The Secret Serverless Computing Service in Azure
<p>As a <a href="https://www.dmesh.io/" rel="noopener ugc nofollow" target="_blank">small team of data engineers and data scientists</a>, we often work on projects that involve designing and implementing <strong>data processing solutions</strong> for various customers. Recently, we had an interesting challenge: one of our customers had developed an optimisation<strong> algorithm</strong> that they wanted to run on a <strong>container-based</strong> platform in the <strong>cloud</strong>. The algorithm was designed to solve a complex optimisation problem that required some specific libraries installed in a Linux environment. The customer wanted us to design and implement an architecture that could run a data processing job on a daily basis, using their optimisation algorithm as the core component. The job would take about <strong>10 to 20 minutes</strong> to complete, and the customer expected to run about <strong>five jobs per day</strong>. It all had to be <strong>extremely</strong> <strong>cost-effective</strong> and <strong>secure</strong>, meaning that only authorized users or systems could create job runs and view the results. Once rolled out, we would have to maintain the architecture, so monitoring and observability were also important aspects for us.</p>
<p><a href="https://dmesh-io.medium.com/the-secret-serverless-computing-service-in-azure-99a9e01b8c3f"><strong>Visit Now</strong></a></p>