Effortless Scalability: How Asynchronous Lambda Invocation Transforms AWS Workflows
<p><strong>Situation</strong>: While working on working multiple countries/regions file (with one file dedicated to each country), we encountered the requirement to execute a specific set of data cleaning, validation, transformation and enrichment task for each of these countries. To streamline this process and enable the concurrent execution, I harnessed the capabilities of AWS Lambda, S3, and ECR to effectively achieve a highly efficient workflow.</p>
<p><strong>Task</strong>: The task at hand is to set up a serverless system that can concurrently and seamlessly trigger multiple AWS Lambda(s), each of which is based on one of the rows in the configuration file. To accomplish this, it’s essential to create a well-coordinated system where one Lambda function acts as an <strong><em>orchestrator </em></strong>and another Lambda acts as the <strong><em>worker </em></strong>for these tasks.</p>
<p><a href="https://akash-mathur.medium.com/effortless-scalability-how-asynchronous-lambda-invocation-transforms-aws-workflows-b7b0000bd26d"><strong>Read More</strong></a></p>