Tag: AWS

Demystifying AWS Lambda Invocation Types

In the realm of serverless computing, AWS Lambda has emerged as a cornerstone technology. Its ability to run code without the hassle of setting up and managing servers has transformed the way we develop applications. However, like any powerful tool, understanding its nuances is crucial. In this arti...

A Gentle Introduction to Kafka Consumer Group

You may have heard about Kafka if you are studying for a system design interview or dealing with data-intensive applications. Even if you don’t work with distributed systems before, you probably have heard of “Kafka” during a water cooler chat with your colleagues. In the system...

Mastering AWS Cost Reduction: Mistakes That Skyrocket Your Bill

The ability of AWS to provide almost infinite resources is great and you shall never consider resource constraints when building cloud native applications. However, there’s the economic factor and no one has infinite budgets. I recently reduced my company’s AWS bill for a set of accounts...

Mastering AWS Cost Reduction: Mistakes That Skyrocket Your Bill

The ability of AWS to provide almost infinite resources is great and you shall never consider resource constraints when building cloud native applications. However, there’s the economic factor and no one has infinite budgets. I recently reduced my company’s AWS bill for a set of accounts...

Deploying and fine tuning LLMs in AWS for job listing summarisation

It is not only OpenAI GPT models that glitter, and even more so when it comes to summarisation. That is the journey that we embarked on a few months ago when we started to work on the topic of job listing summarisation. StepStone, one of the world’s leading job platforms, has for a long tim...

My Most Expensive AWS Mistake

I’m a firm believer in learning from others’ mistakes. So to help you out, I’d like to share how I accidentally spent $327.36 in AWS (thank the lord for AWS credits, which saved me). I was looking into migrating database instances from one engine to another recently, so I fou...

$4000 Streamlit Solution with AWS

I previously created a solution for a client that required an efficient way to manage invoices and quotes simultaneously for their staff. Initially, I attempted a solution involving Dropbox. However, this approach fell short as it didn’t support simultaneous collaboration, and frequent renewal...

Building a CI/CD Pipeline for a Serverless Express Application with AWS CDK

Ever wondered how the top tech companies deploy their applications so seamlessly? It all starts with an efficient CI/CD pipeline, the assembly line of the software world. In today’s fast-paced software development environment, mastering this process is crucial for delivering high-quality appli...

26 Terraform Hacks for Effective Infrastructure Automation (With Examples)

Terraform has emerged as a powerful tool for automating provisioning and managing resources across various cloud providers. While many users start with the basics, there are numerous advanced techniques and hacks that can elevate your Terraform expertise to new heights. In this article, we&r...

Step-by-Step Guide to Navigate AWS GameDay — Finding Monoceros

About AWS GameDay AWS GameDay offers an exciting and interactive learning opportunity that replicates real-world scenarios within the AWS (Amazon Web Services) ecosystem. During a GameDay event, teams, typically comprising 1 to 4 members, embark on a journey to tackle challenges across various do...

How to Automate Your Data Science Workflow with CI/CD in GitLab and Dataiku

Continuous Integration and Delivery enable teams to automate all necessary steps to build, test, and deploy code to the production environment. The result is a faster development cycle and a lower error rate. For a data science team, having a CI/CD pipeline is crucial to delivering machine learning ...

How I Nailed the AWS ML Specialty Exam in Just 2 Weeks

The AWS Machine Learning (ML) Specialty exam is often considered one of the most challenging AWS exams. It encompasses a wide range of skills in ML, AWS tools, and services. As a data engineer, I was eager to showcase my proficiency in AWS, machine learning, and data engineering. While there isn&rsq...

Mastering AWS Cost Reduction: Mistakes That Skyrocket Your Bill

The ability of AWS to provide almost infinite resources is great and you shall never consider resource constraints when building cloud native applications. However, there’s the economic factor and no one has infinite budgets. I recently reduced my company’s AWS bill for a set of accounts...

Run AWS on Your Laptop. Introduction to LocalStack.

What is LocalStack LocalStack is a cloud service emulator that runs AWS services solely on your laptop without connecting to a remote cloud provider . How can it help us as a developer? Whether you are, A beginner who is looking to practice your AWS skills but don’t have access ...

Building a Software Engineer Portfolio with Next.js, React, and AWS Hosting

I’ve had a burning desire to craft a digital showcase of my journey as a Software Engineer — a vibrant canvas where I can paint a picture of my academic and personal achievements, my skillsets, and my unwavering passion for cutting-edge technologies. I invite you to delve into the depths...

Aws Lambda that Reacts to S3 File Upload

Today we will see how we can design an architecture where we will upload a file to aws s3, and after the file is uploaded successfully, a lambda will be Triggered. That lambda will download the file and do some operations on it. Some possible options might be Generating a thumbnail version ...

AWS Solutions Architect Professional Cheat Sheet

This material was gathered while preparing for the AWS Solutions Architect Professional Exam. I created and curated this cheat sheet with useful information that will be handy to review before taking the exam. This article’s objective is to gather different notes, topics, and details that I...

How I Reduced Our AWS Cloudfront Data Transfer Cost from $1000+ to Under $400

When running an e-commerce platform, especially one hosting a vast amount of images for multiple websites, the costs associated with data transfer can quickly add up. As a Senior Technical Product Manager (hands-on with day-to-day coding and contribute to features as an IC), working on ...

Fine-tuning Stable Diffusion with Dreambooth in AWS SageMaker Studio

In school, I went through engineering (read CAD) drawing. I can draw an isometric view of something I want to build or a part I need to fabricate. By hand, it’s not great quality, but it gets the job done. In CAD software ( like SketchUp), I can do a pretty good job. I am absolutely abysmal wh...

Most Organizations Make This Mistake with AWS DynamoDB

DynamoDB is known for its flexibility, scalability, and high-performance capabilities. But like any powerful tool, it’s easy to make mistakes if you’re not careful. Many organizations begin their journey with DynamoDB using it in proof-of-concept (POC) applications. However, because of t...

Terraform AWS Provider — Everything you need to know about Multi-Account Authentication and Configuration

There are multiple options available to configure the authentication between Terraform and AWS. But the two entry points are IAM users and IAM Identity Center Users (SSO). The Authentication is configured in the Terraform AWS Provider, To choose an option will depend among other things if you are ex...

Optimizing AWS Batch Workloads: Concurrent Batch Jobs Execution using Lambda, S3, and ECR

Situation: While working on building Machine Learning models for 70 different countries (with one model dedicated to each country), we encountered the requirement to execute a specific set of post-processing tasks for each of these countries. To streamline this process and enable the concurrent trig...

How to deploy AWS EKS Cluster and associated resources through Terraform and Jenkins

In our experience, establishing resources on AWS or any major cloud provider is a demanding and less favored undertaking. To effectively navigate this complex terrain, it is imperative for business organizations to empower their IT Operations team to adopt a mindset centered around automation. This ...

Effortless Scalability: How Asynchronous Lambda Invocation Transforms AWS Workflows

Situation: While working on working multiple countries/regions file (with one file dedicated to each country), we encountered the requirement to execute a specific set of data cleaning, validation, transformation and enrichment task for each of these countries. To streamline this process and enable ...

Using AWS single sign-on within your Docker containers

If you deploy applications to Amazon AWS EC2 instances, you probably make a lot of use of Amazon-specific features. In my case, I happen to use Amazon’s Systems Manager to store configuration parameters for my applications. When developing code locally I would also like to be able to run th...

Troubleshooting AWS Load Balancer with EKS

When setting up an AWS load balancer for an EKS cluster, you may run into issues with the ingress controller pods. The key is setting up proper identity and permissions. The Issue When I first set up the load balancer, the ingress controller logs showed errors like: "Unexpected statu...

Amazon SNS Notification Topics Subscribe From AWS Lambda

In this article, we are going to subscribe Amazon SNS topics from AWS Lambda Functions. This will be hands-on lab for Amazon SNS Notifications Subscribe From AWS Lambda. Amazon SNS Topics Subscribe From AWS Lambda By the end of the article, we will develop AWS Lambda function which subscri...

Awesome AWS EC2 Features You May Have Overlooked

The AWS ecosystem is an absolute behemoth of features and services. It would take multiple lifetimes to master everything AWS has to offer. Figuring out how to work effectively with just one of the most popular products, EC2, is still itself quite the challenge. There are tons of different ways you ...

THE AWS VPC, BUT SO SIMPLIFIED A 10-YEAR-OLD CAN UNDERSTAND.

Having your services run in the cloud means that your networking has to be nothing but perfect, Miss even a single step and you have your service either isolated from other services they are supposed to talk to or even worse, you have it exposed to the malice of the internet. In AWS, every service h...

Using AWS Like A Pro: Best Practices From Solutions Architects

I’ve been using the cloud, predominantly AWS, for around 10 years now and hold the AWS Solutions Architect Professional Certification being a certified solutions architect for over 5 years. In 2018, I got my SA-A badge and my SA-Pro badge in 2021. Further, I had the pleasur...

Mambu announces availability in AWS Marketplace

Mambu empowers financial institutions with the cloud infrastructure and services they need to differentiate and adapt Mambu, a leading Software as a Service (SaaS) cloud banking platform, today announced it is now available in AWS Marketplace, making it one of the first core banking providers...

Migrating AWS Infrastructure From Terraform to AWS CDK

Introduction Managing cloud infrastructure has evolved with tools like Terraform and the AWS Cloud Development Kit (AWS CDK) leading the way. Terraform has been a trusted ally for many, helping to set up and manage infrastructure smoothly. But now, AWS CDK is stepping up, promising more features ...

Creating EKS Cluster From AWS Console : Part 1

This Article is part of my main article How to Deploy Microservices in EKS with ArgoCD, Secure AWS Infrastructure via Terraform, Automate Deployment via Gitlab CI/CD ← CI/CD Pipeline for Terraform Deployment Recap(); In last article, we create pipeline for Terraform Deployment ...

How to Deploy AWS Autoscaling Groups with Terraform

In this article, we will take a look into how to manage and deploy autoscaling groups in Amazon Web Services (AWS), explaining what they are, their purpose and functions, and how they differ from a launch configuration group, before showing how to create an auto-scaling group with Terraform examples...

How You Can Land the $275,000 Job at AWS As I Did

Are you ready to unlock the door to a $275,000 job at Amazon Web Services (AWS)? Transitioning from engineering to technology, I embarked on a thrilling journey to establish myself at one of the world’s tech giants, and I’m here to guide you through it. In this article, I will unco...

Deploy FastAPI to AWS Elastic Beanstalk (Zero to Hero)

This guide will go over how to deploy a FastAPI app, add a `postgres` database, and attach a SSL certificate (assuming you have purchased a custom domain). Prerequisites This tutorial will be using pipx to install the Elastic Beanstalk CLI. Follow the instructions here&nbsp...

How I Passed the AWS Solutions Architect Associate (SAA-CO3) Exam in 2023

If you have found this article, it means you are interested in taking the AWS Solutions Architect Associate Exam, so let me make it easy for you. In April 2023, I took the SAA-CO3 exam. It took me 2+ months of preparation and practice to pass the exam. MY BACKGROUND: I work as a Data Analyt...

AWS SAA-26: Kinesis

Amazon Kinesis is a family of real-time data streaming and processing services provided by Amazon Web Services (AWS). These services enable you to ingest, process, analyse, and respond to streaming data at scale. Kinesis is designed to handle large volumes of real-time data from sources such ...

AWS CloudWatch: Monitoring and Management Made Easy

Introduction Welcome to another exciting article from Cullan Carey’s Tech Blog! In this post, we’ll explore the powerful capabilities of AWS CloudWatch, a comprehensive monitoring and management service provided by Amazon Web Services (AWS). Key Features AWS CloudWatch offers a ...

AWS API Gateway and S3 Integration (encouraging the correct way)

Amazon S3 Amazon Simple Storage Service (Amazon S3), often referred S3, is a highly scalable, secure, and flexible cloud storage service provided by Amazon Web Services (AWS). It was introduced in March 2006 and has since become one of the most widely used object storage services in the world. ...

AWS Bedrock on Snowflake (Talk to Claude, LLAMA)

Yes it is that simple to connect to AWS Bedrock directly from Snowflake without the need for snowflake external function or API Gateway. When AI Sneaks into Data Warehousing: Expect the Unexpected snowflake-x-aws Overview of AWS Bedrock Amazon Bedrock is ...

Simplifying An AWS Network Design

Today I was working on my container for my Lambda function to use as a trigger for AWS CodeCommit to push to an S3 bucket. I started by revamping my base container based on findings from prior posts so I can use a single container with all the base files required for my bash custom runtime. More on ...

AWS Rekognition For Advanced Image and Video Analysis

AWS Rekognition, a cloud-based machine learning solution by AWS, empowers developers to identify objects, settings, individuals, and inappropriate content within images and videos. The system uses extensive application programming interfaces (APIs) to accurately recognize individuals and interpret t...

FastAPI App Deployment Using AWS Lambda And API Gateway

FastAPI is a modern fast (high-performance) web framework for building APIs with Python. FastAPI features FastAPI gives you the following, based on open standards OpenAPI for API creation, including declarations of path operations, parameters, body requests,...

Deploying a Node.js Application on AWS

Synopsis In this blog post, I’ll walk you through the steps to deploy a Node.js application on the AWS cloud. Along the way, I’d demonstrate how to leverage Termius, a versatile SSH platform that works on both mobile and desktop. Additionally, I’ll guide you on how to communicat...

Understanding AWS Security Groups and NACLs: A Simple Guide for Beginners

In today’s online world, it’s essential to keep your cloud storage safe. If you’re using Amazon Web Services (AWS), it’s vital to know about tools like Security Groups and NACLs. They help decide who can see or use your cloud data and where they can do it from. Let’s...

How to set up AWS CLI with AWS Single Sign-On (SSO)

To get access to your AWS Account with the AWS CLI and AWS SSO, you need to install AWS CLI and enable AWS SSO in the AWS Console. After enabling AWS SSO, you create an SSO user with a permission set. AWS SSO makes it easy to centrally manage SSO Access to multiple AWS account...

Using AWS EventBridge + Lambda to handle auction timeline.

In the world of car auctions, timing is everything. Ensuring that each auction ends precisely when it’s supposed to is crucial to maintaining efficiency and customer satisfaction. However, as the scale of our operations grew, we encountered a significant challenge with our traditional cron-bas...

Optimizing AWS Costs: Your Handbook to Financial Efficiency — Part 2

Hello, dear readers! Welcome back to our journey of optimizing AWS costs. In Part 1, we laid the foundation by exploring various essential strategies for cost optimization in the AWS cloud. Now, in Part 2, we’re ready to take a deeper dive into a treasure trove of cost optimization techni...

Enhancing Security for Toll SDK on AWS Infrastructure

Protecting your TollGuru SDK deployment on AWS is paramount for data integrity and consistent service access. This guide will walk you through essential steps to enhance the security of your TollGuru SDK setup, focusing primarily on two key areas. Setting up SSL Certificate for HTTPS Usage A...

Discovering the Synergy Between AWS Lambda and API Gateway

The world of cloud computing is vast, but among its vast array of services, AWS Lambda and API Gateway stand out, especially when you harness them together. Here’s a more detailed look into these game-changing services. AWS Lambda: More Than Just Function Execution The Heartbeat of S...

The Power of IAC with AWS Cloudformation

At Paragon Cloud Consulting, we help businesses migrate their infrastructure to the cloud and build custom cloud-native applications optimized for scalability and reliability.As a company with extensive experience on the AWS platform, we have seen firsthand how implementing Infrastructure as Code (I...

The Next Generation Video Processing Technology: A Guide to AWS DeepLens

Internet of Things applications can handle more information operations owing to computational frameworks and improvements in hardware. In addition to improving latency and bandwidth, the proximity of resources also enables developers to handle security issues with sensitive data by lowering the risk...

Testing Toll SDK deployed on your AWS Cloud

Introduction This guide outlines steps to monitor and test your TollGuru SDK deployment within Kubernetes, ensuring your toll calculation service operates smoothly. We’ll check the pod and service status, then provide a manual testing process to confirm the successful deployment, and finall...

Blue-Green Deployments With AWS Lambda

Developing resilient software is great, but updating it seamlessly without any disruptions to the users is a skillful art. It’s quite a challenge. One strategy that has gained momentum is the Blue-Green deployment method. What is the Blue-Green Deployment Strategy? The Blu...

Automated user migration and management of AWS Identity and Access Management (IAM) resources

In this project based on a real-world scenario, I acted as Cloud Specialist with the mission to migrate users in an automated way and manage AWS IAM (Identity and Access Management) resources. There were 100 users that needed to be migrated and have MFA (Multi-factor authentication) enabled on th...

Creating resources in multiple AWS accounts using Terraform

As a beginner when I was creating my first terraform code, I created an EC2 instance with a role attached that had the necessary IAM privileges. This kind of made it easy for me to not expose any keys or go into too many configurations when setting up the provider. terraform { required_provi...

Sticking with Success using AWS Glue:

In one of my previous articles on using AWS Glue, I showed how you could use an external Python database library (pg8000) in your AWS Glue job to perform database operations. Click on the link below to read that story. Connecting external database libraries with AWS Glue Using pg8000 awstip...

8 Top Strategies for AWS Certifications Success

Becoming a Senior Solutions Architect at AWS was a transformative moment in my career. It marked the beginning of a remarkable journey, one that would see me earn all 12 AWS certifications in just a year — a feat that I’m immensely proud of. What’s even more exciting is that I a...

Stop wasting money on AWS

Welcome back to our journey of exploring Grafana Cloud! In today’s story post, we will focus on an essential aspect of monitoring and managing your cloud infrastructure — setting up alerts. Specifically, we’ll cover how to configure alerts for EC2 instances and AWS billing in Gr...

Your First Steps with AWS

Have you ever think about learning cloud technologies and think “A lot of people talk about AWS, but I’m not sure what it is”? Well, we all started there. AWS is one of the most popular cloud providers in the world, along with Azure (Microsoft’s cloud service) and GCP (Goo...

Ditch the Layers: Exploring the Benefits of Dockerized AWS Lambda

AWS Lambda has been a game-changer in cloud computing, offering seamless serverless code execution. However, as applications grow in complexity, managing dependencies with Lambda Layers can be a headache. Lambda Layers, though handy, are not always the easiest to work with. Managing and updating ...

AWS Basics for DevOps Learners: How to Use User Data and IAM Roles

User data is a feature of Amazon EC2 that allows you to pass custom configurations and commands to your EC2 instances when you launch them. You can use user data to perform common automated tasks such as installing software, configuring settings, running scripts, etc. User data can be very useful fo...

Deploying a MERN Stack Application on AWS Server

Introduction Still on my journey to become a cloud engineer, we’ve come a long way from bash scripting to python and Learning the foundational services that AWS provides. Join me as a take a breather before we embark on today’s task. Feeling overwhelmed, you’re not alone i feel ...

Why I Chose AWS Over Azure and Google Cloud as My Employer

As I sit down to share my story, I can’t help but reflect on the critical moment when I had to make a career-defining choice. It was a decision that would shape the trajectory of my professional life and open doors to a world of endless possibilities. I faced the decision of choosing betwee...

How to Generate a Presigned URL for AWS S3 using Node.js and AWS SDK v3

Accessing private objects in AWS S3 sometimes requires providing temporary access without altering object visibility. Presigned URLs are a means to this end, granting short-lived access for tasks such as sharing or one-time access. Prerequisites: AWS Account: You need to have an AWS account...

Top 10+ Scenerios based AWS Interview questions and answers| Part-1

Question-1 : How would you set up a highly available web application in AWS using EC2, ELB, and Auto Scaling? A high-level overview of the steps to set up a highly available web application in AWS using EC2, ELB, and Auto Scaling: · Launch multiple EC2 instances in multiple Availability...

RAG-ing Success: Guide to choose the right components for your RAG solution on AWS

With the rise of Generative AI, Retrieval Augmented Generation(RAG) has become a very popular approach for using the power of Large Language Models (LLMs). It simplifies the whole Generative AI approach while reducing the need to fine-tune or eventually train an LLM from scratch. Some of t...

AWS VPC Peering vs. AWS Transit Gateway

Amazon Web Services (AWS) provides multiple solutions for connecting virtual private clouds (VPCs) and on-premises networks, but two commonly used options are VPC peering and AWS Transit Gateway. In this article, we will explore these two connectivity solutions, compare their features, and he...

AWS Cloud Data Engineering End-to-End Project — EMR, EC2, Glue, S3, Spark, Zeppelin

Overview In this project, we are going to upload a CSV file into an S3 bucket either with automated Python/Shell scripts or manually. We are going to create a corresponding Glue Data Catalog table. The main part will be establishing a new EMR cluster. After creating it, we are going to run a Spar...

My one month experience using AWS SageMaker

… from the previous episode As a follow-up to my previous Medium post on the ever-evolving nature of data science and the need for continuous upskilling, I want to share some insights on the second stage of my upskilling plan. In this post, I will be discussing the AWS implementa...

Lakehouse — Databricks vs. AWS EMR

Disclaimer: The decision on which ETL tool to use took place in May, EMR Serverless was in preview, and it did not support Delta Lake natively back then. About this blog series At claimsforce, our initial approach to big data was a two-tier architecture consisting of a Data Lake stage in ...

Quick Blog: Databricks DLT consuming from AWS MSK Kafka Topics

This quick blog shows an example architecture of Databricks deployed using Customer Managed VPC, with private MSK cluster in the same VPC. By providing your own VPC to host Databricks and MSK, you can customize networking objects and keep MSK traffic private. After building this platf...

How to deploy a Docker Image on AWS and Run it on Fargate

In this story, I will show you how to create and upload a Docker image from your computer to Amazon Elastic Container Registry (ECR) and Amazon Elastic Container Service (ECS) and run it on Fargate. You will create a Target group and an Application Load Balancer (ALB) that will act as a load balance...

Project 3 →Aws DevOps Deployment

above command pulls your aplication code to your local that is need to pushed in aws code commit step 2 →Setup code commit go to aws console search aws code commit and create a demo repository 2. provide necessary permission to aws code commit to use it with aws cli which need...

Migrate from AWS Beanstalk to AWS ECS in a Simple Way

What will be our main goals? Setup the initial AWS infrastructure. Having a CI/CD pipeline which will deploy new changes. Having a public URL (HTTP for now) where we can access our application. What we’ll deploy: I’ll present a bash script that I’ve build for myse...

AWS ECS Cluster on EC2 with Terraform (2023)

This short guide will describe how to create an AWS ECS Cluster on EC2 in 2023. Basically there are already articles and code samples on the Internet, but some products in AWS are becoming obsolete (like Launch Configuration) and Terraform is undergoing API changes. So the purpose of this article is...

Optimizing AWS Batch Workloads: Concurrent Batch Jobs Execution using Lambda, S3, and ECR

Situation: While working on building Machine Learning models for 70 different countries (with one model dedicated to each country), we encountered the requirement to execute a specific set of post-processing tasks for each of these countries. To streamline this process and enable the concurrent trig...

AWS Containerization With Docker, ECR, ECS & Fargate

Containerization has emerged as a dominant strategy for many organizations seeking agility, efficiency, and consistency in their web deployment processes. Using Docker Hub in combination with AWS ECR can be considered a hybrid approach to containerization of web applications, com...

AWS- OIDC Identity Provider For EKS Cluster

When you create an Amazon EKS cluster, it is by default configured as an OpenID Connect (OIDC) identity provider (IdP). This means that it can be used to provide federated access to AWS resources, just like Google, Microsoft, and Facebook IdPs. AWS also supports IdPs compatible with OIDC to establi...

Automating an E-Commerce Platform Deployment and Monitoring on AWS

Hello there! As I continue my journey to master DevOps practices, I am excited to share my insights gained from tackling this substantial project. In this comprehensive blog series, using a variety of technologies we’ll explore the process of creating and automating an e-commerce platform t...

Microservices Resilience and Fault Tolerance using AWS JDBC driver

Developing reactive and resilient microservices entails creating a highly scalable and distributed architecture. To meet the demands of resiliency and fault tolerance, it is crucial to address the following aspects of failure management: Proactively Avoiding Faults Effectively Isolating Faul...

How AWS CloudWatch Agent on Kubernetes Blew Our AWS Bill

When running a microservice-based architecture, traffic flows from the front-end, passes through multiple microservices, and eventually receives the final response from the back-end. Kubernetes is a container orchestrating service that helps us run and manage these numerous microservices, including ...

AWS- OIDC Identity Provider For EKS Cluster

When you create an Amazon EKS cluster, it is by default configured as an OpenID Connect (OIDC) identity provider (IdP). This means that it can be used to provide federated access to AWS resources, just like Google, Microsoft, and Facebook IdPs. AWS also supports IdPs compatible with OIDC to establi...

Terraform AWS Provider — Everything you need to know about Multi-Account Authentication and Configuration

There are multiple options available to configure the authentication between Terraform and AWS. But the two entry points are IAM users and IAM Identity Center Users (SSO). The Authentication is configured in the Terraform AWS Provider, To choose an option will depend among other things if you are ex...

Deploying an Apache Cassandra Cluster in AWS with Terraform

In this guide, we’ll take you through the process of setting up an Apache Cassandra cluster in AWS using Terraform, an infrastructure-as-code tool. Apache Cassandra is a powerful NoSQL database known for its scalability and fault tolerance, making it a popular choice for distributed ...

Migrating AWS Infrastructure From Terraform to AWS CDK

Introduction Managing cloud infrastructure has evolved with tools like Terraform and the AWS Cloud Development Kit (AWS CDK) leading the way. Terraform has been a trusted ally for many, helping to set up and manage infrastructure smoothly. But now, AWS CDK is stepping up, promising more features ...

Automate AWS SSO Using Terraform

Managing user access and permissions across multiple AWS accounts in an AWS Organization can be a complex and time-consuming task. However, with the power of Infrastructure as Code (IaC) Terraform, you can automate the provisioning and management of Single Sign-on (SSO) users, groups, and ...

Harnessing Terraform In Deploying a Dating App On AWS

Synopsis In this blog post, I’ll walk you through the steps to deploy a landing page for a dating app I created on the AWS cloud. Along the way, I’d demonstrate how to leverage Terraform, an in-demand infrastructure as code tool. Additionally, I’ll guide you on how to communicat...

How to import existing AWS resources using Terraform?

Terraform is a free and open-source infrastructure as code (IAC) that can help to automate the deployment, configuration, and management of remote servers. Terraform can manage both existing service providers and custom in-house solutions. Read more about Terraform here Terraform W...

Revolutionize AWS Resource Management with Terraform Automated with Gitlab CI/CD

Managing AWS resources manually can be time-consuming and prone to errors. By using Terraform automation with GitLab CI/CD, you can manage AWS resources efficiently with infrastructure as code techniques, eliminating human error and speeding up the deployment process. In this medium article, ...

A Brief Practical Demonstration of Building AWS Infrastructure Using Terraform

Today, let’s get into a brief Terraform illustration. It’s beneficial to understand Terraform’s workings, even if you’re not directly responsible for its execution. Here’s a straightforward demonstration of Infrastructure as Code (IaC) employing Terraform to establish a...

AWS VPC — Using Terraform Modules

AWS VPC (Virtual Private Cloud) is a networking service that allows you to create a private, isolated virtual network within the AWS cloud. Here are some key points to note about AWS VPC. Isolated Virtual Network: A VPC provides a logically isolated virtual network environment where ...

How to Deploy AWS Autoscaling Groups with Terraform

In this article, we will take a look into how to manage and deploy autoscaling groups in Amazon Web Services (AWS), explaining what they are, their purpose and functions, and how they differ from a launch configuration group, before showing how to create an auto-scaling group with Terraform examples...

Terraform: Building AWS Infrastructure for Analyzing Resource Costs with AWS Cost and Usage Reports and Amazon Athena

In today’s cloud-driven landscape, managing costs and optimizing resource utilization is of utmost importance for organizations leveraging AWS. To gain deep insights into AWS resource costs and effectively analyze usage patterns, deploying a robust architecture is essential. With the power of ...

Terraform — AWS Site-to-Site route-based VPN with Transit Gateway

In this article, I will demonstrate a straightforward Terraform script for deploying a site-to-site VPN with a Transit Gateway. Here are some key concepts related to AWS VPNs: Customer Gateway: A resource that contains information about the remote (customer) device. Transit Gateway: Serve...

3 Ways to Configure Terraform to use your AWS Account

There are basically 3 different approaches you can use to allow Terraform to connect and authenticate successfully to AWS. For your consideration: It is advisable that you create a dedicated set of AWS credentials from the IAM console with programmatic access for your Terraform CLI. Make sure ...

Using Helm with Terraform to deploy AWS Load Balancer Controller on AWS EKS

What is Helm? Helm is a tool that works as a package manager for automating the creation, packaging, configuration, and deployment of Kubernetes applications by combining different Kubernetes configuration files into a single reusable package. Advantages of using helm over kubernetes manifest ...

AWS CDK vs Terraform

IaC is one of the key DevOps practices, and AWS CDK & Terraform are both great IaC tools to manage your AWS infrastructure. Having used both extensively, let me share my experience with the 2 IaC tools. AWS CDK vs Terraform Import Existing Resources There could be many scenarios whe...

Automating AWS Infrastructure with Terraform and Jenkins: A Step-by-Step Guide

In today’s fast-paced world, automating the provisioning and management of infrastructure is essential for efficient and reliable deployment of services. Terraform, a popular infrastructure as code (IaC) tool, combined with Jenkins, a powerful automation server, provides a robust solution for ...

AWS Cloud Services(AWS CloudWatch , IAM )

If we want to keep monitoring your physical resources then we have service available in AWS called Cloud Watch. How much memory is utilize? , How much CPU issued? ,How much Network Band width is used? ,How much data is transferred from internet to instance? All of this terms are known as Metrics....

How to deploy Node.js application on AWS with Github

As a very first step, we need to configure an EC2 instance and securely SSH into it. To learn how to create an EC2 Linux(Amazon Linux) instance, please refer to my previous article on “Securely SSH into AWS EC2 Linux instance”. After successful SSH into EC2 instance, we will follow th...

How to Configure FTP on AWS EC2

When I need to send or receive data/files from one system to another system in a secure way, in my mind there is only one protocol which is FTP(File Transfer Protocol). File Transfer Protocol (FTP) is a standard network protocol used for the transfer of computer files between a client and a ...

Easy way to add a layer in AWS Lambda

AWS Lambda is a powerful tool for running code in the cloud without the need for infrastructure management. It interacts perfectly with other AWS cloud services, however, to make your function more scalable and manageable, sometimes you need to add additional libraries or dependencies. AWS prov...

Setting up Windows Active Directory on AWS

Step 1: Launching a Windows Server instance in AWS Log into your AWS console and navigate to the EC2 service. Click on the “Instances” tab on the left side of the screen. Click on the “Launch Instances” button. In the AMI selection screen, type “Windows&rdqu...

AWS + Melbourne

Earlier this week, I attended the AWS Cloud Day in Melbourne — a first after the AWS Melbourne region was launched earlier this year. The event was much better than what I had expected — higher turnout, superb conversations, and great energy. Throughout the day, which s...

AWS Cloud Day Prague 2023: A must-attend event for businesses in the digital age

The event kicked off with a morning keynote from Tibor Kolejak (Senior Director, Enterprise for the Czech Republic & Slovakia at AWS), Clare Liguori (Senior Principal Software Engineer at AWS), and customer speakers. It focused on the current status of cloud adoption in Central Eastern Europe, t...

Day out at 2023 AWS Summit Toronto

I had the pleasure of attending the recent AWS Summit Toronto held on June 14, 2023, at the sprawling Metro Convention Center — South building. The main goal for me was to learn about all the exciting new products and services that AWS is coming up with that simplify buildi...

Reinforcement Learning with AWS DeepRacer

In March 2016, Lee Sedol, the greatest Go player of the past decade, was defeated 4–1 by AlphaGo. Computers have beaten the best humans at chess before, but Go is at another next level at complexity. Do you know what’s even crazier? The machine had only been learning how to pla...

Windhavi FontIntroduction to AWS & Creating AWS account

AWS, is a cloud computing platform provided by Amazon. It offers a wide range of services, including computing, storage, and databases, among others. AWS is designed to be flexible, scalable, and cost-effective, making it an ideal choice for startups, small businesses, and large enterprises alike. ...