Big Data Processing using AWS services* Conceptualized the required AWS services like EMR, Glue, Redshift, Athena, Stepfunction, Notebook, S3, Lambda, for processing and migrating Bigdata* Proficient in designing and executing AWS EMR Spark jobs for large-scale data processing, with expertise in optimizing performance and efficiency. Experienced in loading processed data into AWS Redshift tables using AWS Glue for streamlined analytics pipelines.* Created AWS Glue Crawler to crawl the data from the S3 bucket into the glue catalog database* Provisioned AWS Glue job to process the ETL operation using pyspark scripts stored in the S3 bucket* Defined AWS Stepfunction workflow to trigger Glue jobs and publish error messages in case of job failure via AWS SNS service* Implemented all the required AWS Big Data resources using Infrastructure as Code methodology via AWS CDK* Monitored Glue jobs over the AWS Glue Studio console and AWS resources using CloudWatch and implementing optimization strategies to improve performance and reduce costs.IAM, Networking, and Security* Created IAM roles for Glue and attached In-line policies and AWS-managed policies to access required AWS services

Cloud Migration Strategy & Approach* Planned & strategized migration approach by project scope and delivery deadlines* Interacted with clients to ensure complete & thorough understanding of all requirements* Suggested the migration approach to the clients & internal team and got the approval for the solution of using AWS* Cloud Development Kit (CDK) as a migration tool to provision and deploy the required AWS resources for the migrationData Migration using AWS DevOps tools* Spearheaded complete migration activity of backend application to AWS* Deployed latest patches & updated versions of application code directly via CICD pipelines* Implemented all the required AWS DevOps resources using Infrastructure as Code methodology via AWS CDK