Project: Manage, Enhance and Cost Optimization for Human Resources System hosted on AWS.• Developed and managed a customer’s core infrastructure hosted on AWS cloud for handling contracts, human resources, and access management from over 100 subsidiary companies globally, utilizing 10 primary data sources. This system manages user identity and access lifecycles, integrates user details from HR systems, provides automated entitlement access, manages user access across IT systems, ensures periodic reviews to meet security and regulatory standards, and handles access deactivation upon user departure. The processed data integrates into the parent corporation’s data center, serving 13 target systems, including Active Directory, messaging systems, workplace management, and IT services.• Provided guidance and support to operations personnel, ensuring smooth and efficient operations.• Optimized and refactored the existing codebase to enhance AWS service utilization, resulting in a 50% reduction in ETL execution time and a 30% decrease in running costs.• Developed an API solution using AWS services for data exchange between systems and data sources, eliminating the additional cost of using third-party solutions.

Project: Build Data Lakehouse Platform on AWS for Warehouse Operations Optimization Project.• Extracted data from Oracle and IDM DB2 data sources spanning multiple warehouses across 9 cities, totaling approximately 200 GB of data over several years, into the raw data layer on S3 using AWS Glue.• Deployed a Lakehouse data model on AWS platform using Glue and Athena for data cleansing, mapping, transformation, and enrichment before loading into the active layer on S3.• Worked with the Data Scientist team to integrate AI solutions into the data platform. This process included deploying containerized tasks on an Amazon ECS cluster. Leveraged data queried from AWS Athena to process and transform it, and subsequently loaded the processed output into an Amazon RDS PostgreSQL database• Implemented CICD process using CloudFormation for consistent deployments across environments.• Developed event-based trigger notifications utilizing AWS EventBridge, Lambda functions, and SES (Simple Email Service) to promptly alert stakeholders of job run failures, enhancing operational responsiveness and reliability.

Project: Migrate VM-based system from on-premises to AWS.• Collaborated in designing and implementing the migration solution to transition VM-based systems from on-premises infrastructure to AWS cloud environment.• Deployed a cluster of EC2 instances behind a Load Balancer to capture messages and generate operations from Sailpoint IdentityNow (IDN). Messages were processed and converted into actionable tasks, which were queued in AWS SQS. Then, these tasks were executed on Windows-based servers on EC2 instances to manage operations on Active Directory, Exchange, and related systems.• Migrated the central Samba file share storage to AWS using Storage Gateway for S3 storage.• Automated patch management process for EC2 instances using AWS Systems Manager, ensuring timely and secure updates across the environment.• Automated the CI/CD pipeline using Terraform and AWS CodeBuild to facilitate blue-green deployment.

Project: Azure Cloud Migration Project.• Participated in analyzing legacy system comprising 2 databases and over 30 data tables, including tables with more than 300 million records, to translate 372 complex business metrics into new data transformation logics.• Ingested historical data from on-premise to ADLS using ADF for batch processing.• Ingested data from Kafka to ADLS for near real-time streaming solution.• Developed Spark Scala jobs deployed on Azure HDInsight cluster to process data in ADLS into STG (Staging), TRANS (Transformation), HUB (Hub), and PUB (Publish) layers, which enable data virtualization using Dremio and data visualization through PowerBI in the downstream.• Created documentation outlining the new data flow architecture and processing steps, enabling stakeholders to understand and validate the data integration processes effectively.