Working in AdTech Domain

* Experience in AWS Infrastructure as a code(laC) development (Cloud Formation, Lambda, Glue, Redshift, etc.) following best CI/CD practices.* Working with the Pharma domain. The project deals with Providing useful Insights, uploading files, extracts and historical data from on-prem to AWS S3 and performing all ETL operations through Glue, adding triggers via Lambda. Copying data (S3 copy) in Redshift, developing automatic validation process for ETL data feeds.* Working with… Show more * Experience in AWS Infrastructure as a code(laC) development (Cloud Formation, Lambda, Glue, Redshift, etc.) following best CI/CD practices.* Working with the Pharma domain. The project deals with Providing useful Insights, uploading files, extracts and historical data from on-prem to AWS S3 and performing all ETL operations through Glue, adding triggers via Lambda. Copying data (S3 copy) in Redshift, developing automatic validation process for ETL data feeds.* Working with different libraries like boto3, PySpark and Python SDK for integrating redshift withglue which reduced cost for querying the database.* Creation of workflows with AWS Prefect and integrating Step function (orchestration)for loading data in facts and dimensions.* Ability to work with serverless architecture and deploying using CI/CD pipeline.* Actively involved in providing RCA, dig deep to understand end-user impacting issues and provide actionable long-term fixes. Show less