Working as a Big Data Engineer at North Bay on a US Based Client Project.My major responsibilities are:-- Enterprise Data-lake orchestration to process data at different stages from ingestion till publish-- Manage System configuration and data encryption-- Infrastructure as a codeCloud based Infrastructure (POC):-- Work Flow orchestration using AWS step function-- Automation through AWS Cloud Formation-- Logs analysis in AWS Elstic search clusterData warehouse Migration:-- Migrate Staging Tables on Red shift using hadoop.-- Update mapping Document for Dim and fact tables.-- Populate Dim and Fact tables using ELT techniques.-- Analyzing and Reviewing code to ensure adherence to working development standards worldwide.

Manage IAM role for AWS users.Vertica database backup, storage and server maintenance on AWS infrastructure.Deploy auto scalable, fault tolerant, highly available and reliable applications on AWSSelect appropriate AWS services to design and deploy an application based on requirements.Minimize AWS infrastructure cost.Automate tasks using python and ansible.