Developed AWS Data pipelines that consume real time customer data from Kinesis data streams and stored the information in CDH and EDW Redshift tablesWorked on automating jobs using Lambda functions to perform Data quality checks on incoming customer dataImplemented AWS solutions using S3, EC2 instance, EMR Cluster, Glue Crawler, Athena, Code commit, Lambda, Event Bridge, Step functionsProgrammed and designed solutions for customer data processing in AWS using PysparkFamiliar… Show more Developed AWS Data pipelines that consume real time customer data from Kinesis data streams and stored the information in CDH and EDW Redshift tablesWorked on automating jobs using Lambda functions to perform Data quality checks on incoming customer dataImplemented AWS solutions using S3, EC2 instance, EMR Cluster, Glue Crawler, Athena, Code commit, Lambda, Event Bridge, Step functionsProgrammed and designed solutions for customer data processing in AWS using PysparkFamiliar with real-time data streaming using kafkaOrganized and cleansed the data in S3 buckets using AWS Glue and processed data using RedshiftDeveloped lambda jobs that reject customer profile data based on data validity and creates error log in DynamoDBDesigned SNS topics for reject handling and data collection notification for error and log information to EDWBuilt conversion jobs that transform the raw customer data and creates load ready files for EDW and downstream analytical consumersDeveloped and designed ETL data processing applications using AWS glue to process customer data from transactional data stores to load into analytical EDW redshift tablesCoordinated with Product and business team while working on high priority jira stories. Show less

Knowledge on P&C Insurance domain with Policy Center experience along with Claims center and Billing center using Guidewire software applicationDesigned role-based access controls to safeguard data and worked on creating data pipelines and ETL jobs to serve analytical and operational needsBuilt data pipelines and ETL jobs using EMR clusters to transform and store data in Redshift and developed data extraction layers and presentation layers for the analyst communityStorytelling using… Show more Knowledge on P&C Insurance domain with Policy Center experience along with Claims center and Billing center using Guidewire software applicationDesigned role-based access controls to safeguard data and worked on creating data pipelines and ETL jobs to serve analytical and operational needsBuilt data pipelines and ETL jobs using EMR clusters to transform and store data in Redshift and developed data extraction layers and presentation layers for the analyst communityStorytelling using data visualization tool TableauWrote Pyspark scripts to analyze raw data and create data lineage using PandasCreated S3 buckets, configured bucket policies and access control lists (ACLs)Worked on IAM policies to restrict resource access within my CORE DB domainOptimized the data transformations by following AWS wellarchitected framework and AWS best practicesWorked on AWS glacier service for long-term data archivalWorked on various transformations such as source Qualifier, Lookup (Connected and Unconnected), Expression, Filter, Router, Update Strategy, Aggregator, Sequence generator etcWorking knowledge on job scheduling using AutosysDebugging job failures and helped support teams resolve production incidents Show less