Software Engineer
CurrentDeveloped AWS Data pipelines that consume real time customer data from Kinesis data streams and stored the information in CDH and EDW Redshift tablesWorked on automating jobs using Lambda functions to perform Data quality checks on incoming customer dataImplemented AWS solutions using S3, EC2 instance, EMR Cluster, Glue Crawler, Athena, Code commit.