Data ingestion from files received in AWS s3 to CDL using existing framework.Creation of databases with different role assignment.Loading the data to Hive external table by applying Business rules and data type casting.Generation of Extracts from existing hive tables.Performed Data ingestion into HDFS either in incremental mode or full refresh mode.Responsible for check in the developed code in azure devops and creation of build ,release and backup pipelines .Performed Unit Testing on the final datasets using business use cases.Scheduled the jobs and monitored the same using Autosys. Involved in creation of SIQ , SOP and interact with different teams across organization for moving the developed code from development environment to QA and Production environment.Worked in Production environment on Hypercare fixes and load data as per requirements.

Creation of test cases, test data for performing testing.Validation of file data in AWS path, Hdfs and hive table data.Preparation of test scripts for Jupiter,an internal automation tool.Identification of defects and performing regression testing.Identified issues in existing Framework.

Creation of web form using HTML ,CSS and download the data into Excel using VB script .Installation and setup of R shiny package,R studio and publishing web pages using R studio connect.