Senior Associate
Current· Develop, test and maintain the data infrastructure, the data ingestion pipeline, data store and data processing on premise.· Working with business analysts in gathering business requirements, obtaining clarifications and approvals during functional analysis, data validations and integration testing.· Implement and execute data security and data quality measurements to ensure compliance to data security and data governance policies· Data modeling is done using Data Vault technique.· Worked on Scheduling the Jobs through NIFI scheduler· Design, development, testing, troubleshooting and debugging of the application.· Involved in creating Hive tables, data loading and writing queries.· Was responsible for Optimizing Hive queries that helped in saving Cost to the project.· The processed data is loaded into hive table using spark SQL