Data Engineer
Current- Fully involved in the requirement analysis phase.
- Supported Analytics onshore team by generating data sets data from various systems by writing Py Spark scripts.
- The purpose of the data-loading utility was to migrate constant and moving data sets, like transactional snapshots from Oracle to the Kubernetes cluster.
- Designed Integration and Production Deployment Scripts.
- Debugging the issues in Production and DEV, UAT environment.
- Monitoring Daily batch loads in Production and Testing Environments in the Airflow Tool.