1. Led the migration and automation of legacy SQL code to PySpark for processing CSV data recurring every three months, optimizing logic and resulting in a 1.5x efficiency improvement.2. Orchestrated backend migration of APIs from cloud to on-premise, achieving 95% endpoint validation success. Implemented JWT-based authentication for enhanced security.3. Optimized parsing for diverse data sizes (MBs to GBs) and formats (JSON, XML), resulting in a 30% ETL efficiency boost, while… Show more 1. Led the migration and automation of legacy SQL code to PySpark for processing CSV data recurring every three months, optimizing logic and resulting in a 1.5x efficiency improvement.2. Orchestrated backend migration of APIs from cloud to on-premise, achieving 95% endpoint validation success. Implemented JWT-based authentication for enhanced security.3. Optimized parsing for diverse data sizes (MBs to GBs) and formats (JSON, XML), resulting in a 30% ETL efficiency boost, while integrating AWS Lambda and Step Functions for workflow automation.4. Developed and implemented data processing pipelines, including Kafka code integration in Kubernetes pods, Docker image deployment, and data ingestion into HDFS(Hadoop Distributed File System) and Percona DB. Show less

Developed web APIs and orchestrated the integration of microservices including Pharmacy Medicine Count, Authorization, etc., resulting in the successful establishment of the project framework.