Programmer Analyst (Data Engineering Focus)
• Developed and designed data integration and migration solutions in Azure, setting up the necessary infrastructure, including storage accounts, integration runtime, and service principal IDs, to ensure scalable utilization of business user analytical requirements.• Created and maintained an optimal data pipeline architecture using Azure Data Factory and Azure Databricks, and developed pipelines to bulk copy multiple tables from relational databases to Azure Data Lake Gen2.• Led proof-of-concept projects from idea to production, leveraging Azure Data Factory to deliver business value.• Performed data cleaning, feature scaling, and feature engineering using Python libraries like pandas and NumPy.• Worked extensively with Microsoft SQL Server and MongoDB for database management, optimizing data storage and supporting business intelligence operations.