Software Analyst
CurrentOptimized ETL pipelines using Azure Data Factory, Databricks & Snowflake, improving data accuracy and centralizing reporting for high-performance environments.Designed and implemented advanced data integration solutions, boosting operational efficiency with a 40% improvement in data retrieval speeds.Migrated legacy MapReduce applications to PySpark, improving performance by 30% and simplifying business logic implementation.Developed Python MapReduce programs to process data and store it efficiently in Hive tables.Led the creation of automated workflows using Power Automate and Power Apps, reducing manual processes by 40% and enhancing operational speed.Architected Power BI dashboards with row-level security and DAX, delivering tailored insights while ensuring compliance with internal standards.Established DevOps governance protocols, reducing report update cycles by 25% and improving version control efficiency.Enhanced database performance (SQL Server & Snowflake), cutting query times by 40% through optimized indexing and table structures.Developed and deployed AI/ML models using TensorFlow, PyTorch, and Scikit-learn to enhance data pipelines and enable data-driven decisions that automated decision-making, reducing manual intervention by 30%.Managed historical data loads to Cloud Storage using Hadoop utilities and loaded data into Big Query using BQ tools.Designed and developed Kafka producers, consumers, and brokers for stream processing using Java.Worked with Google Cloud Functions in Python to load data into Big Query from CSV files in GCS.Developed an ASP.NET MVC web interface to monitor production KPIs, improving scalability, security, and real-time data integration.Implemented data quality frameworks and CI/CD processes, ensuring data integrity and streamlining production releases.Collaborated with cross-functional teams, applying Agile and SDLC methodologies to foster efficient, problem-solving-driven development cycles.