Designed and implemented complex data integration pipelines using Azure Data Factory and Azure Data Lake, ensuring seamless movement and transformation of pharmaceutical and healthcare data for analytics and reporting.Optimized data processing workflows with Azure Databricks and DBT (Data Build Tool) for faster transformations and model training, supporting efficient analysis and market insights.Developed and managed scalable data lake infrastructure on Azure Cloud, utilizing Azure… Show more Designed and implemented complex data integration pipelines using Azure Data Factory and Azure Data Lake, ensuring seamless movement and transformation of pharmaceutical and healthcare data for analytics and reporting.Optimized data processing workflows with Azure Databricks and DBT (Data Build Tool) for faster transformations and model training, supporting efficient analysis and market insights.Developed and managed scalable data lake infrastructure on Azure Cloud, utilizing Azure Synapse SQL for efficient data analysis and reporting.Implemented Databricks notebooks in Python with PySpark to preprocess pharmaceutical and healthcare data for reporting and analytics, including data cleansing, enrichment, aggregation, and de-normalization.Utilized PostgreSQL's full-text search capabilities to improve application search functionality.Designed scalable data processing architectures leveraging Hadoop and Spark technologies to manage growing data volumes and user demands effectively.Implemented data governance strategies to ensure compliance with GDPR, HIPAA, and other regulatory requirements, safeguarding pharmaceutical data security and privacy.Engineered high-performance data ingestion frameworks with Scala and Apache Flink for real-time analytics and event processing. Show less

Designed and implemented end-to-end data solutions using AWS Glue, AWS S3, and AWS Redshift, optimizing data processing for agricultural data management.Integrated AWS into ETL workflows to extract, transform, and load agricultural data from various sources, ensuring alignment with business requirements.Developed and optimized Python-based ETL pipelines in both legacy and distributed environments, enhancing data processing efficiency.Utilized Spark with Python-based pipelines on AWS… Show more Designed and implemented end-to-end data solutions using AWS Glue, AWS S3, and AWS Redshift, optimizing data processing for agricultural data management.Integrated AWS into ETL workflows to extract, transform, and load agricultural data from various sources, ensuring alignment with business requirements.Developed and optimized Python-based ETL pipelines in both legacy and distributed environments, enhancing data processing efficiency.Utilized Spark with Python-based pipelines on AWS EMR for loading data to the Enterprise Data Lake (EDL) using AWS S3 as a storage layer.Developed and optimized NoSQL data models tailored for agricultural use cases, improving data retrieval performance and reducing storage costs.Integrated NoSQL databases with ETL pipelines to facilitate seamless data ingestion, transformation, and loading, ensuring enhanced data availability and accessibility.Employed NoSQL databases in real-time analytics and monitoring systems, enabling rapid processing and visualization of streaming agricultural data. Show less

Designed and implemented ETL pipelines using Azure Databricks and Azure Data Factory to extract, transform, and load data from various sources for M&T supporting operational and analytical needs.Contributed to the development of an Azure cloud-based data centre on Azure Data Lake ensuring scalable and secure data storage solutions.Designed and implemented cloud data integration solutions using Informatica Cloud services facilitating seamless connectivity between on-premises and… Show more Designed and implemented ETL pipelines using Azure Databricks and Azure Data Factory to extract, transform, and load data from various sources for M&T supporting operational and analytical needs.Contributed to the development of an Azure cloud-based data centre on Azure Data Lake ensuring scalable and secure data storage solutions.Designed and implemented cloud data integration solutions using Informatica Cloud services facilitating seamless connectivity between on-premises and cloud-based platforms.Developed Python-based data pipelines for ETL tasks ensuring data quality and consistency in financial data processing.Created Python-based data visualization tools using Matplotlib, Seaborn, and Plotly providing insightful graphical representations of financial data.Utilized Apache Spark and Hadoop ecosystem tools (MapReduce, Hive) to develop scalable data processing solutions at M&T, enabling efficient analysis of large financial datasets.Implemented SAS data processing and statistical analysis routines to derive actionable insights from financial data. Show less

Utilized the Pandas library in Python to analyze large datasets, extract meaningful insights, and perform advanced statistical analysis, supporting data-driven decision-making processes. Excel expert proficient in advanced functions, pivot tables, and data manipulation and analysis visualizations, enhancing data analytics capabilities.Implemented data preprocessing, feature engineering, and model building using SAS, contributing to predictive analytics and business… Show more Utilized the Pandas library in Python to analyze large datasets, extract meaningful insights, and perform advanced statistical analysis, supporting data-driven decision-making processes. Excel expert proficient in advanced functions, pivot tables, and data manipulation and analysis visualizations, enhancing data analytics capabilities.Implemented data preprocessing, feature engineering, and model building using SAS, contributing to predictive analytics and business intelligence.Developed and maintained ETL processes using Alteryx, ensuring seamless data extraction, transformation, and loading for operational efficiency.Created professional presentations and reports in PowerPoint, effectively communicating data-driven insights to stakeholders.Designed and developed reports in SSRS, providing detailed insights for various business processes and operational areas.Strong experience gathering requirements from stakeholders and transforming business requirements into functional specifications Show less