• Designed and developed ETL pipelines with SQL and Matillion, enhancing data preprocessing efficiency by 45%.• Developed workflows for key business use cases using Matillion, DbSchema, Snowflake, and Oracle, improving operational efficiency by 20%.• Engineered robust KPI validation scripts, improving MicroStrategy grid report accuracy by 25%, directly supporting high-impact stakeholder decisions across orgs.• Reduced defects by 70% through Python and SQL validation across data… Show more • Designed and developed ETL pipelines with SQL and Matillion, enhancing data preprocessing efficiency by 45%.• Developed workflows for key business use cases using Matillion, DbSchema, Snowflake, and Oracle, improving operational efficiency by 20%.• Engineered robust KPI validation scripts, improving MicroStrategy grid report accuracy by 25%, directly supporting high-impact stakeholder decisions across orgs.• Reduced defects by 70% through Python and SQL validation across data sources and transformation layers.• Collaborated with cross-functional teams to integrate REST APIs into Splunk dashboards, reducing incident response time by 90%.• Applied data warehousing concepts like Star schema, SCD, ETL processes to support BI operations effectively. Show less

• Optimized data processing by 40% for 100 GB+ datasets by developing scripts with multiprocessing capabilities, with core and worker specifications, to streamline data structuring and flattening processes.• Streamlined ETL workflows on HPCs using Airflow DAGs, boosting data pre-processing efficiency by 35%.• Enhanced model performance and event classification on Verizon's WebScale dataset by applying feature engineering and implemented an ensemble anomaly detection approach combining… Show more • Optimized data processing by 40% for 100 GB+ datasets by developing scripts with multiprocessing capabilities, with core and worker specifications, to streamline data structuring and flattening processes.• Streamlined ETL workflows on HPCs using Airflow DAGs, boosting data pre-processing efficiency by 35%.• Enhanced model performance and event classification on Verizon's WebScale dataset by applying feature engineering and implemented an ensemble anomaly detection approach combining Isolation Forest, Local Outlier Factor, frequency-based, and pattern-based methods using scikit-learn.• Developed neural network model with TensorFlow and Keras, leveraging LSTM and Embedding to optimize sequential data workflows and enhance predictions.• Created interactive visualization dashboards for displaying anomalies and log details using React and Django, improving system monitoring. Show less

• Revamped resource upgrade processes with AWS (EC2, RDS, Elastic Beanstalk) and shell scripting, reducing recurring vulnerabilities by 90%.• Transformed data ingestion pipelines using Databricks workflows, reducing processing time and costs by 85%.• Spearheaded app deployment with AWS blue-green deployment, ensuring 99% availability with minimal downtime.• Implemented CI/CD pipelines with GitHub Actions, Jenkins, and SonarQube, integrating BDD/TDD testing methodologies to achieve a… Show more • Revamped resource upgrade processes with AWS (EC2, RDS, Elastic Beanstalk) and shell scripting, reducing recurring vulnerabilities by 90%.• Transformed data ingestion pipelines using Databricks workflows, reducing processing time and costs by 85%.• Spearheaded app deployment with AWS blue-green deployment, ensuring 99% availability with minimal downtime.• Implemented CI/CD pipelines with GitHub Actions, Jenkins, and SonarQube, integrating BDD/TDD testing methodologies to achieve a 30% reduction in deployment timelines.• Engineered a user management and onboarding application leveraging Microsoft Power Automate and Power Apps, streamlining the employee onboarding process and reducing onboarding time by 60%.• Developed and automated Spark SQL validation scripts for daily ETL pipelines utilizing diverse raw data sources in EDL, enhancing data accuracy and consistency by 65%.• Partnered with cross-functional teams to accelerate product delivery timelines ServiceNow integration, improving defect resolution rates by 20%. Show less