Madhu E Email & Phone Number

Mooresville, North Carolina, United States

• Skilled in data cleansing, preprocessing using Python and creating data workflows with SQL queries using Alteryx and prepares Tableau Data Extracts (TDE).
• Examined data quality issues using Snow SQL by building analytical warehouses on Snowflake. Generating interactive Power BI and Tableau dashboards.
• Designed and developed Flink pipelines to consume streaming data from kafka and applied business logic to massage. Developed advanced analytics models in Snowflake for risk assessment, including credit risk, market.
• Implementing data constraints and validation rules to maintain the accuracy and consistency of the RDBMS. Collaborated with stakeholders to understand business requirements to ensure data quality and governance.
• Designed and implemented complex data integration pipelines using Azure Data Factory, enabling seamless data movement and transformation across diverse data sources.
• Developed Python code to gather data from HBase and designs solution to implement using PySpark. Managed and maintained Azure SQL Databases, ensuring data integrity, security, and high availability.

Weehawken, New Jersey, United States

• Worked on building centralized Data Lake on AWS Cloud utilizing primary services like S3, EMR, Redshift and Athena. Designed and implemented end-to end data solutions using AWS Glue, AWS S3 and AWS Redshift, resulting.
• Managed database instances for various relational database engines like MySQL, PostgreSQL, Oracle, SQL Server using AWS RDS. Experience in designing stunning visualizations using Tableau software and publishing and.
• Experienced in setting up RDBMS clusters and replication for scalability and high availability, ensuring uninterrupted data access. Expertise in Data load management, importing & exporting data using SQOOP, FLUME and.
• Developed interactive and insightful Power BI reports and dashboards to meet business requirements, incorporating data visualization best practices. Used Snowflake to process ETL pipelines and load external data from.
• Developed MapReduce/Spark Python modules for machine learning & predictive analytics in Hadoop on AWS.
• Extensive experience in utilizing ETL Process for designing and building very large-scale data using Apache Spark

Minnesota, United States

• Developed series of data ingestion jobs for collecting data from multiple channels and external applications in Scala.
• Worked on both batch and streaming ingestion of data. Built Python based Data pipelines from multiple data sources by performing necessary ETL Tasks.
• Imported clickstream log data from FTP Servers and performed various data transformations using Spark Data frame API and Spark-SQL API’s. Knowledge of data warehousing concepts and experience in building and.
• experience in Big Data ecosystems using Hadoop, Pig, Hive, HDFS, MapReduce, Sqoop, Storm, Spark, Airflow, Snowflake, Teradata, Flume, Kafka, Yarn, Oozie, and Zookeeper.
• Build Tableau and Data studio dashboards based on Marketing campaign requirements and presented them to Sales Directors. Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the.
• Converted several informatica workflows into Hadoop, Spark and Scala. Implemented data migration and ETL (Extract, Transform, Load) processes to seamlessly transfer and transform data between NoSQL and MySQL databases.

Hyderabad, Telangana, India

• Worked on complex SQL Queries, PL/SQL procedures and convert them to ETL tasks. Utilized Apache Spark with Python to develop and execute Big Data Analytics and Machine learning applications, executed machine Learning.
• Designed and operationalized efficient data processing systems using a combination of tools like Apache Spark, Kafka, and Composer. Worked on ingesting data from SQL-server to S3 using Sqoop with in AWS EMR.
• Worked on full spectrum of data engineering pipelines: data ingestion, data transformations and data analysis/consumption with Python. Used various AWS services including S3, EC2, AWS Glue, Athena, RedShift, EMR, SNS.
• Skilled at performing complex data transformations and calculations in Excel, improving data usability for analysis.
• Worked with different types of data in Tableau like Excel files, Text files, JSON files. Spearheaded the transition to a NoSQL database.
• Regularly collaborated with cross-functional teams, offering expertise in data platforms such as Data Lakes and Data Warehouses. Implementing data quality checks and validation procedures to maintain high data quality.