Venkatesh Reddy S Email & Phone Number

Toronto, Ontario, Canada

• I offer comprehensive data engineering services, including the development and optimization of data pipelines using PySpark and Azure Cloud Services, ensuring efficient data processing and storage.• My business intelligence solutions feature the creation of interactive Power BI and Tableau dashboards, enabling you to visualize data insights and enhance decision-making processes.• I specialized in data migration and automation, seamlessly transferring on-premise jobs to the cloud and automating data profiling, resulting in significant time and cost savings.

Ontario, Canada

• Built, orchestrated and optimized ADF data pipelines to extract, transform, and load (ETL/ELT) various data types parquet, JSON, and XML from API, relational, and streaming sources into the Synapse data warehouse.• Applied database design principles to create efficient data models, optimize queries, manage indexes, and perform integrity checks.• Deployed 15 ETL workloads into production environments, following the code, integration testing, release management, troubleshooting and data management best practices.• Engineered batch and streaming data processing workflows to handle terabyte-size volumes of structured and unstructured data leveraging the Lakehouse architecture.• Automated data profiling and cleaning using Spark DataFrames, Spark SQL, and PySpark reducing validation time by 30% and boosting productivity.• Collaborated with stakeholders to understand business requirements and translate them into technical solutions following Agile/Scrum methodologies.• Automated recurring cloud infrastructure deployment tasks using IaC tools like Terraform, PowerShell, Bash, and ARM Templates.• Implemented Databricks Unity Catalog for enhanced user access management, data governance and metadata management.• Scheduled the dedicated Synapse's Datawarehouse units (DWUs) based on the Ad-hoc and ETL workloads resulting in 28% savings in data warehousing cost.• Applied machine learning libraries, Scikit-learn, TensorFlow, PyTorch and Pandas to create a fraud detection model improving transaction monitoring.• Leveraged Apache Streaming APIs, Delta Live Tables, Auto Loader and Azure Event Hub to process and analyze over 10 million events per day, enhancing real-time data processing.

India

• Defined and implemented SSIS packages for daily data filtering and import from the OLTP system to SQL Server, incorporating advanced features like Lookup Transformations, Merge Joins, Fuzzy Lookups, and Derived Columns.• Designed automated interactive PowerBI and Tableau dashboards with KPI scorecards for non-technical users that improved decision-making efficiency by 30% and enhanced user engagement by 40%.• Hands-on ETL development experience with Python, SQL, and AWS services like Glue, lambda, Redshift, Athena, S3, Step Function, Monitoring and Logging mechanisms- AWS Cloud Watch.• Hands-on experience working with SSIS, for ETL process ensuring proper implementation of Event Handling, Logging, Checkpoints, Transactions, and package configurations.• Authored SQL Stored Procedures to implement SCD Type2 functionality, which captures the history of each batch run on ETL Control.• Proficient in designing fact and dimension tables, and establishing relationships between tables using Star Schema and Snowflake Schema.• Developed and maintained a robust data warehouse using Snowflake Streams on critical tables to capture real-time changes, ensuring accurate and up-to-date data.• Developed modular, maintainable Python and SQL code in Data Build Tool (DBT) for efficient, scalable data engineering workflows.• Conducted performance analysis and database tuning on SQL server database to optimize querying time results for business users and applications. • Created DDL, DML scripts, stored procedures, User Defined Functions (UDF), Common Table Expression (CTE), Views, Joins, and System Defined Functions, as well as Temp Tables and Table Variables, according to the requirement and designed ad-hoc queries on the database tables.

India

• Designed complex SSAS solutions using multiple dimensions, perspectives, hierarchies, measures groups and KPIs to analyze performance of Strategic Business Units as well as corporate centers.• Involved in the meetings with Line of Business for requirements gathering and modified procedures according to the business requirements.• Proficient in configuring and customizing visual reports, dashboards, and KPI scorecard parameters in Power BI and SSRS. Skilled at managing data connections to extract and transform data from various sources for analysis. • Implemented the delivery of Microsoft Business Intelligence development studio (MSBI) platform solutions to develop and deploy ETL, analytical, reporting and scorecard / dashboards on SQL Server using SSIS, SSRS.

Visakhapatnam, Andhra Pradesh, India

Master'S Degree, Industrial Engineering

Bachelor'S Degree