Yashwanth Sai Email & Phone Number

Mountain View, California, United States

Horsham, Pennsylvania, United States

• Collaborated with diverse technical teams, architects, security officers, and business users to review and meticulously document workloads, system dependencies, and business requirements.• Actively participated in technical design sessions, working closely with application development, infrastructure teams, and clients to scrutinize and enhance infrastructure designs for new projects.• Skillfully mapped complex workloads onto Amazon AWS capabilities, catering to public, private, and… Show more • Collaborated with diverse technical teams, architects, security officers, and business users to review and meticulously document workloads, system dependencies, and business requirements.• Actively participated in technical design sessions, working closely with application development, infrastructure teams, and clients to scrutinize and enhance infrastructure designs for new projects.• Skillfully mapped complex workloads onto Amazon AWS capabilities, catering to public, private, and hybrid cloud environments.• Engineered end-to-end data pipelines using AWS Glue for ETL processing, achieving a notable 30% reduction in processing time.• Masterminded the design and optimization of a data warehousing solution on Amazon Redshift, leading to a significant 50% improvement in query performance.• Developed AWS Lambda functions to orchestrate AWS EMR cluster provisioning and teardown, leveraging Service Catalog and Auto Scaling for efficient cluster management.• Created and optimized PySpark scripts for converting large-volume files into efficient Parquet format, demonstrating expertise in Data Analysis using PySpark (SparkSQL).• Imported data from JSON, Sequential, Text, CSV, AVRO, and Parquet formats into HDFS clusters, using PySpark for optimal storage with compression to enhance performance.• Utilized PySpark for scripting data filtering, aggregation, and writing, producing various compressed file formats tailored to specific business requirements.• Painstakingly documented comprehensive test plans, test cases, and test scripts based on design specifications, covering unit testing, system testing, and functional testing.• Prepared and managed test data with meticulous error handling and in-depth analysis, contributing significantly to maintaining and enhancing product quality. Show less

• Facilitated cross-functional collaboration to gather comprehensive requirements, resulting in the successful establishment of a real-time data reporting infrastructure.• Designed and developed a high-performance Power BI data model by integrating diverse datasets (Postgres, Oracle, FAST), achieving a 60% performance enhancement through effective relationship implementation.• Presented actionable insights and data-driven findings to executive stakeholders through interactive… Show more • Facilitated cross-functional collaboration to gather comprehensive requirements, resulting in the successful establishment of a real-time data reporting infrastructure.• Designed and developed a high-performance Power BI data model by integrating diverse datasets (Postgres, Oracle, FAST), achieving a 60% performance enhancement through effective relationship implementation.• Presented actionable insights and data-driven findings to executive stakeholders through interactive dashboards, enabling informed decision-making and real-time data analysis.• Designed and implemented a data mart on SQL Server, strategically housing subsets of data from various sources, demonstrating expertise in SQL queries, RDBMS, and ETL tools.• Analyzed and optimized complex tasks to improve operational efficiency, showcasing problem-solving skills and process improvement expertise.• Established a robust data extraction, transformation, and loading infrastructure using SQL, facilitating seamless data movement across diverse sources.• Collaborated with QA analysts to identify and resolve data quality challenges, implementing a monitoring dashboard that resulted in an 80% enhancement in data quality.• Utilized advanced Excel functionalities (Pivot Tables, VLOOKUP) to reconcile account values, substantially reducing the risk of erroneous cash disbursements by 85%. Show less

• Facilitated cross-functional collaboration to gather comprehensive requirements, resulting in the successful establishment of a real-time data reporting infrastructure.• Designed and developed a high-performance Power BI data model by integrating diverse datasets (Postgres, Oracle, FAST), achieving a 60% performance enhancement through effective relationship implementation.• Presented actionable insights and data-driven findings to executive stakeholders through interactive… Show more • Facilitated cross-functional collaboration to gather comprehensive requirements, resulting in the successful establishment of a real-time data reporting infrastructure.• Designed and developed a high-performance Power BI data model by integrating diverse datasets (Postgres, Oracle, FAST), achieving a 60% performance enhancement through effective relationship implementation.• Presented actionable insights and data-driven findings to executive stakeholders through interactive dashboards, enabling informed decision-making and real-time data analysis.• Designed and implemented a data mart on SQL Server, strategically housing subsets of data from various sources, demonstrating expertise in SQL queries, RDBMS, and ETL tools.• Analyzed and optimized complex tasks to improve operational efficiency, showcasing problem-solving skills and process improvement expertise.• Collaborated with QA analysts to identify and resolve data quality challenges, implementing a monitoring dashboard that resulted in an 80% enhancement in data quality.• Utilized advanced Excel functionalities (Pivot Tables, VLOOKUP) to reconcile account values, substantially reducing the risk of erroneous cash disbursements by 85%. Show less

Pune, Maharashtra, India

• Demonstrated advanced SQL query skills that surpass syntax knowledge, specializing in crafting queries that optimize performance by strategically using indexes and partitions. This ensures streamlined data access, enhancing query response times and overall database efficiency.• Showcased mastery of SQL query writing, including the strategic utilization of indexes and partitions for optimized performance.• Delivered innovative solutions using Databricks and Apache Spark alternatives… Show more • Demonstrated advanced SQL query skills that surpass syntax knowledge, specializing in crafting queries that optimize performance by strategically using indexes and partitions. This ensures streamlined data access, enhancing query response times and overall database efficiency.• Showcased mastery of SQL query writing, including the strategic utilization of indexes and partitions for optimized performance.• Delivered innovative solutions using Databricks and Apache Spark alternatives, customized to each project. These platforms create efficient data pipelines for processing, transformation, and integration, driving actionable insights.• Proficient in real-time data processing, leveraging streaming data for dynamic transformations. This agility allows organizations to seize opportunities and address challenges instantly, enhancing responsiveness in a fast-paced landscape.• Expertise extends to seamless API connections for fluid data flows. By bridging systems and formats, established cohesive data ecosystems that fuel unified insights and informed decision-making.• Adept in data analysis, modeling, integration, warehousing, and database design, crafting scalable data solutions. Role includes maintaining ETL pipeline quality, conducting meticulous testing, validation, and monitoring to ensure data integrity.• Navigate services within the Azure ecosystem, such as Azure SQL Database, Data Lake Gen2, Data Factory, Analysis Service, Cosmos DB, and Event Hub. This empowers the orchestration of complex data workflows that harness Azure's full potential.• Excel in version control and CI/CD practices with GIT, leveraging CI/CD pipelines. Preference for Azure DevOps/VSTS underscores commitment to efficient code management, ensuring readiness for production environments.• Expertise forms a holistic approach to Data Engineering that aligns with an organization's goals. Each aspect contributes to robust solutions that empower strategic decision-making. Show less