A highly skilled Azure Data Engineer and Snowflake Data Engineer with around 9 years of experience, I have specialized in building efficient, scalable, and high-performance data solutions utilizing modern cloud technologies such as Microsoft Azure, Snowflake, and IBM Cloud. My expertise spans across query optimization, data loading, data warehousing, and the automation of large-scale data pipelines.I have hands-on experience in SQL, Python, and cloud platforms, designing and optimizing complex queries that have led to performance improvements of up to 50%. I managed and optimized large-scale data ingestion, transformation, and loading processes using Azure Data Factory, Databricks, and Snowflake, ensuring seamless data flow from multiple sources to Azure Data Lake Storage and Snowflake's data warehouse.I am proficient in Snowflake utilities such as Snowpipe, Snowpark, Tasks, Streams, Time Travel, Cloning, Optimizer, Metadata Manager, and Data Sharing, optimizing data processes and improving performance by leveraging these advanced Snowflake features. Additionally, I have experience in building efficient databases, schemas, and warehouses within Snowflake, applying RBAC and DAC for data security while supporting analytical and reporting needs.My data modeling expertise, including dimension modeling, has enabled the design of robust schemas that support business intelligence and reporting requirements. By integrating Python scripts for enhanced data processing and custom transformations, I have streamlined workflows and improved pipeline efficiency by 30%.I have extensive experience with data governance practices, ensuring the accuracy, consistency, and security of data through metadata management and access controls, and have worked on automating key processes to reduce manual effort. Additionally, I have integrated Apache Spark, Snowpark, and a variety of file formats (XML, JSON, CSV, Parquet) for smooth data operations.My proficiency with Microsoft Azure services such as Azure SQL, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Data Factory has enabled me to develop and maintain scalable data pipelines and perform real-time analytics that support business decisions. I successfully transitioned legacy databases to Snowflake and Azure without any downtime, achieving a 40% boost in query performance through optimized migration and tuning strategies.
-
Data EngineerCareer Education CorporationTampa, Fl, Us -
Data EngineerCareer Education Corporation Aug 2022 - PresentUnited StatesI have extensive experience working with Snowflake on the Azure cloud platform, where I managed accounts, warehouses, and databases, optimizing performance and resource allocation while ensuring data security. I automated data pipeline management with Snowflake Tasks and stored procedures, and configured Snowpipe for seamless data ingestion from various sources. Leveraging SnowSQL and Snowpark, I developed scalable data processing applications using Python UDFs for advanced analytics and applied data warehousing techniques such as clustering, partitioning, and indexing to enhance Snowflake’s performance. Additionally, I implemented dimensional modeling techniques to design fact and dimension tables for analytical queries and leveraged Snowflake’s query profiling for optimization.In my data engineering role, I built efficient ETL workflows using Azure Data Factory and Databricks, integrating with Airflow to schedule and monitor Spark jobs, and optimizing pipeline performance. I employed dbt to manage data transformations, developing optimized models with dependency management and implementing incremental processing for reduced refresh times. I also used Matillion for data quality checks, data cleansing, and Snowflake data transformations. Through collaboration with BI teams, I facilitated data-driven decision-making by ensuring data accuracy and accessibility, supporting visualization tools like MicroStrategy and Tableau for reporting and analytics. -
Data EngineerMetlife Jun 2019 - Jul 2022Chennai, Tamil Nadu, IndiaAs a Data Engineer, I specialize in designing and developing scalable data solutions, with a primary focus on Azure and Snowflake technologies.I designed and developed scalable ETL/ELT pipelines using Azure Data Factory, orchestrating data movement and transformation across Azure Data Lake Storage (ADLS) and Snowflake. I managed data loading from external stages (ADLS, BLOB) into Snowflake with SnowSQL, using the COPY command for efficient data validation and management.I implemented Snow Pipe for real-time data ingestion from Azure, creating Snowflake procedures for data transformation. Using zero-copy cloning, I efficiently managed production data for testing and modification without extra storage. I built scalable data warehouses in Snowflake for real-time reporting and analytics, ensuring accuracy with thorough validation and quality analysis.Leveraging Azure services (Databricks, ADF, Synapse) integrated with Snowflake, I optimized data ingestion and transformation workflows. I also improved data security by implementing Role-Based Access Control (RBAC) and secure data sharing in Snowflake. I developed optimized data models with dimension modeling and star schema techniques for better business intelligence reporting.I optimized SQL queries and leveraged Snowflake’s micro-partitioning and materialized views to enhance performance. Additionally, I utilized Time Travel for historical data management and set up monitoring and alerts with Azure Monitor for pipeline performance tracking. My troubleshooting ensured data integrity and operational continuity in complex cloud data environments. -
Snowflake DeveloperStonegrid Limited Apr 2016 - Jun 2019Hyderabad, Telangana, IndiaAs a Snowflake Developer, I have configured and maintained Snowflake virtual warehouses, developed and optimized ETL processes using SnowSQL, and ensured data consistency through validation between Snowflake, SQL Server, and Db2. I implemented automation for change data capture (CDC) workflows using Streams and Tasks, designed partitioning strategies to improve query performance, and developed stored procedures to handle complex transformations. I have experience with performance tuning, data sharing, and data governance in Snowflake, and I played a key role in migrating legacy systems to Snowflake while providing support and training to internal teams.
Sai K. Education Details
-
Mechanical Engineering
Frequently Asked Questions about Sai K.
What company does Sai K. work for?
Sai K. works for Career Education Corporation
What is Sai K.'s role at the current company?
Sai K.'s current role is Data Engineer.
What schools did Sai K. attend?
Sai K. attended Daita Madhusudana Sastry Sri Venkateswara Hindu College Of Engineering.
Not the Sai K. you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial