Sai Teja Mukkavilli Email & Phone Number

United States

As a Data Engineer, I specialized in developing, designing, and optimizing data models, structures, and ETL jobs to streamline data acquisition and manipulation processes. I efficiently processed massive data volumes using Python and PySpark process billions of records in parallel for ETL tasks, and constructed cloud data lakes integrated with Spark and Delta Lake. I transformed batch data from various sources, including SQL Server, MySQL, and PostgreSQL, into data frames using PySpark and… Show more As a Data Engineer, I specialized in developing, designing, and optimizing data models, structures, and ETL jobs to streamline data acquisition and manipulation processes. I efficiently processed massive data volumes using Python and PySpark process billions of records in parallel for ETL tasks, and constructed cloud data lakes integrated with Spark and Delta Lake. I transformed batch data from various sources, including SQL Server, MySQL, and PostgreSQL, into data frames using PySpark and performed ETL operations in Azure Databricks. Additionally, I orchestrated workflows with Apache Airflow, optimizing data pipeline architectures using Azure services like Databricks, Data Factory and Synapse Analytics, implementing CI/CD pipelines with Jenkins and supported Power BI reporting through complex SQL queries. Show less

India

As a Data Engineer, I developed ETL jobs for data migration and data warehousing across multiple projects using AWS S3, Glue, Lambda and PowerBI. I managed data ingestion from on-prem SQL Server to AWS, utilized various file formats (JSON, XML, CSV, Parquet) files for raw data storage, and optimized SQL scripts with PySpark SQL. I also integrated Kafka streams with Python data pipelines on AWS, leveraging AWS Lambda and Amazon Kinesis, resulting in a 25% increase in data processing speed and a… Show more As a Data Engineer, I developed ETL jobs for data migration and data warehousing across multiple projects using AWS S3, Glue, Lambda and PowerBI. I managed data ingestion from on-prem SQL Server to AWS, utilized various file formats (JSON, XML, CSV, Parquet) files for raw data storage, and optimized SQL scripts with PySpark SQL. I also integrated Kafka streams with Python data pipelines on AWS, leveraging AWS Lambda and Amazon Kinesis, resulting in a 25% increase in data processing speed and a 20% reduction in data latency. I developed complex Python and Scala code to meet application requirements, improving data processing efficiency by 30% and reducing debugging time by 20%. In addition, I implemented CI/CD pipelines using Git for version control, ensuring seamless integration and deployment across various environments. I also collaborated with Data Scientists and Data Analyst teams to resolve data quality issues during migrations, boosting data integrity by 30% and enhancing trust in reporting. Show less

India

As a Junior Data Engineer, I have hands-on experience in designing, developing, and implementing performant ETL pipelines using the Python API (PySpark) of Apache Spark on Databricks. I have integrated data storage solutions with Spark, particularly leveraging AWS S3 for object storage, and optimized PySpark scripts for better performance. Additionally, I built the infrastructure required for efficient extraction, transformation, and loading (ETL) of data from diverse sources, including MySQL… Show more As a Junior Data Engineer, I have hands-on experience in designing, developing, and implementing performant ETL pipelines using the Python API (PySpark) of Apache Spark on Databricks. I have integrated data storage solutions with Spark, particularly leveraging AWS S3 for object storage, and optimized PySpark scripts for better performance. Additionally, I built the infrastructure required for efficient extraction, transformation, and loading (ETL) of data from diverse sources, including MySQL. I developed analytics tools that utilized the data pipeline to provide actionable insights into key business performance metrics such as customer acquisition and operational efficiency. Furthermore, I built reusable data ingestion and transformation frameworks using PySpark to streamline data processes and used data visualization tools such as Power BI and Tableau to support business insights and reporting. Show less

Master'S Degree, Master Of Science In Computer Science

Bachelor'S Degree, Computer Science And Engineering