🌐 Senior Data Engineer | Cloud & Big Data Specialist | Problem-Solver & Technical LeaderWith over a decade of hands-on experience in data engineering, I specialize in transforming raw data into strategic insights that drive business growth. My journey has taken me through the intricacies of cloud migrations, real-time data processing, and robust ETL pipeline designs, equipping me with a versatile skill set that spans multiple industries—including finance, retail, and healthcare.🔹 Technical MasteryMy expertise lies in harnessing AWS and Azure services to build scalable, cloud-based data solutions. From designing complex ETL workflows in AWS Glue and Azure Data Factory to implementing real-time streaming with Apache Kafka, I thrive in the challenge of working with large-scale data. I bring a deep knowledge of Snowflake, BigQuery, and Redshift, using them to create optimized data warehouses that empower teams with accessible, actionable data.🔹 Data-Driven & Detail-OrientedAs a dedicated problem-solver, I focus on every detail of the data lifecycle—from ingestion to analysis—ensuring the accuracy and quality of every byte. Tools like Apache Airflow, Prefect, and dbt are my go-to for orchestrating workflows and enforcing data governance standards. With skills in SQL optimization, Python, and Spark, I have achieved data processing time reductions of 30-40% and significantly enhanced system performance for enterprise-scale applications.🔹 Adaptable and Forward-ThinkingIn an ever-evolving tech landscape, adaptability is essential. I stay up-to-date on the latest in cloud, big data, and machine learning technologies, whether it's deploying MLOps frameworks in SageMaker and Azure ML or developing NLP models for unstructured data. My commitment to continuous learning and flexibility makes me a resilient candidate, ready to tackle any data engineering challenge that comes my way.🔹 Reliable and CollaborativeI’m known for my ability to bring teams together, collaborating with cross-functional groups to understand business needs and translate them into technical solutions. Mentoring junior engineers, setting up CI/CD practices, and ensuring thorough documentation are just some of the ways I foster reliability and scalability in every project. My goal is to build data ecosystems that don’t just meet today’s demands but are ready for tomorrow’s growth.
Sony Music Publishing
View- Website:
- sonymusicpub.com
- Employees:
- 1718
-
Senior Data EngineerSony Music PublishingSterling, Va, Us
-
Senior Data EngineerState Of Alabama Apr 2022 - Sep 2024Montgomery, Alabama, United StatesAs a Senior Data Engineer with the State of Alabama since April 2022, I have led critical data migration initiatives, transferring petabyte-scale datasets from Teradata to Snowflake with an emphasis on accuracy and efficiency. Through custom Python-based ETL pipelines and Apache Airflow automation, I achieved a 99.5% data accuracy rate, significantly enhancing data quality and accessibility across departments. I implemented predictive models in Python and DataRobot to support accurate billing and revenue forecasting, providing stakeholders with reliable insights to guide decision-making.In this role, I introduced real-time data integration using Apache Kafka, enabling seamless access to customer data for cross-functional analytics teams. I also collaborated with business units to establish KPIs and crafted interactive Tableau dashboards, presenting insights on customer behavior, revenue, and platform performance. My work has underscored my ability to blend technical expertise with a collaborative approach, ensuring each project aligns with the State’s strategic goals while fostering cross-functional alignment and communication. -
Big Data EngineerState Of California Department Of Housing Oct 2020 - Mar 2022Los Angeles, CaServed as a Big Data Engineer for the Housing Department of California, where I developed a high-volume big data platform that enabled efficient distributed processing and seamless data integration. I designed scalable ETL pipelines using Apache Spark and PySpark to transform data from multiple sources, including Oracle, MySQL, and flat files, in a multi-node Hadoop environment. Leading the migration from SQL servers to Azure Data Lake Storage (ADLS) via Azure Data Factory, I optimized the department’s data infrastructure, reducing dependency on on-premises storage and improving scalability.To facilitate real-time data updates, I integrated Apache Kafka with Spark Streaming, ensuring consistent, timely data delivery for downstream analytics. I also built machine learning pipelines using PySpark and Spark MLlib, contributing predictive insights that supported key decision-making processes. Recognized for my impact on processing efficiency, I successfully reduced overall data processing time by 30%, streamlining reporting capabilities across various analytics teams and enabling more agile responses to department needs. -
Senior Data EngineerUptake Jun 2018 - Sep 2020Chicago, Illinois, United StatesAs a Senior Data Engineer at Uptake Technologies, where I designed and implemented complex ETL pipelines across AWS Glue and Azure Data Factory. Processing over 8TB of data across multi-cloud environments, I streamlined data workflows and achieved a 20% reduction in processing time. Additionally, I led the setup of CI/CD pipelines using Jenkins, enhancing deployment efficiency and minimizing manual intervention, which improved release frequency and reduced errors.I collaborated closely with cross-functional teams to understand data requirements across analytics, finance, and product operations, ensuring seamless pipeline integration to meet diverse business needs. As a mentor to junior engineers, I provided guidance on Git best practices, version control, and code reviews, fostering a collaborative, knowledge-sharing environment. By incorporating Apache Kafka for real-time data processing, I enabled low-latency insights for executives, enhancing their ability to make data-driven decisions. Power BI dashboards I developed further empowered stakeholders, providing visual insights into data health and pipeline performance. -
Data EngineerNationwide Jun 2016 - May 2018Columbus, Ohio Metropolitan AreaIn my role as a Data Engineer at Nationwide from June 2016 to May 2018, I developed custom multi-threaded ingestion jobs using Java and Scala, as well as Spark JDBC jobs for ingestion from FTP servers and multiple data warehouses. I designed and optimized Spark applications in PySpark for efficient ETL processes, leveraging Spark SQL to enhance query performance and support downstream analytics. Leading data migrations from Oracle and MySQL databases to Azure Data Lake with Azure Data Factory and Python scripts, I streamlined data workflows, improving both scalability and operational reliability.I integrated Kafka with Spark Streaming to facilitate real-time data transformations, providing timely, consistent data availability for analytics teams. My responsibilities included orchestrating ETL workflows through Apache Airflow, enabling reliable data integration and fault tolerance across the pipelines. I also implemented Snowflake for data warehousing, optimizing data models and SQL queries for high-performance retrieval. This experience solidified my skills in managing large-scale data migrations and implementing real-time solutions that align with business goals. -
Data EngineerMaisa Solutions Private Limited Jun 2015 - Dec 2015Hyderabad, IndiaI architected and implemented BI solutions on Azure, utilizing Azure Data Lake, Data Factory, Azure SQL Data Warehouse, and Databricks to support complex healthcare data management and analytics. I led the migration of on-premises databases (SQL Server, Oracle, and DB2) to Azure Data Lake Storage (ADLS) using Azure Data Factory, reducing infrastructure dependencies and ensuring scalable data storage. By building ETL pipelines with Snowflake, I enabled real-time access and optimized query performance, providing efficient solutions for healthcare data analysis.Using dbt, I developed robust data models that standardized business logic, enabling self-service analytics across departments and improving data accessibility. My work in automating ETL processes with Azure Synapse and ADF enhanced data quality, consistency, and operational efficiency. I established CI/CD pipelines in Azure DevOps to streamline deployments and improve pipeline reliability. Additionally, I applied Azure AD-based access controls to ensure HIPAA compliance, fostering secure and governed data environments. This role honed my expertise in building adaptable and compliant data solutions in a highly regulated industry.
Frequently Asked Questions about Satya K.
What company does Satya K. work for?
Satya K. works for Sony Music Publishing
What is Satya K.'s role at the current company?
Satya K.'s current role is Senior Data Engineer.
Not the Satya K. you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial