Umesh K Email & Phone Number

United States

Connecticut, United States

• Designed and implemented scalable data processing pipelines using Hadoop MapReduce, Hadoop Hive, and HDFS.
• Designed and optimized SQL queries for complex data retrieval and analysis.
• Designed and engineered data solutions, collaborating with onshore and offshore teams for seamless data migration.
• Developed Snow Pipe and complex data transformations using Snow SQL, ensuring efficient data ingestion.
• Optimized performance through Snowflake external tables, staging, and… Show more
• Optimized performance through Snowflake external tables, staging, and scheduler for enhanced data processing.

Bellevue, WA

• Led a big data processing project using Apache Spark, Spark SQL, and Streaming for real-time data processing, ensuring efficient analysis.
• Managed Hadoop system, oversaw data import from various sources, transformed it using Hive and MapReduce, and loaded it into HDFS.
• Deployed StreamSets in enterprise environments to support mission-critical data integration and data management initiatives.
• Designed and implemented scalable and resilient data pipelines using StreamSets Data… Show more
• Designed and implemented scalable and resilient data pipelines using StreamSets Data Collector, ensuring high availability and fault tolerance.
• Built data ingestion Spark streaming framework, integrating data from sources like REST API and Kafka.

Plano, Texas, United States

• Played a pivotal role in developing solutions to meet business requirements by creating data pipelines using Apache Spark, orchestrating the extraction, transformation, and loading of data from various sources like SQL.
• Implemented data integration solutions for on-premises and cloud-based data warehouses and data lakes using platforms such as Amazon Redshift, Google BigQuery, and Snowflake.
• Orchestrated data replication and synchronization tasks between… Show more
• Orchestrated data replication and synchronization tasks between on-premises databases and big data platforms using StreamSets Data Collector and Control Hub.
• Utilized various data sources and destinations to efficiently manage and orchestrate data workflows, ensuring seamless data movement and transformation.
• Built data pipelines using PySpark to ingest data from CSV and JSON sources, ensuring data integrity and compliance with organizational standards.

Minneapolis, Minnesota, United States

• Collaborated within Agile Scrum methodology for development, ensuring effective teamwork and project management, facilitating continuous delivery of high-quality data engineering solutions.
• Utilized Sqoop, Kafka, and Hadoop File System APIs to implement robust data ingestion pipelines, ensuring reliable and efficient data processing and storage.
• Handled Hadoop cluster installations across various environments (Unix, Linux), assisting in upgrading, configuring, and maintaining Hadoop… Show more
• Handled Hadoop cluster installations across various environments (Unix, Linux), assisting in upgrading, configuring, and maintaining Hadoop infrastructures such as Pig, Hive, and HBase.
• Worked with Hadoop from Cloudera Data Platform, managing services through Cloudera Manager to ensure smooth operation and performance optimization of Hadoop clusters.
• Created Hive tables, loaded data into them, and crafted efficient Hive queries to support data analysis and reporting initiatives.

Hyderabad, Telangana, India

* Implemented solutions for data ingestion from diverse sources and processing stored data using Big Data technologies like Hadoop, MapReduce frameworks, HBase, and Hive.* Efficiently utilized Sqoop to transfer data between databases and HDFS, ensuring seamless data integration and management.* Employed Flume to stream log data from servers, enabling.