Data Engineer with a solid background in optimizing and managing data pipelines within the Big Data ecosystem. Proficient in Hadoop, Apache Spark, SQL Server, and Hive, I have successfully ingested and processed large datasets, enhancing operational efficiency and reducing costs. My expertise encompasses data analysis, performance tuning, and integrating PySpark applications with external systems.I am dedicated to continuous learning and professional growth, staying up-to-date with emerging technologies and best practices in data engineering. My strong analytical and problem-solving skills, combined with excellent communication and teamwork abilities, enable me to collaborate effectively with multidisciplinary teams and deliver impactful data-driven solutions.Passionate about leveraging data to drive business insights, I thrive in dynamic, challenging environments. I am eager to apply my skills and expertise to drive organizational success and support data-driven decision-making that fuels growth."
-
Senior Data EngineerIncedo Inc.India
-
Data EngineerHcltech Oct 2023 - PresentChennai, Tamil Nadu, IndiaI developed an automated ETL pipeline using PySpark to efficiently process a retail dataset. This involved extracting data from Oracle tables via PySpark JDBC, transforming it to fit the required schema, and storing it in HDFS in CSV format with custom delimiters. I combined and standardized the data, managed null values, and loaded it into PySpark DataFrames for further analysis. I also performed complex transformations to create nested structures and optimized query performance by partitioning, bucketing, and indexing datasets. Finally, I automated the entire ETL process, ensuring scalability and efficiency throughout. -
Data EngineerHcltech Jan 2022 - Sep 2023Chennai, Tamil Nadu, IndiaAs a Data Engineer, my main work has involved designing, building, and improving data pipelines to make sure data is processed efficiently, can easily scale, and is reliable. Using tools like Databricks, PySpark and SQL, I've created strong data workflows that handle large amounts of data effectively. By focusing on optimizing performance, managing incremental data loads, and using parallel processing, I've made these pipelines faster and more scalable. Additionally, my attention to careful testing and clear documentation has helped ensure the data processes are consistent and dependable.
Khasim Shaik Education Details
-
Computer Science Engineering
Frequently Asked Questions about Khasim Shaik
What company does Khasim Shaik work for?
Khasim Shaik works for Incedo Inc.
What is Khasim Shaik's role at the current company?
Khasim Shaik's current role is Senior Data Engineer.
What schools did Khasim Shaik attend?
Khasim Shaik attended Saveetha School Of Engineering.
Who are Khasim Shaik's colleagues?
Khasim Shaik's colleagues are Yash Raj Singh, Subham Saha, Rajkumar Mishra, Deepak Takkar, Syedtouseef Syedtouseef, Pavni Chintada, Vishwa Reddy.
Not the Khasim Shaik you were looking for?
-
Khasim Shaik
Hyderabad -
1gmail.com -
Khasim Shaik
Hyderabad -
khasim shaik
Hyderabad -
1gmail.com
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial