Shubham Bari Email & Phone Number

I am a Data Engineer Extraordinaire with a passion for leveraging Python, SQL, PySpark, and more to drive data-driven success in AWS and beyond! Currently, I am working as Data engineer, where I have gained extensive experience in various domains within the IT industry.My expertise lies in Hadoop Ecosystem Development and Spark-API's, where I have honed my skills in writing data extraction logic using PySpark. I have successfully processed large amounts of structured and unstructured data, seamlessly integrating it into traditional ETL processes. My proficiency in Spark Architecture, including Spark-Core and Spark-SQL, has allowed me to accelerate the extraction, transformation, and loading of data.I am well-versed in transferring data from RDBMS to HDFS and Hive tables using Sqoop and Spark API's. Additionally, I have hands-on experience in creating tables, partitioning, bucketing, and loading data in Hive. My ability to gather and process raw data at scale enables me to analyze processed data effectively.As a versatile professional, I am adept at handling multiple tasks and can work both independently and as a valuable team member. With a keen understanding of input to output transformation requirements, I consistently deliver high-quality results.If you are seeking a highly skilled Data Engineer who can drive data-driven success in AWS and beyond, look no further. Let's connect and explore how I can contribute to your organization's growth and success.