Harshit Gupta Email & Phone Number

Bengaluru, KA, IN

*Working with Cloud Connector Team to build and improve Hadoop FileSystem connectors for Object Stores such as S3, ABFS and GCS. Successfully delivered project goals by implementing new features, and adhering to stringent timelines. Committed to open source Hadoop.*Worked with AWS team to integrate new S3 Express SDK with our stack. The new integration.

Bengaluru, Karnataka, India

*Worked with the performance team to improve Big Data Query Engines such as Hive,Tez and Spark. Collaborated with different teams to understand and optimize storage, execution and metadata layers of big data systems.*Worked on optimising storage formats like ORC,Parquet and Iceberg for high performance vectored reads.Tech Stack:Python, Java, Go, Hive, Tez.

Bengaluru, Karnataka, India

*Developed a DDL describing feature for Hive to replicate and repro compiler based issues. The feature came in handy in for solving high priority escalations.*Developed data parsers for Hive MetaStore and Hive LLAP logs to understand and optimise query engines. They were further used to improve Metadata related operations. Tech Stack:Java, Python, Plotly.

Bengaluru Area, India

Developed a pipeline to parse and process the homologous gene dataset, then use them to predict the homologous genes using Deep Neural Networks.Tech Stack:Python, Tensorflow, Scikit-Learn, Numpy, Pandas etc.