Siddharth Goyal Email & Phone Number

Gurugram, Haryana, India

• Supported computation of derived attributes from raw fields in Elastic Search as well as the construction and ingestion of country-specific data pipelines.
• Performed queries on the Elastic Search and MongoDB architectures to speed up data retrieval and optimize searches.
• Suggested and developed a script for searching ES data, optimizing it through fuzzy match, and further automating it using DAGs in order to create company profiles and ingest them into MongoDB for different countries.
• Developed search-based ES indexes for constructing features like HS Code and Company Name autosuggest.
• Sped up the execution time of numerous Python functions by employing multithreading and parallelizing these processes with the aid of the pandarallel/threadpool executor.
• Tools/Technologies Used- Jupyter Notebook, Python, Pandas, Elasticsearch, Apache Airflow, PyMongo, Numpy, MongoDB, Muti-Threading, Threadpool Executor.

Gurugram, Haryana, India

• Indexing: Created Index for around 400+ tables on EC2, increasing efficiency and help reduce the query time from an average of 3 mins down to 40ms.
• Automation: Automated storing various indexes and then automatically re‑indexing them if EC2 was reset due to excess load and scheduled a CRON for the same.
• Pandas and NumPy: Formulated a python script to compare daily data of various databases like Redshift, EC2, CMDB, DMS etc. and automatically store the data inconsistencies and monitor the data variances used Pandas.
• Used NumPy Library to find out GMV values across various Indian cities and present it in a structured manner to send to the CEO, CTO etc on a daily basis.
• Tools/Technologies used and learned: Python, Pandas, Jupyter Notebook, Automation, FastAPI, Cron, SQL, DBeaver, CyberDuck, NumPy, PostgreSQL

Noida, Uttar Pradesh, India

Made a state-of-the-art program using OpenCV in Python to provide an elegant solution to the Rubik's Cube problem.

Bachelor Of Technology - Btech, Computer Science

Education record