Kaustubh Pathak Email & Phone Number

Bengaluru, Karnataka, India

• Implemented Remediation platform for Server connection that seamlessly connect client and dell servers using Api interface to resolve Client server problems using Argo, Golang• Implement custom pipelines with argo workflow for Kubernetes artitecture and in Apache airflow for non-kubernetes artitectures.• Implement custom inputs plugins(Redfish, SNMP Trap) and outputs plugins(Message bus, HTTP) in Telegraf to handle large number of requests(10 Million+/day) in real time.• Automated the Streaming Services using Docker, Kubernetes and Azure with help of Spark/Scala.• Working as SWE-2 to perform daily Backend Operations and Dataops Tasks.• Involved in Development, Testing and Maintenance of Spark Jobs in Java/Scala.• Worked on ETL pipelines to preprocess data from Various Sources(Azure Eventhub, DBFS, Blob Storage).• Involved in deployment process for Spark Jobs over HDInsight and Databricks.

Bengaluru, Karnataka, India

• Build Wrangler tool to search Databases and Tables using Non-Contextual searching and Contextual Searching over NLP(Siemese Network) using Pytorch, Flask, Apache Elasticsearch, Sentence Transformers.• Building custom Java/Python Components including Hyperloglog and Bloom Filters for projects.• Implemented Multi-Threaded / Multi-Process components to transfer between SFTP to MinIO/HDFS in Java/Scala/Python with Airflow Framework.• Performing DataOps(Transfering, Filtering, Analysis) to maintain Day2Day tasks over Large Datasets from SFTP, MioIO, HDFS, MySQL and Streaming Data.

Delhi, India

• Using Forecasting and Machine Learning to Predict localised Server requirements of Machine to save Server cost.• Automating the large scale Database in MySQL to classify and create insight pipeline to detect Logs Anomaly from S3, AWS Athena and building correct slack responses.• Building ETL pipelines for Sumologic, Grafana and Apache Superset Dashboards for Analysing Millions of Rows Datasets from MySQL.• Building ETL pipelines using Apache Airflow to hourly preprocess Millions of Rows of Data from MySQL and S3.• Implementing large scale Dashboards for Sales \& Analytic team using Sumologic, Grafana, Superset and Custom Dashboards build using Plotly, Flask and MySQL

Delhi, India

Gurugram, Haryana, India

• Developing custom NLU pipelines and Middlewares to improve Entity Extractions and Intent Classifications for RASA models.• Developing Pothole Detection and Object Detection Deep Learning Models and integrating deep learning models using FastAPI for Async response.

● Worked on Multiple Projects, including Companies leading Blog Sites using Django & FireBase and Deployed the Interface to Cloud. ● During the internship, Worked on NLP Models and interfaces that can Chat with New Readers and Refer them to the Most Significant Article.

Gwalior Area, India

Gwalior Area, India

● During this time, I acted as Full Stack Developer, and I designed Dynamic websites with various menus and multiple pages, including the company's main website.● Hosted and maintained the Company Website on AWS.

Integrated M.Tech, Information Technology, 7.8

Intermediate, Pcm With Computer Science, 88.7%