- Solving complex security checks & bypassing them to extract data.- Extract, process & handle semi-structured and unstructured data formats like JSON, HTML, XML, Text to extract information.- Structure and maintain highly customizable large-scale web crawling setups that extracts and processes millions of data records daily to crawl 1 Billion+ products across 6 continents & 100+ languages globally. - Developed test-driven code using Unit Tests, ensuring reliability and robust functionality.- Storing and validating scraped data from MongoDB & Aerospike databases.- Identifying bottlenecks, bugs & fixing them to increase efficiency.- Created scripts to generate alerts, exports, data checks & cleanup.- Automated processes for health checks of proxies, browsers & auto restart of failed instances.

Worked with US Self Drive Car Rental Company.- Used JCL for scheduling, executing and controlling flow of jobs on mainframe servers.- Worked with SQL on DB2 architecture of IBM servers.- Worked in coordination with teams from TCS, IBM & client side.- Fixing bugs, issues and handling job operations (on server),- Taking backups and working in a real-time production environment.- Using virtual environments to replicate issues, find root cause, fix them and deploy the changes.