Designed and built robust data pipelines using big data ecosystems including Hadoop, Spark, Kafka, Elasticsearch, and Cassandra.Built and optimized Spark jobs to handle billions of records, tuning for efficient resource utilization and significantly improving cluster performance and reducing processing time.Designed and built APIs for external partners to handle high throughput data, ensuring seamless data exchange and integration.Built and supported data analytics tools to provide actionable insights and support decision-making processes.Developed an orchestration framework in Python to display and integrate results with the Web UI, enhancing user experience and system interactivity.Created Large Language Model (LLM) solutions to automate and reduce manual review work, increasing efficiency and accuracy.Built AI/ML tools and pipelines for business category classification.Led a team of 15 engineers, executing projects from requirements gathering through to production support, ensuring timely delivery and high-quality outcomes.

 Design and Develop solutions for high throughput map data processing system. Recommend/Develop solutions for instrumentation and performance metrics that can be used by upper management for decision making and cost estimation. ETL is done by using mongoDB (NoSql) and PostgreSQL databases for storage/analysis and tableau and kabana to display the metrics.  Develop various metrics and dashboard for production support and task complete estimation using kabana elastic search and MongoDB.  Lead team of developers for day to day assignments, code-review , JUnit and Design. Write/Maintain batch applications and real-time applications for map data transfer and storage written in Java using Spring Framework.

 Design and Develop trading API for Chicago Board Options Exchange using java, xml and byte buffers and FIX. Write replay and batch processing tools for back office regulatory and surveillance.  Lead team of developers and provide mentoring, guidance and direction along with preparing project schedule.  Analyze and debug real-time production issues and report/fix in timely manner. Develop various solutions for collection process status(node information) from distributed processes running across 100+ nodes and display on a dashboard using python and shell scripts.

 Implement highly robust and performance oriented trading APIs by following Object Oriented Principles and Design Patterns. 24x7 Production support on rotation schedule. Design algorithms that provide super-fast performance and scalability along with maintainability.  Create and maintain Binary and CORBA trading-firm API build based on TCP.  Design/Develop and Support trading API for FIX Engines.  Write Market data publications, subscriptions and filtering applications that are used by firms to find the Top of the Market price and NBBO.

 I was a primary developer of several subsystems that were a part of a project to develop a new digital map data collection and storage. Company was converting the Mainframe data repository (VSAM) into the Oracle data repository.  Developed data pipeline for converting data from one format (SEF, MIF, SHP, SIF, UMF) to another (Oracle Relational database). Designed and developed map editing tools/applications using Java Swing, HTML and XML. These tools allowed internal users to add/edit map data stored in Oracle using graphical interface (Java Swing).  Developed PL/SQL tools to perform oracle spatial operations (Merge geometry, build geometry, update, split etc). Developed highly sophisticated stored procedures, Java stored procedures, highly efficient/complex sql scripts for various operations.  Developed automated test framework/ Smoke test framework on Windows server using Ant for PL/SQL components. Maintained automated JUnit and integration tests using Ant framework. Worked on Query tool (Reporting tool for Map database) using JSP on Struts framework. Developed various python and shell scripts for batch operations.  Directly worked with end users and prepared the requirement documents that meet company’s specification standards. Performed architectural and feasibility studies of user requirements, created prototypes and given “Proof of Concepts”. Created Architectural design for new projects. Regularly demonstrated object-oriented & extreme programming principles, Design patterns and UML diagrams.  Worked on high priority problems that could shut down the production or cause possible failure in software sub systems. Mentored/Managed new employees and other team members to understand the project architecture and software component design. Traveled internationally for software demonstration, end-user training and technical support.  Performance tuned software tools to meet user expectations and enhance user experience.

- Research Data Driven and Command Driven automated testing techniques.- Tutor undergraduate and graduate students. - Grade assignments and exams.