Presently working with the Big Data and Analytics Practice.

I was the Engineering Manager for the NIA DocAI platform which helped enterprises in digitizing documents and derive insights from extracted data.Prior to that I was the Engineering Lead for NIA Data platform and involved in developing a data management platform to simplify the data lifecycle management and governance in a data lake. Also involved in exploring new technologies in the Big Data ecosystem and adapting them to the NIA Data platform.

I lead the Engineering team for the NIA Knowledge platform. The knowledge platform provides a capability to capture and store information from different sources like source code, documents, etc. in the form of an ontology. The stored information can then be queried through a search option or accessed via chatbot by end users.Have worked as Solution Architect for different customers by deploying solutions based on NIA Data platform. Primary technologies involved were Hadoop, Spark, Hive, Azkaban, Java. Architected & designed a data lake by setting up ingestion of data from internal & external data sources, performing data transformation and data analytics.

I worked as a Big Data Architect at a large Technology Company designing & developing applications to induct data into Hadoop/Hive and create aggregated reports for business reporting/visualization. Primary technologies involved were Hadoop, Hive, Oozie, Python & Java.

I traveled to Bay Area to work on a Big data project at a large manufacturing company. There I worked on the migration of Teradata based aggregate processing into Hadoop. I was part of the team that developed the Oozie based semantic process used in Hadoop applications and worked on the requirements & design of a semantic framework.Later I was involved in the requirements, design and development of a new Hadoop only application. As part of the team, I has defined the core processes around data validation, DQM, data correction, and data loading into Hadoop/Hive tables. I also managed the complexities of core module that involves components spread across multiple servers, coordinating with multiple interfacing teams and working on multiple technologies (like Hive, Shell, Python, Java, Perl, Oozie).

In the beginning of the period, I was involved in designing and developing a Java application for an European banking customer. I was working at the client location in Zurich interacting with different parties involved in the project. My responsibilities included coordinating with offshore team in developing the application and mentoring the team of junior engineers.Later, I was involved in prototyping and developing a cloud based solution, which provides IT as a service with features like - Self-Service with Infrastructure Platforms and Applications as a Service, Automated Provisioning, Automated Resource Management and load balancing, SLA driven Service Management ,Monitoring, Chargeback, Billing, etc. I was into designing and leading the development of the solution.I was then involved in the design and development of an OLAP framework over Hadoop for Enterprise data warehouse(EDW). My responsibilities included using Hadoop, Hive, Pig and other frameworks and design & implement modules for code accelerator, data integration, data processing, data storing and data consumption.

Initially I was Involved in the design, development and testing for a J2EE based application dealing with the critical logistical and shipment data for a large Logistics company.Then, I was involved in report development using JReports, JSP and Servlets for a Hong Kong based Insurance company with essential information on the sales process and aid overall as well as individual performance tracking. .I was later involved in developing, maintaining and enhancing a web-based application designed using J2EE in UNIX for Australia’s leading Telecommunications Carrier Company. I was based in Australia for over a year as onsite coordinator and coordinated with different customer, vendor teams and offshore teams to effectively complete work. Later I lead an offshore team of 8 supporting a suite of applications and was involved in project and team management. For the last few years in this period, I was involved in the development and consultation of the Infosys J2EE Application development Framework which helps implement agile enterprise applications through service-oriented architecture concepts and design. The framework incorporates industry best practices and leverages open source. I was involved in development, supporting and consulting with projects in leveraging the different components of the framework.