Heading BI Team responsible for building a data platform including data lake and data pipelines along with dashboards and reporting. Responsible for architecture, design, development and deployment of the data platform.My responsibilities are following● Responsible for designing, architecting and implementing data pipelines and data lake.● Assessment of right set of tools and technologies as per the requirement● Building short, medium and long term plan and strategy for analytics platform● Developing Video categorization System based on Deep Learning● Developed both batch processing and real-time system using Apache Spark based ETLjobs.● Used AWS ecosystem extensively(i.e. S3, Kinesis, EMR, Redshift, SQS, SNS, Athena,EC2, Glacier, etc). Developed Data Lake from where data is kept under categories-hot, warm and cold as per the usage.● Developed dashboard for both batch system and real-time system using, Supersetand Kibana, respectively. Provided querying system for different teams, etc.● Optimization of Implemented Solution in planned way● Cost Benefit Analysis of Cloud based infrastructure● Coordinated with stakeholder teams(Sales, Marketing, Content, Strategy and HigherManagement)

Worked on designing and developing a Cyber Security Analytics Platform from scratch. used Apache Metron for managing threat indicators. used Kafka and Storm based data streaming pipelines.used Spark for consuming data from streams and dumping into HDFS.

I worked on developing modules to analyse the vital parameters related to the health of Hadoop Mapreduce, Pig, Hive and Spark jobs by analysing the logs and other data generated by the jobs in the HDFS. I developed a module for analysing the Oozie workflows and coordination jobs in order to analyse the past performance and future predictions with respect to the parameters like input data size, cluster configuration, etc. I participated in the development of Kafka based messaging queue solution for transporting data from cluster to the processing server.

I worked on developing the module which transformed unstructured log data into structured data(key-value pair), storing data to the HBase tables and generated reports by reading from the tables. I developed Hadoop Mapreduce jobs to parse the log data and extract the fields and ultimately transformed into structured data. I used Pig scripts for storing data to HBase table and report generation. I developed workflows using Oozie for synchronizing and scheduling different actions.

I worked on the developing an analytics tools which analyses the huge log data set(~2 TB compressed) on the daily basis using Hadoop Mapreduce Jobs which generated more than 60 metrics on hourly and daily basis. I also developed the modules based on Apache Flume topology for shipping logs produced at the web servers to the Hadoop cluster. I also developed a Oozie workflow for synchronizing jobs.

PROJECT : CMSClient – Ford MotorsCMS is a content management system which will manage the repository with huge file data using Adobe CQ5 which also manages Ford website. Programming environment used is Java(JDK 1.6).ROLE – Senior Software Engineer• Worked as an individual contributor.• Developed a POC presented before client team• Developed a Java based tool to import data(image,text,videos,etc) from SVN repository to the CQ5 repository. Also, tool handles delta changes in the both repositories and keeps them in synch.• Developed modules for fetching ,analyzing and sending data from JCR to UI. PROJECT : WBDOWBDO is Web based dealer orders management system which replaces older System. Programming environment used is Java(JDK 1.6).ROLE – Senior Software Engineer• Worked as an individual contributor.• Developed end-to-end a complete module(consists of many APIs)• Close interaction with the UI team sitting in different geographical locations.

PROJECT: COMMUNITY SOCIAL NETWORK AGGREGATOR ( CSNA)CSNA is a communication tool which connects a mobile device with social networking websites like Facebook, GTalk using SIP technology.Responsibilities:• Developing software which implements Extensible Messaging and Presence Protocol (XMPP) stack which provides many facilities including exchanging Instant messages and file transfer• Developing MSRP stack which was incomplete and apply the same stack in CSNA for receiving messages and file from mobile device user• Testing software modules using Junit• Participation in planning process of both HLD and LLD• Participation in developing web application and web services for CSNA application using Grails framework.• Developing GTalk Simulator based on XMPP which acts as a server capable of receiving and sending requests like text chatting, image uploading, etc.

PROJECT : COBROWSEeGain Cobrowse™ enables agents at to provide high-value, live collaboration options to online customers and prospects. It gives your company the ability to deliver real-time assistance and convert site visitors into profitable, long-term customers.ROLE – Product Engineer• Involved in the requirement analysis, designing and developing various modules of the project• Close interaction with the QA team in order to promote extreme programming and agile development

PROJECT: CONSULTCONSULT - A knowledge management tool developed by TCS. It is the first case-based reasoning solution built on Artificial Intelligence algorithms. Responsibilities:• Enhancements and testing of the tool.; • Customizing the Java code involving JSP and Servlets • Testing with SQL queries using Microsoft SQL Server 2005• Design, development and testing of Java Script and HTML based web screens• Integration and Unit Testing