Chief Manager – Technology, (Et.Com)
CurrentThe primary responsibilities are to ensure: - Project Development & Delivery:- - Built a Recommendation Engine to provide personalized content to the user by learning user choices and producing the outcomes that correlates to their needs and interests. - Hands on experience in Hadoop cluster management and configuration. - Created Data Lake by extracting user data from various data sources into HDFS. This includes data from RDBMS and MongoDB. - Involved in design and development of Data Transformation Framework components to support ETL process. - Developed an ingestion module to ingest data into HDFS from Kafka Stream - Built distributed in-memory applications using Apache Spark and Spark ML to do processing on huge data sets. - These applications were built using Spark Scala & Java API and used YARN as resource manager. - Efficiently used spark transformations and action to build simple/quick and complex ETL applications. - Involved in performance optimisation of Spark jobs and designed efficient queries to query large data sets. - Implemented OAuth 2.0 is the industry-standard protocol for authorisation. OAuth 2.0 focuses on client developer simplicity while providing specific authorisation flows for web applications, desktop applications, mobile phones using spring security. - Analytics - Managing Product Life Cycle. - Operations & Leadership. - Cross-functional coordination between Design, Development, and QA teams to deliver the solutions in quick turnaround time. - Visualising, Analysing, Design architecture, and implementing the various changing requirements from product . - Interacted closely with product and the editorial teams with their feedback to ensure smooth delivery of the project.
