Mohan S Email & Phone Number

San Francisco, California, Us

The Customer Engagement Engine (CEE) is an AI-Powered brain, will be connected to all authenticated channels, that decides the ‘next best conversation’ to have with a customer based on customer behaviors, available products and service offers and sophisticated machine learning and adaptive modelingprinciples.The next best conversation promotes will demonstration “you know me”, build trust and improve the depth of customer relationship with wells fargo.Responsibilities:• Extract business data from multiple data sources and store in MapR DB HDFS location.• Analyze the requirements and communicate the same to both Data Science and other team members.• Closely worked with Data Scientists and build pyspark scripts to meet their data needs using OSDS platform (IBM spectrum).• Make necessary changes as per Data Science team as required on fly and re generated the features for data modeling. • Worked with Enterprise Data Lake team to maintain data and information security for all use cases.• Worked on automation script using AUTOSYS to automate the pyspark scripts end-end.• Monitor the data loads for Feature Engineering required input data and report to the ingestion team if we miss any partition/data. • Developed scripts and configurations to successfully load data using Data Ingestion Frameworks (DCI/DCT).• Post-production support of the AIES Open Source Data Science (OSDS) Platform.• Enumerated Hive queries to do analysis of the data and to generate the end reports to be used by business users.

Charlotte, Nc, Us

Worked on implementation and data integration in developing large-scale system software experiencing with Hadoop ecosystem components like HBase, Sqoop, Zookeeper, Oozie, Hive for ERICA application.Developed ETL Applications using Hive, Spark, and Impala & Sqoop for Automation using Oozie.Automated the process for extraction of data from warehouses and weblogs by developing work-flows and coordinator jobs in Oozie.Developed workflow in Oozie to automate the tasks of loading the data into HDFS.Creating Hive tables, dynamic partitions, buckets for sampling, and working on them using HiveQL.Used Sqoop for importing the data into HBase and Hive, exporting result set from Hive to MySQL using Sqoop export tool for further processing.Enumerated Hive queries to do analysis of the data and to generate the end reports to be used by business users.Worked on scalable distributed computing systems, software architecture, data structures and algorithms using Hadoop, Apache Spark and Apache Storm etc. and ingested streaming data into Hadoop using Spark, Storm Framework and Scala.Implemented POCs with Spark SQL to interpret complex JSON records.Experience in transferring Streaming data, data from different data sources into HDFS and NoSQL databases using Apache Flume.

San Francisco, Ca, Us

Involved in gathering the requirements, designing, development and testing. Responsible to manage data coming from different sources. Successfully migrated Legacy application to Big Data application using Hive/HBase in Production level. Load and transform large sets of structured, semi structured, and unstructured data that includes Avro, sequence, word, Excel files and XMLfiles. Created Nifi and Streamsets pipelines to collect the data from different sources and load into the HDFS and Hive tables.Analyze the flexter tool for split/parse XML files dynamically. And provided the end to end POC to the client. Handled different time series data using HBase to perform store data and perform analytics based on time to improve queries retrieval time. Developed simple and complex MapReduce programs in Java and scala for DataAnalysis. Worked on Hue interface for querying the data and validation the data. Developed Hive Scripts for implementing dynamic Partitions. Developed workflow in Oozie to automate the tasks of loading the data into HDFS from different sources.

Charlotte, North Carolina, Us

Coordinated with business customers to gather business requirements. And also interact with other technical peers to derive Technical requirements and delivered the BRD, MDD and TDD documents. Extensively involved in Design phase and delivered Design documents. Experience in Hadoop eco system with HDFS, HIVE, Zookeeper and SPARK with SCALA. Extracted data from different flat files, azure external storage, external hard drives and transformed the data based on user requirement using spark and loaded data into target, by scheduling the sessions. Created reusable mapplets and Transformations starting concurrent batch process in server and did backup, recovery and tuning of sessionsCreate data flow using Apache Nifi for Monthly semi-real time data processing. Using Azure data factory, AZcopy and Explore moving data from one External Blob to Internal Blob Storage.Worked on analyzing Hadoop cluster and different Big Data Components including Hive, Spark, Oozie. Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data. Involved in creating Hive tables, loading with data and writing hive queries that will run internally in map reduce way. Experienced in defining job flows Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting. Experienced in managing and reviewing the Hadoop log files.Creates Test Strategy, Test Cases, ensures clear requirements in Version1 stories to support creation of test scenarios and scripts. Test Strategy creation and building Test Case template for QA teams to utilize based on functional requirements.