Dinesh Kumar Yadav Email and Phone Number

Talend, Big Data, Hadoop and Spark Developer, Kafka,AWS

Epsilon is providing a robust platform for NBA to manage its audience subscriptions and communications, which enables a holistic view and more insights on its member base. This suite of services including design and build of a single customer view marketing database, full service email marketing including campaign management, delivery management, strategy and analytics. Few of my roles and resposibility is mentioned below --Working on a live 13 node Hadoop cluster running on CDH5.8-Involved in end to end design and development of NBA Data Lake.-Using of Spark Data Frames API(Scala) for building ETL pipelines with Aggregations and used for reporting-Development of Spark RDDs for low-level functionality and custom functionality.-Used Sqoop to import and export data b/w Oracle data mart and Hive tables.-Involved in Design and development of Hive and Hbase DDLs.-Involved in Integration of Hive and HBase tables for easy analysis.-Development PigLatin Scripts to load and update the data in HBase tables.-Design and development of oozie workflows in UAT/PROD Environments.-Used different Compression techniques effectively such as Snappy.-Used advanced performance techniques in HBase like Presplitting of regions, Md5 keys.-Create Oozie bundles and workflows to schedule and run hive, spark and shell scripts.Environment: Hadoop, CDH5.8, Hive, Impala, PIG, HBase, Oozie, Cloudera Manager,TFS, Unix,Oracle, Spark

We as Data Stewards Team are highly responsible for Data Accuracy,Data Availability and Data Quality for all type of Data related to different Bu's in Ocwen. Validate the data quality in HDFS Data Lake. Run Talend Job and generate data report for all BU's as per their request.

Hi,I worked for British Telecom as Analyst for a Data warehousing/Data Lake DSS Project.Primary Skill- Hadoop, Hive,Impala, Sqoop, Talend, Oracle PL-SQL, Oracle APEX.Secondary- UNIX Scripting.

Creation for data warehouse for Fidelity Investment as a ETL (Informatica) and PL-SQL developer.Application and automation development using oracle apex.