Project: BNYMELLONEnvironment: Hadoop, Hive, HBase, Sqoop, Elaticsearch integration with hive, Spark Oracle, ESP SchedulerResponsibilities:● Worked on hive upgradation from HDP 2.x to CDP 3.x● Worked on ES upgradation from ES5.6 to ES7.11● Created hive tables with Hbase integration, Elastic search integration, Phoenix integration.● Created Hive tables with cobol serde, Lazy serde, csv serde,regex serde● Migration of tables which were loaded in Oracle to Hadoop… Show more Project: BNYMELLONEnvironment: Hadoop, Hive, HBase, Sqoop, Elaticsearch integration with hive, Spark Oracle, ESP SchedulerResponsibilities:● Worked on hive upgradation from HDP 2.x to CDP 3.x● Worked on ES upgradation from ES5.6 to ES7.11● Created hive tables with Hbase integration, Elastic search integration, Phoenix integration.● Created Hive tables with cobol serde, Lazy serde, csv serde,regex serde● Migration of tables which were loaded in Oracle to Hadoop environment (Pershing DataLake).● Running Java framework which obtained configurations from oracle tables and loadeddata from Oracle to Hadoop.● Creating Unix Scripts and HQLs to load Hive tables.● Importing data from Oracle to hadoop using Sqoop● Worked on PAS Growth - A framework which sends congratulatory mails to NETX360users on real-time, based on their milestones.● Creating generic unix scripts to perform count validation post data migration.● Scheduling the jobs through ESP● Maintained versioning of code by check in the codes in GIT Show less

Project: WalgreensEnvironment: Hadoop,Teradata,ESP Scheduler,OracleWorking Model: AgileResponsibilities:● Migration of tables which were loaded in Teradata to Hadoop environment.● Replicating existing DataStage logic to Hive Quires, Pig scripts and loading the hive tables (Aspart of migration).● Performing Export and Import of data from Teradata using Sqoop.● Testing of the scripts from end to end and performing data validation.● Scheduling jobs through… Show more Project: WalgreensEnvironment: Hadoop,Teradata,ESP Scheduler,OracleWorking Model: AgileResponsibilities:● Migration of tables which were loaded in Teradata to Hadoop environment.● Replicating existing DataStage logic to Hive Quires, Pig scripts and loading the hive tables (Aspart of migration).● Performing Export and Import of data from Teradata using Sqoop.● Testing of the scripts from end to end and performing data validation.● Scheduling jobs through ESP.● Validation and Hand over to support team post implementation.● Maintained versioning of code by check in the codes in GIT in every stages - Development,QA, Production.● Logged the status, defects in assigned user stories in Jira Show less