Arjun Kumar Email & Phone Number

Santa Clara, CA, US

Cupertino, California, US

• Data Migration from On-premise Data lake to | s3 | Iceberg using Airflow DAGs | Spark | Distcp.
• Data Migration from Kafka Streams to Iceberg using Flink.
• Automated the Data Validation and reconsilation process.
• Setting up Flink data pipeline and Data Dog Alerts and Monitoring process.
• Performance tuning of flink application and reducing the Lag to meet the SLA.
• Automated the process to generate the DAG for Data Copy.

Oakland, California, US

• Creating Road Map for Data ingestion and Data Procession on Hadoop.
• Designing and Building the Reporting Layer on Big Data.
• Setting up Next Gen / S5 /PCR / BCABL Lab/Machines and Torrent Server.
• Helped Data scientists to analyze the Cancer patient/Gene/Blood Culture using Perl and R Module.
• Working closely with the Data Scientist team in Genetics Lab to analysis the Genetics data produced by iron chef and other lab machine. Helping them to identify the Cancer test result, Identify the mutant Gene, Analyze.
• Created the UI to Build Data Pipeline to ingest the Data from multiple source system to Hadoop.

Santa Clara, CA, US

• Creating Ingestion -ETL Process to Ingest Data from different source system to Hive/Hbase Tables.
• Creating Azkaban job flow to load daily/ Incremental Data.
• Automating Sqoop Jobs to import the data and to load into hdfs.
• Generating reports using Impala/hive/Python/Scala.
• Ingesting Data from heterogeneous source system and creating the framework for incremental load and data validation.
• Analyze current data sources, schema based on use case documentation provided, Develop program and scripts to complete data ingestion into Hadoop cluster.

Mclean, VA, US

• Creating ETL Process to Move Data from Landing Phase/Key Phase/Split to Hive Tables.
• Historical loads (one-time) from Teradata using an unload script built on Teradata Parallel Transporter (TPT) and Fast Load Scripts.
• Creating Talend Jobs to apply business rule and to load into hdfs.
• Recurring loads from the Oracle source system using an sFTP pull framework and Landing of files into the UNIX edge node.
• Registration of the datasets in a metadata registry that controls admittance into Hadoop.
• Designed criteria for progressive classification of the datasets within Hadoop (from raw to validated, refined and archived)

Cork, Ireland, IE

• Develop the ETL solutions to migrate payroll from workday to ADP
• Leading Development team, In Developing / DBA and Business to Develop the ETL solutions for various subject areas.
• Designing the ETL process to load data from various different source to HDFS.
• Interacting with Business/Domain to gather ETL requirements & analysis off various data sources, Flat files and oracle.
• Provide Technical guidance and leadership on Etl methodologies for projects, such as technical requirements, source system analysis, Etl design topics, ETL control system, Etl Jobs, code reviews and testing procedures.
• Generating the Ad-hoc Report using the Hive.

San Diego, California, US

• Leading Development team, In Developing / DBA and Business to Develop the ETL solutions for various subject areas.
• Extensively used Cloudera (Hive) to generate the Reports.
• Provide Technical guidance and leadership on Etl methodologies for projects, such as technical requirements, source system analysis, Etl design topics, ETL control system, Etl Jobs, code reviews and testing procedures.
• Worked extensively on Big Data, extensively used DataStage an ETL tool to design mappings to move data from Source to Target database-using Stages.
• Interacting with Business/Domain exert to gather ETL requirements & analysis off various data sources, Flat files, oracle, sql server, mainframe system.
• Interacting with DBA team to convert Logical Data Model into the Physical Data Model and recommending primary index/secondary based on nature of query submitted by the end user.

London, GB

• As an ETL developer, I am involved in
• Designing the ETL jobs using DataStage 7.5.1 tool to load data from Mainframe to Teradata Data-base.
• Created sequence for running ETLs using new job sequencer, job activity, nested condition, noti-fication activity and sequencer.
• Used job sequence to create job sequencer, to call various parallel job and send message in case of process failures through the execution command.
• Testing the Jobs and preparing the Unit Test Cases.

Bachelor'S Degree, Engineering/Industrial Management

Education record

Bachelor Of Engineering (B.E.), Industrial Production Engineering And Management