Jason E Email & Phone Number

Milwaukee, WI

• Worked on Hadoop cluster scaling from 4 nodes in development environment to 8 nodes in pre-production stage and up to 24 nodes in production.
• Involved in complete Implementation lifecycle, specialized in writing custom MapReduce, Pig and Hive programs.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• AWS Cloud and On-Premise environments with Infrastructure Provisioning / Configuration.
• Extensively used Hive/HQL or Hive queries to query or search for a particular string in Hive tables in HDFS.
• Used Apache NiFi for creating a pipeline which consumes the data from source, does data processing and stores the data into AWS HBase tables using Kafka.

St. Louis, MO

• Worked on analyzing Hadoop stack and different big data analytic tools including Pig, Hive, Hbase database and Sqoop.
• In depth understanding of Classic Map Reduce and YARN architectures.
• Developed Map Reduce programs for some refined queries on big data.
• Hands-on experience in training, evaluating and predicting the data as a part of Machine Learning using Spark MLlib, Tensor Flow, and a regular contributor to Machine Learning projects on GitHub.
• Created Azure HDInsight and deployed Hadoop cluster in could platform.
• Designed and Modified Database tables and used HBase Queries to insert and fetch data from tables.

Bronx, NY

• Worked with Hadoop Ecosystem components like HBase, Sqoop, ZooKeeper, Oozie, Hive and Pig with Cloudera Hadoop distribution.
• Experience in data cleansing and data mining.
• Responsible for processing ingested raw data using Kafka and Hive.
• All the data was loaded from our relational DBs to HIVE using Sqoop. We were getting four flat files from different vendors. These were all in different formats e.g. text, EDI and XML formats.
• Ingest data into Hadoop / Hive/HDFS from different data sources.
• Load data into HBase tables using Java Map Reduce.

San Francisco, CA

• Installed and configured Hadoop Ecosystem components and Cloudera manager using CDH distribution.
• Developed multiple Map Reduce jobs in Java for complex business requirements including data cleansing and preprocessing.
• Developed Oozie Bundles to Schedule Pig, Sqoop and Hive jobs to create data pipelines.
• Handled importing of data from various data sources, performed transformations using Hive, Pig, and loaded data into HDFS.
• Developed Spark streaming applications for consuming the data from Kafka topics.
• Developed Sqoop scripts to import/export data from Oracle to HDFS and into Hive tables.

Chennai, India

• Involved in the coding of JSP pages for the presentation of data on the View layer in MVC architecture.
• Used J2EE design patterns like Factory Methods, MVC, and Singleton Pattern that made modules and code more organized, flexible and readable for future upgrades.
• Worked with JavaScript to perform client-side form validations.
• Used Struts tag libraries as well as Struts tile framework.
• Used JDBC to access Database with Oracle thin driver of Type-3 for application optimization and efficiency.
• Actively involved in tuning SQL queries for better performance.