Manoj Kumar Ravichandran Email & Phone Number

San Francisco Bay Area

Menlo Park, California, United States

• Worked on complex SQL Queries, PL/SQL procedures and convert them to ETL tasks.• Built data pipelines to move data from source to destination scheduling by Airflow.• Developed BIX Extract application in Python to ingest Pega (Complaint System) files to HDFS and configure Airflow DAGs to orchestrate ETL workflow.• Involved in Agile Development process (Scrum and Sprint planning).• Involved in various sectors of business, with In-depth knowledge of SDLC (System Development Life Cycle) with all phases of Agile - Scrum, & Waterfall.• Developed Map Reduce jobs using Java to process large data sets by fitting the problem into the Map Reduce programming paradigm.

New York City Metropolitan Area

• Designed & developed batch processing solutions by using Data Factory and Azure Databricks.• Designed, developed and implemented solutions with data warehouse, ETL, data analysis and BI reporting technologies.• Identified, evaluated, and documented potential data sources in support of project requirements within the assigned departments as per agile methodology.• Created Python / SQL scripts, to transform Databricks notebooks from Redshift table into Snowflake S3 buckets.• Extensively worked on Data Services for migrating data from one database to another database.• Implemented various performance optimization techniques such as caching, Push-down memory-intensive operations to the database server, etc.• Worked with developing customized UDF's in java to extend Hive and Pig Latin functionality.• Involved in data from RDBMS and performed data transformations, and then export the transformed data to Cassandra as per the business requirement and used Cassandra through Java services.

Chicago, Illinois, United States

• Participated in requirements sessions to gather requirements along with business analysts and product owners. Involved in Kafka and building use case relevant to our environment.• Worked on implementation and maintenance of Cloudera Hadoop cluster.• Pulled the data from data lake (HDFS) and massaging the data with various RDD transformations.• Involved in building an information pipeline and performed analysis utilizing AWS stack (EMR, EC2, S3, RDS, Lambda, Glue, SQS, and Redshift).• Responsible for developing data pipeline using flume, Sqoop and pig to extract the data from weblogs and store in HDFS.• Developed Oozie workflow jobs to execute hive, Sqoop and MapReduce actions.• Architected, Designed and Developed Business applications and Data marts for reporting.• Imported the data from different sources like HDFS/HBase into Spark RDD and developed a data pipeline using Kafka and Storm to store data into HDFS.• Collaborated with Business users for requirement gathering for building Tableau reports per business needs.

Ohio, United States

• Worked closely with Business Analysts to gather requirements and design a reliable and scalable data pipelines.• Develop and add features to existing data analytic applications built with Spark and Hadoop on a Scala, Python development platform on the top of AWS services.• Programming using Python, Scala along with Hadoop framework utilizing Cloudera Hadoop Ecosystem projects (HDFS, Spark, Sqoop, Hive, HBase, Oozie, Impala, and Zookeeper etc.).• Involved in developing spark applications using Scala, Python for Data transformations, cleansing as well as validation using Spark API.• Developed several Accelerators/Tools as Spark/Step Functions for Workflow (UNIX Scripts as well) applications that saved a lot of Manual Efforts.• Developed ETL data pipelines using PySpark on AWS EMR, also Configured EMR clusters on AWS.• Provided end to end data solutions to business and analytics team ensuring end to end encryption by leveraging AWS cloud services and native python and shell scripting.

India

• Worked extensively along with business analysis team, scrum masters in gathering requirements and understanding the workflows of the organization.• Involved in Data mapping specifications to create and execute detailed system test plans. The data mapping specifies what data will be extracted from an internal data warehouse, transformed and sent to an external entity.• Analyzed business requirements, system requirements, data mapping requirement specifications, and responsible for documenting functional requirements and supplementary requirements in Quality Center.• Wrote and executed unit, system, integration and UAT scripts in a data warehouse projects.• Wrote and executed SQL queries to verify that data has been moved from transactional system to DSS, Data warehouse, data mart reporting system in accordance with requirements.• Created the test environment for Staging area, loading the Staging area with data from multiple sources.• Worked on data profiling and data validation to ensure the accuracy of the data between the warehouse and source systems.• Monitored the Data quality of the daily processes and ensure integrity of data was maintained to ensure effective functioning of the departments.

Master'S Degree, Computer Science

Bachelor Of Engineering - Be, Computer Science