Manoj Kumar Email & Phone Number

* 5+ years of overall IT experience in a variety of industries, which includes hands on experience of 4+ years in various Azure data services. Involved in creating Hive tables, and loading and analyzing data using hive queries.* Implemented Partitioning, Dynamic Partitions, Buckets in HIVE to optimize performance.* Experienced in handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself.* Experience in implementing Pyspark DataFrame, Transformations and actions to implement business Analysis.* Experience in processing data in Spark using Scala to load the data from Data Lake Store to Integrate Layer.* Strong experience on Hadoop distributions like Cloudera and HortonWorks.* Experienced in handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations. Analyzed the SQL scripts and designed the solution to implement using Pyspark.* Experience in Python and spark to scrape, clean and analyse large Datasets. Implemented schema extraction for Parquet and Avro file Formats in Hive. Worked with Azure Storage Systems like Azure Data Lake Store (ADLS) and Azure Blob Storage. Constructed the Azure data factory (ADF) pipelines with utilization of transformation activities such as Hive, Spark Etc.* Analyze, design and build Modern data solutions using Azure service to support visualization of data Involved in building the dashboards using Qlikview designer to develop applications.

• 

  Telangana University

  A