Sharad Patel Email & Phone Number

Florida, United States

Zephyrhills, Fl, Us

Valley Forge, Pa, Us

• Spearheaded the processing of vast datasets using cutting-edge Big Data technologies, such as Cloudera Distribution 7.x, Amazon EMR, Databricks, and Cloudera CDP, ensuring timely and accurate data processing.• Implemented robust data pipelines and workflows, handling terabytes of data efficiently and reliably to meet the business's data processing needs • Worked with analyst to determine and understand business requirements. • Involved in working with Spark on top of YARN for interactive and batch analysis. • Implemented POC on writing programs in Scala using Spark and worked on migrating MapReduce programs into Spark using Scala. • Implemented Spark SQL to update queries based on the business requirements.• Using SparkSQL allowing to the data from different formats it's currently in (like JSON, Parquet, a Database), transform it, and expose it for ad-hoc/interactive querying. • Used Spark API over Hortonworks Hadoop YARN to perform analytics on data in HDFS. • Integrated various business validation & prep flag rules from campaign managers and business analyst on the data.

New York, Ny, Us

• Involved in the process of data acquisition, data pre-processing and data exploration of telecommunication project in scala. • As a part data acquisition in, used sqoop and flume to inject the data from server to hadoop using incremental import. • In pre-processing phase used spark to remove all the missing data and data transformation to create new features. • In data exploration stage used hive and impala to get some insights about the customer data. • Used flume, sqoop, hadoop, spark and oozie for building data pipeline. • Installed and configured Hadoop Map Reduce, HDFS, Developed multiple Map Reduce jobs in java for data cleaning and Processing. • Importing and exporting data into HDFS and Hive using Sqoop • Experienced in defining job flows • Experienced in managing and reviewing Hadoop log files. • Load and transform large sets of structured, semi structured and unstructured data • Responsible to manage data coming from different sources • Cluster coordination services through Zookeeper. • Involved in loading data from UNIX file system to HDFS. • Installed and configured Hive and also written Hive UDFs.

Frankfurt Am Main, Hessen, De

Nairobi, Ke

• Involved in the process of data acquisition, data pre-processing and data exploration of scala. • As a part data acquisition in, used sqoop and flume to inject the data from server to hadoop using incremental import. • In pre-processing phase used spark to remove all the missing data and data • transformation to create new features. • In data exploration stage used hive and impala to get some insights about the customer data. • Used flume, sqoop, hadoop, spark and oozie for building data pipeline. • Installed and configured Hadoop Map Reduce, HDFS, Developed multiple Map Reduce jobs in java for data cleaning and Processing. • Importing and exporting data into HDFS and Hive using Sqoop • Experienced in defining job flows • Experienced in managing and reviewing Hadoop log files. • Load and transform large sets of structured, semi structured and unstructured data • Responsible to manage data coming from different sources • Cluster coordination services through Zookeeper. • Involved in loading data from UNIX file system to HDFS. • Installed and configured Hive and also written Hive UDFs. • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map way • Automated all the jobs, for pulling data from FTP server to load data into Hive tables, using Oozie workflows.

• Developed application logic using C#.• Written stored procedures, triggers using SQL in SQL SERVER 2005.• Worked intensely on the User Interface.• Developed WebForms using C# and ASP.NET.• Used AJAX in some webforms.• Worked on Cascading Style Sheets and XML-Schemas.• Developed Web Services for user authentication and file ransfer • Used Xpath , XmlNode to access files and XMLDataDocument to synchronize with Datasets.• Compared the XML files sent by the Toll Authorities with XML Schemas.• Ensured Security to all the portals by creating Tampered proofed URLs.• Wrote triggers for sending Emails after to clients after any kind of transaction has been made• Extensively used GridViews sorting and paging• Implemented Template Columns for Custom Nested GridViews• Worked with Infragistic Controls extensively.• Worked on exporting reports to Excel from Gridviews and Ultrawebgrids.• Deployment of Application on Test and Production Server.• Handled many production issues and enhancement to the existing live portals

Master’S Degree, Ms. Computer Network & Comm Mgmt

Bachelor’S Degree, Computer Science

High School, Igcse