PROFESSIONAL SUMMARY:• Overall 8 years of IT experience and excellent experience as a Data Engineer, including profound expertise and experience in statistical data analysis such as transforming business requirements into analytical models, designing algorithms, and strategic solutions that scale across massive volumes of data.• Experience in Big Data/Hadoop, Data Analysis, and Data Modeling professional with applied information Technology.• Strong experience working with HDFS, Map reduce, Spark, Hive, Sqoop, Flume, Kafka, Oozie, Pig, and HBase.• IT experience in Big Data technologies, Spark, and database development.• Good experience in Amazon Web Service (AWS) concepts like EMR and EC2 web services which provide fast and efficient processing of Teradata Big Data Analytics.• Expertise in transforming business requirements into analytical models, designing algorithms, building models, developing Data Mining, Data Acquisition, Data Preparation, Data Manipulation, Feature Engineering, Machine Learning Algorithms, Validation, and Visualization, and reporting solutions that scale across massive volumes of structured and unstructured Data.• Experience in the usage of Hadoop distribution like Cloud Era and Horton Works.• Excellent Experience in Designing, Developing, Documenting, and Testing ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Data marts.• Have experience in Apache Spark, Spark Streaming, Spark SQL, and NoSQL databases like HBase, Cassandra, and MongoDB.• Establishes and executes the Data Quality Governance Framework, which includes end-to-end process and data quality framework for assessing decisions that ensure the suitability of data for its intended purpose.• Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort and Link Collector.• Proficiency in Big Data Practices and Technologies like HDFS, Map reduce, Hive, Pig, HBase, Sqoop, Oozie, Flume, Spark, and Kafka.• Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, and XML.• Expertise in configuring the monitoring and alerting tools according to the requirement like AWS cloud watch.• Extensive experience in Text Analytics, generating data visualizations using R, and Python, and creating dashboards using tools like Tableau.
