Mohammed Sameer Email & Phone Number

Princeton, New Jersey, United States

Responsibilities:• Developing Spark programs with Python, and applied principles of functional programming to process the complex structured data sets.• Work in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business.• The individual will be responsible for design and development of High-performance data architectures which support data warehousing, real-time ETL and batch big-data processing.• This project was mainly… Show more Responsibilities:• Developing Spark programs with Python, and applied principles of functional programming to process the complex structured data sets.• Work in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business.• The individual will be responsible for design and development of High-performance data architectures which support data warehousing, real-time ETL and batch big-data processing.• This project was mainly focus on reporting the commercial loan detailed information to ‘Federal department’ with applying ‘Data Governance controls on it.• Worked with Hadoop infrastructure to storage data in HDFS storage and use Spark / HIVE SQL to migrate underlying SQL codebase in AWS.• Converting Hive/SQL queries into Spark transformations using Spark RDDs and Pyspark• Analyzing SQL scripts and designed the solution to implement using Pyspark• Export tables from Teradata to HDFS using Sqoop and build tables in Hive.• Loaded and transformed large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.• Use Spark SQL to load JSON data and create Schema RDD and loaded it into Hive Tables and handled structured data using Spark SQL.• Worked with Hadoop ecosystem and Implemented Spark using Scala and utilized Data frames and Spark SQL API for faster processing of data.• Developed Spark code using Scala and Spark-SQL/Streaming for faster processing of data.• Develop RDD's/Data Frames in Spark using and apply several transformation logics to load data from Hadoop Data Lakes. Show less

Bentonville, Arkansas, United States

Responsibilities:• This project was focused on customer clustering. Used the ETL Data Stage Director to schedule and running the jobs, testing and debugging its components & monitoring performance statistics.• Installed Hadoop, Map Reduce, HDFS, and AWS and developed multiple Map Reduce jobs in PIG and Hive for data cleaning and pre-processing.• Architected, Designed and Developed Business applications and Data marts for reporting. Involved in different phases of Development life… Show more Responsibilities:• This project was focused on customer clustering. Used the ETL Data Stage Director to schedule and running the jobs, testing and debugging its components & monitoring performance statistics.• Installed Hadoop, Map Reduce, HDFS, and AWS and developed multiple Map Reduce jobs in PIG and Hive for data cleaning and pre-processing.• Architected, Designed and Developed Business applications and Data marts for reporting. Involved in different phases of Development life including Analysis, Design, Coding, Unit Testing, Integration Testing, Review and Release as per the business requirements.• Implemented Spark GraphX application to analyze guest behavior for data science segments.• Worked on batch processing of data sources using Apache Spark, Elastic search.• Developed Big Data solutions focused on pattern matching and predictive modeling.• Collaborated with EDW team in, High Level design documents for extract, transform, validate and load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams.• Develop an Estimation model for various product & services bundled offering to optimize and predict the gross margin• Designed OLTP system environment and maintained documentation of Metadata. Used forward engineering approach for designing and creating databases for OLAP model.• Exploring with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD's, Spark YARN.• A highly immersive Data Science program involving Data Manipulation & Visualization, Web Scraping, Machine Learning, Python programming, SQL, GIT, Unix Commands, NoSQL, MongoDB, Hadoop.• Worked on migrating PIG scripts and Map Reduce programs to Spark Data frames API and Spark SQL to improve performance. Show less

India

Responsibilities: • Responsible for analyzing large data sets to develop multiple custom models and algorithms to drive innovative business solutions.• Involved in designing data warehouses and data lakes on regular (Oracle, SQL Server) high performance on big data (Hadoop - Hive and HBase) databases. Data modelling, Design, implement, and deploy high-performance, custom applications at scale on Hadoop /Spark.• Generated ad-hoc SQL queries using joins, database connections and… Show more Responsibilities: • Responsible for analyzing large data sets to develop multiple custom models and algorithms to drive innovative business solutions.• Involved in designing data warehouses and data lakes on regular (Oracle, SQL Server) high performance on big data (Hadoop - Hive and HBase) databases. Data modelling, Design, implement, and deploy high-performance, custom applications at scale on Hadoop /Spark.• Generated ad-hoc SQL queries using joins, database connections and transformation rules to fetch data from legacy DB2 and SQL Server database systems.• Translated business requirements into working logical and physical data models for OLTP &OLAP systems.• Creation of BTEQ, Fast export, Multi Load, Tpump, Fast load scripts for extracting data from various production systems.• Reviewed Stored Procedures for reports and wrote test queries against the source system (SQL Server-SSRS) to match the results with the actual report against the Data mart (Oracle)• Perform Data profiling, preliminary data analysis and handle anomalies such as missing, duplicates, outliers, and imputed irrelevant data. Remove outliers using Proximity Distance and Density based techniques.• Involved in Analysis, Design and Implementation/translation of Business User requirements.• Used supervised, unsupervised and regression techniques in building models.• Performed Market Basket Analysis to identify the groups of assets moving together and recommended the client their risks Show less

India

Responsibilities:• Collaborating wif business users/product owners/developers to contribute to the analysis of functional requirements.• Design and develop the application using Agile Methodologies.• Involved in loading data from the system generated data sources to HDFS and experienced in writing multiple java-based Map-Reduce jobs for cleaning, processing the data.• Loading the data in to hadoop ecosystem by using hive from various data sources and file… Show more Responsibilities:• Collaborating wif business users/product owners/developers to contribute to the analysis of functional requirements.• Design and develop the application using Agile Methodologies.• Involved in loading data from the system generated data sources to HDFS and experienced in writing multiple java-based Map-Reduce jobs for cleaning, processing the data.• Loading the data in to hadoop ecosystem by using hive from various data sources and file systems.• Extensively worked on Hive tables, partitions and buckets for analyzing large volumes of data.• Used Apache Avro wif Hive to make the advantages of compressed, efficient columnar data representation available to this project in Hadoop ecosystem.• Had experience wif Source Code Repository systems (SVN) and used revision control systems such as Git.• Debugging Map Reduce jobs using job history logs and syslog for tasks.• Developed shell scripts for adding process dates to the source files.• Transferring the log incoming log files to the Parser (specially written Java Code to load in to HDFS, HBASE) by using Kafka message broker.• Design & Develop ETL workflow using Oozie for business requirements which includes automating the extraction of data from MySQL database into HDFS using Sqoop scripts. Show less