Mujtaba Ali Email & Phone Number

Dallas, Texas, United States

Dallas, Texas, United States

• Involved in the abnormal state outline of the Hadoop 2.6.3 engineering for the current information structure and Problem articulation and setup another group and arranged the whole Hadoop stage.• Responsible for building scalable distributed data solutions using Hadoop.• Implemented Data Interface to get data of clients utilizing Rest API and Pre-Process information utilizing MapReduce 2.0 and store into HDFS (Hortonworks). • Extracted documents from MySQL, Oracle, and Teradata… Show more • Involved in the abnormal state outline of the Hadoop 2.6.3 engineering for the current information structure and Problem articulation and setup another group and arranged the whole Hadoop stage.• Responsible for building scalable distributed data solutions using Hadoop.• Implemented Data Interface to get data of clients utilizing Rest API and Pre-Process information utilizing MapReduce 2.0 and store into HDFS (Hortonworks). • Extracted documents from MySQL, Oracle, and Teradata through Sqoop 1.4.6 and set in HDFS Cloudera Distribution and handled. • Worked with different HDFS document groups like Avro 1.7.6, Sequence File, Json and different pressure positions like Snappy, bzip2. • Developed effective MapReduce programs for sifting through the unstructured information and built up numerous MapReduce occupations to perform information cleaning and preprocessing on Cloudera. • Involved in changing over MapReduce employments into start changes in Spark RDD's utilizing Python. • Continuous checking and dealing with the Hadoop group utilizing Ambari. • Used Pig to perform information approval on the information ingested utilizing Sqoop and Flume and the washed down informational index is pushed into Hive. • Collecting and conglomerating a lot of log information utilizing Apache Spark and arranging information in HDFS for assist investigation. • Designed and constructed the Reporting Application, which utilizes the Spark SQL to get and create writes about HBase table information. • Developed custom Unix SHELL contents to do pre-post approvals of ace and slave hubs, when arranging the name hub and information hubs separately. • Developed information pipeline utilizing Kafka to ingest behavioral information, utilized Spark Streaming for information Show less

Saudi Arabia

• Imported information utilizing Sqoop to stack information from MySQL to HDFS on standard premise. • Involved in gathering and collecting a lot of log information utilizing Apache Flume and organizing information in HDFS for assist investigation. • Push information from Amazon S3 stockpiling to Redshift utilizing Key, Value combines as required by BI group. • Processed information utilizing Athena on S3 took a shot at door hubs and connectors (Jar records) interfacing sources with… Show more • Imported information utilizing Sqoop to stack information from MySQL to HDFS on standard premise. • Involved in gathering and collecting a lot of log information utilizing Apache Flume and organizing information in HDFS for assist investigation. • Push information from Amazon S3 stockpiling to Redshift utilizing Key, Value combines as required by BI group. • Processed information utilizing Athena on S3 took a shot at door hubs and connectors (Jar records) interfacing sources with AWS cloud. • Developed proficient MapReduce programs for sifting through the unstructured information and built up different MapReduce occupations to perform information cleaning and preprocessing on EMR. • Collected and amassed a lot of web log information from various sources, for example, webservers, portable and system gadgets utilizing Apache Kafka and put away the information into HDFS for investigation. • Developed various Kafka Producers and Consumers sans preparation actualizing according to association's necessities. • Setup Flume for various sources to convey the log messages from outside to Hadoop HDFS. • Responsible for making, changing themes (Kafka Queues) as and when required with differing setups including replication components, parcels and TTL. • Wrote and tried complex MapReduce occupations for totaling distinguished and approved information. • Created Managed and External Hive tables with static/dynamic partitioning. • Written Hive questions for information examination to meet the Business prerequisites. • Increased execution of the HiveQLs by part bigger questions into little and by presenting impermanent tables in the middle of them. • Extensively engaged with execution tuning of the HiveQL by performing bucketing on vast Hive tables • Used open source web scratching structure for python to slither and extricate information from site pages. Show less

Hyderabad, Telangana, India

• Developed Java web benefits as a major aspect of utilitarian necessities. • Installed and arranged Hadoop and in charge of keeping up bunch and overseeing and evaluating Hadoop log documents. • Supported in setting up QA condition and refreshing designs for executing contents with Pig and Sqoop. • Developed MapReduce programs in Java for Data Analysis and stacked information from different information sources into HDFS. • Worked widely on Cloudera to examine information… Show more • Developed Java web benefits as a major aspect of utilitarian necessities. • Installed and arranged Hadoop and in charge of keeping up bunch and overseeing and evaluating Hadoop log documents. • Supported in setting up QA condition and refreshing designs for executing contents with Pig and Sqoop. • Developed MapReduce programs in Java for Data Analysis and stacked information from different information sources into HDFS. • Worked widely on Cloudera to examine information introduce over HDFS utilizing Hive and Pig. • Created Pig Latin contents to sort, gathering, join and channel the endeavor astute information. • Worked on expansive arrangements of organized, semi-organized and unstructured information. • Use of Sqoop to import and fare information from Oracle RDBMS to HDFS and the other way around. • Involved in making Hive tables, stacking with information and composing hive questions which will run inside as MapReduce occupations.• Coordinated with business customers to gather business requirements. Show less

Master'S Degree, A+

Bachelor'S Degree, Computer Science

Master'S Degree, Masters In Information System