Work with fast paced data analytic group to deliver QA and BI tools to enable team to analyze large structured and unstructured data sets. develop data pipelines and convert SAS programs and models to Python.

Designed, developed, coded and worked in penetration testing in customized DOL-AWS GovCloud Node.js Security Monitoring of VPC Zones using AWS - Lambda to load customized Spark-Scala GraphX ApplicationDeveloped Views and Templates with Python and using Django's view controller and template language for the Web application.Designed and Developed User Interface using front-end technologies like HTML, CSS, JavaScript, JQuery, AngularJS, Bootstrap and JSON.Designed, developed, coded, worked in penetration testing and implemented a concurrent - multi-parallel - event oriented-processing - AKKA Actor System and Actors; to consume Scala Spark-SQL Rules which aggregated data to produce Quality Performance Reports (QPR) on Fiscal projections against Apprentice and Intern Job data.Installed and configured Hadoop Mapreduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.Installed and configured Pig and also written PigLatin scripts.Extensively involved in Installation and configuration of Cloudera's distributionDeveloped User Interfaces using JSF (Primefaces), AngularJS, JavaScript, AJAX, jQuery and CSS.Hadoop, Namenode, Job Tracker, Task Trackers and Data NodesDesigned and led big data algorithms using Hadoop and Java to improve forecasting and used HiveQL to generate reports.Used Bootstrap and AngularJS for effective design of Web pagesDesigned business applications using web technologies like HTML, XHTML, and CSS based on the W3C standards.Fluid understanding of multiple programming languages, including C#, C, C++, JavaScript, HTML, and XML.

Collaborated with data engineers and operation team to implement ETL process, wrote and optimized SQL queries to perform data extraction to fit the analytical requirements.Performed data analysis by using Hive to retrieve the data from Hadoop cluster, SQL to retrieve data from RedShift.Explored and analyzed the customer specific features by using Spark SQL.Performed univariate and multivariate analysis on the data to identify any underlying pattern in the data and associations between the variables.Performed data imputation using Scikit-learn package in Python.Participated in features engineering such as feature intersection generating, feature normalize and label encoding with Scikit-learn preprocessing.Used Python 3.X (numpy, scipy, pandas, scikit-learn, seaborn) and Spark 2.0 (PySpark, MLlib) to develop variety of models and algorithms for analytic purposes.Developed and implemented predictive models using machine learning algorithms such as linear regression, classification, multivariate regression, Naive Bayes, Random Forests, K-means clustering, KNN, PCA and regularization for data analysis.Conducted analysis on assessing customer consuming behaviors and discover value of customers with RMF analysis; applied customer segmentation with clustering algorithms such as K-Means Clustering and Hierarchical Clustering.Built classification models include: Logistic Regression, SVM, Decision Tree, Random Forest to predict Customer Churn Rate.Used F-Score, AUC/ROC, Confusion Matrix, MAE, RMSE to evaluate different Model performance.Designed and implemented recommender systems which utilized Collaborative filtering techniques to recommend course for different customers and deployed to AWS EMR cluster.Utilized natural language processing (NLP) techniques to Optimized Customer Satisfaction.Designed rich data visualizations to model data into human-readable form with Tableau and Matplotlib.

Responsible for gathering requirements, system analysis, design, development, testing and deployment.Developed tools using Python, Shell scripting, XML to automate some of the menial tasks. Interfacing with supervisors, artists, systems administrators and production to ensure production deadlines are met.Developed Business Logic using Python on Django Web Framework.Designed and developed the UI of the website using HTML, AJAX, CSS and JavaScript.Designed and developed data management system using MySQL.Write scripts using python modules and its libraries to develop programs that improve processing of access requests.Utilized PyUnit, the Python Unit test framework, for all Python applications and used Django Database API's to access database objects.Used PyQuery for selecting particular DOM elements when parsing HTML.Designed and created backend data access modules using PL/SQL stored procedures and Oracle.Worked in an agile development environment.Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format.Designed object model, data model, tables, constraints, necessary stored procedures, functions, triggers, and packages for Oracle Database.Used Django configuration to manage URLs and application parameters.Used Wireshark, live http headers, and Fiddler debugging proxy to debug the Flash object and help the developer create a functional component.