• Worked on building PySpark algorithms for different aggregations of data based on the specifications. • Involved with performance and process enhancement of the PySpark framework.• Developed integration checks around the PySpark framework for Processing of large datasets. • Worked on migration of PySpark framework into AWS Glue for enhanced processing. • Wrote various automation scripts for automation of data processing on AWS Glue.• Developed data warehouse model in snowflake for over 100 datasets using whereScape.• Worked on Scripting CloudFormation Templates to auto provisioning of resources. • Worked of various Quality control checks for data processing using Spark SQL. • Build a data processing algorithm for incremental processing of data that’s aggregated each week.• Wrote ETL jobs to read from web APIs using REST and HTTP calls and loaded into HDFS using java and Talend.• Worked on data transformation like cleaning, partitioning of data for enhanced processing of data. • Worked on setting up of SEE5 data mining server on AWS for pattern finding in the data• Implemented Change Data Capture technology in Talend in order to load deltas to a Data Warehouse.• Created and maintained reports and dashboards to provide fast access to key business metrics.• Enhanced apex class and Visualforce page to create a custom related list, showing activities for selected contacts or clients.• Wrote an apex trigger on contact for cross object field update for reporting purposes.• Involved with migration of AI based project from Google Cloud Platform into AWS.• Build Schedule based AWS Lambdas, SageMaker for MLOps for automatic model build and run of data processing pipelines • Worked on building a standalone UI tool using wxPython for creating custom requirement JSON templets to feed into AWS Glue for ETL processing of data. • Worked on setting of automated loading of data into SQL database using AWS Glue and Step Functions.

• Wrote Python routines to log into the websites and fetch data for selected options. Used other packages such as beautiful soup for data parsing.• Worked on writing and as well as read data from csv and excel file formats.Developed a MATLAB algorithm which determines an object's dimensions from digital images.• Proficient in performance analysis, monitoring and SQL query tuning using EXPLAIN PLAN, Collect Statistics, Hints and SQL Trace both in Teradata as well as Oracle.• Evaluate Snowflake Design considerations for any change in the application• Worked on client's CPQ project, salesforce integration with CPQ application.• Developed various custom objects, tabs, components and visual force pages.• Hands on experience using query tools like TOAD, SQL Developer, PLSQL developer, Teradata SQL Assistant and Query man.Web-services backend development using Python (CherryPy, Django, SQLAlchemy).• Designed and configured database and backend applications and programs.

• Worked on predictive analytics use-cases using R language.• Use Python unit and functional testing modules such as unit test, unittest2, mock, and custom frameworks in-line with Agile Software Development methodologies.• Added licensing feature for 3 products CVU'S, CCLEAR, CSTOR from scratch by going through most modules of code runs at backend and created html pages to view the EULA (End User License Agreement).• Developed micro services API'S for an individual module and exposed the results in JSON format using Bottle framework.• Evaluated, installed and administered 3rd party apps and provide first-tier-support.• Responsible for developing and customizing Salesforce applications using Apex, Visualforce, JavaScript, SQL, SOAP and REST Web Services• Involved in development of testing frameworks, used selenium web driver for Automation.• Worked with Docker Container, have setup an environment and used accordingly.• Wrote Python code embedded with JSON and XML to produce HTTP GET and POST requests for parsing HTML data from website.• Used JIRA for issue tracking and bug tracking for each individual sprint and used confluence to create design documents.• Installed Hadoop, Map Reduce, HDFS, and AWS and developed multiple MapReduce jobs in PIG and Hive for data cleaning and pre-processing.• Manage datasets using Panda data frames and MySQL, queried MYSQL database queries from python using Python-MySQL connector and MySQL dB package to retrieve information.

• Involved in preparing engineering specification with OOA and OOD. • Used Rational Rose Enterprise to develop Use Case diagrams, Class diagrams, Collaboration and Sequence Diagrams, State Diagrams, Data Modeling. • Developed application logic using Python, Jython, Java script. • Used JMS for updating Mailing plans and tracking them. Implemented front end for third party Web service using JQuery, Html, AJAX, JSON and JavaScript.• Used Java Server Pages for content layout and presentation with Python.• Developed the frontend for interaction by using the Django framework. Created Data layer in MYSQL. Extracted and loaded data using Python scripts and PL/SQL packages. • Supported Java application for Media portal management.• Associated with development of Web Services using SOAP for sending and getting data from the external interface in the XML format.• Involved in preparing technical design document.• Used Connect SOAP rule to fetch the Webservices.• Used SOAP UI to test the external service.• Used JIRA for project tacking.• Involved in testing the application.• Environment: Java, Python 2.6, Django, CVS, JavaScript, HTML/CSS, MYSQL, PL/SQL, JDBC, Unix Shell Scripting, Red Hat Linux, WebLogic Application Server.

• Wrote Python routines to log into the websites and fetch data for selected options.• Implemented code in Python to retrieve and manipulate data.• Used Python modules such as requests, urllib, and urllib2 for web crawling.• Used other packages such as Beautiful soup for data parsing.• Worked on writing and as well as read data from CSV and excel file formats using Python.• Web-services backend development using Python (CherryPy, Django, SQLAlchemy).• Worked on resulting reports of the application and Tableau reports.• Participated in developing the company's internal framework on Python. This framework became a basement for the quick service's development.• Worked on HTML5, CSS3, JavaScript, AngularJS, Node.JS, Git, REST API, and MongoDB.• Design and setting up of the environment of MongoDB with shards and replica sets (Dev/Test and productions).• Designed and developed components using Python with Django framework.• Private VPN using Ubuntu, Python, Django, CherryPy, Bootstrap, jQuery.• Created a Python-based GUI application for Freight Tracking and processing.• Experience in designing and developing applications in Spark using Scala.• Wrote scripts in Python for extracting data from HTML files.• Used Python and Django creating graphics, XML processing of documents, data exchange and business logic implementation between servers.