Megha P Email & Phone Number

Cambridge, Ma, Us

• Automate different workflows, which are initiated manually with Python scripts and Linux shell scripting.• Use Python unit and functional testing modules such as unit test, unittest2, mock, and custom frameworks in-line with Agile Software Development methodologies.• Develop Sqoop scripts to handle change data capture for processing incremental records between new arrived and existing data in RDBMS tables.• Installed Hadoop, Map Reduce, HDFS, AWS and developed multiple MapReduce jobs in PIG and Hive for data cleaning and pre-processing.• File ingestion and retrieval to and from Amazon S3 storage, LFS into Spark RDD.• Used Spark-Streaming APIs to perform necessary transformations and actions on retrieved data.• Using Pandas, csv, Zip file, boto3, Elasticsearch, requests etc. libraries for data manipulation. • Configured schemas and tables in AWS Redshift. Stored and retrieved data from Redshift database. • Implemented Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data.• Used Pandas as API to put the data as time series and tabular format for manipulation and retrieval of data.• Experience in python, Jupiter, Scientific computing stack (NumPy, SciPy, pandas and matplotlib).• Manage datasets using Panda data frames and MySQL, queried MYSQL database queries from python using Python-MySQL connector and MySQL dB package to retrieve information.• Involved in the Web/Application development using Python 3.5, HTML5, CSS3, AJAX, JSON and jQuery.• Implemented and modified various SQL queries and Functions, Cursors and Triggers as per the client requirements.• Perform troubleshooting, fixed, and deployed many Python bug fixes of the two main applications in Linux that were a main source of data for both customers and internal customer service team.• Generating various capacity planning reports (graphical) using Python packages like NumPy, matplotlib.

Ann Arbor, Mi, Us

• Worked in comprehending and examining the client's business requirements.• Used Django frameworks and Python to build dynamic webpages.• Developed media asset management applications using Python, JavaScript, XML, XSLT, MariaDB, Oracle, AWS, and Linux. • Used data structures like directories, tuples, object-oriented class-based inheritance features for making complex algorithms of networks.• Implemented a CI/CD deployment workflow using Jenkins to deploy code seamlessly and continuously into QA and Production environments.• Recorded the online users' data using Python Django forms and implemented test case using Pytest.• Involved in designing database Model, API's, Views using python to build an interactive web-based solution.• Improved the Data Security and generated report efficiently by caching and reusing data.• Configured Dev, QA, and Production environments with proper packages and dependencies and worked closely with DevOps and QA team to ensure that deployments into each system went smoothly.• Analyzed SQL scripts and designed the solution to implement using Pyspark. • Created PHP/MySQL backend for data entry from Flash and worked in tandem with the Flash developer to obtain the correct data through query string• Developed APIs in AWS, which supported multiple production applications using API Gateway, Lambda, IAM, S3/Cloudian, CloudFormation, and Serverless-based cloud infrastructure.• Configured Dev, QA, and Production environments with proper packages and dependencies and worked closely with DevOps and QA team to ensure that deployments into each system went smoothly.• Developed the application using the Test-Driven methodology and designed the unit tests using Python Unit test framework.• Deployed the project into Heroku using GIT version control system.

Atlanta, Ga, Us

• Designed and developed the server module and resolved issues and responsible for its enhancements.• Expanded website functionality, using Flask framework in Python to control web application logic.• Developer Numeric Python for source module of Python which provides fast mathematical computation on arrays and matrices.• Built automation script using Confidential API and Python BeatifulSoup to scrape data from social network and other websites using Python.• Designed front end and backend of the application using Python on Django Web Framework.• Used HTML, CSS, AJAX, JSON designed and developed the user interface of the website.• Developed views and templates with Django to create a user-friendly website interface.• Develop consumer-based features using Django, HTML and Test-Driven Development (TDD).• Developed Python web services for processing JSON and interfacing with the Data layer.• Exchanged data with SQL database and NoSQL database such as MongoDB• Conducted Big Data analytics using Hadoop MapReduce to extract KPI’s.• Deeply involved in writing complex Spark-Scala scripts, Spark context, Cassandra SQL context, used multiple API's, methods which support data frames, RDD's, Cassandra table joins and finally write/save the data frames/RDD's to Cassandra database.• Increased the speed of pre-existing search indexes through Django ORM optimizations.

• Used standard Python modules e.g., CSV, Robot parser, Iter tools, Pickle, Jinja2, Xml for development.• Managed, developed, and designed a dashboard control panel for customers and Administrators using Django, HTML, CSS, JavaScript, Bootstrap, jQuery and RESTAPI calls.• Query and set up employee registration and login using Python PostgreSQL• Experience for handling documented database and video file for online management system during creating online learning management solutions.• Automated RabbitMQ cluster installations and configuration using Python/Bash.• Used Pandas API to put the data as time series and tabular format for data manipulation and retrieval.• Fetched twitter feeds for certain important keyword using Python-twitter library.• Used Python library BeautifulSoup for web scrapping to extract data for building graphs.• Performed troubleshooting, fixed, and deployed many Pythons bug fixes for Learning Management System• Used Python core API using Flask framework to build modular & maintainable applications.• Involved in splitting, validating, and processing of flat files using Python scripts.• Used UNIX/LINUX server and Shell Scripts for application deployment and configuration.• Provided technical assistance for maintenance, integration and testing of software solutions during development and release processes.• Created unit test/regression test framework for working/new code.