Senior Python Developer
Current• Automate different workflows, which are initiated manually with Python scripts and Unix shell scripting.• Create, activate and program in Anaconda environment.• Use Python unit and functional testing modules such as unit test, unittest2, mock, and custom frameworks in-line with Agile Software Development methodologies.• Conducted statistical analysis on Healthcare data using python and various tools.• Develop Sqoop scripts to handle change data capture for processing incremental records between new arrived and existing data in RDBMS tables.• Installed Hadoop, Map Reduce, HDFS, AWS and developed multiple MapReduce jobs in PIG and Hive for data cleaning and pre-processing.• Manage datasets using Panda data frames and MySQL, queried MYSQL database queries from python using Python-MySQL connector and MySQL dB package to retrieve information.