Senior Full Stack Python Developer
CurrentDeveloped consumer-based features and applications using Python, Django, pyramid, Flask, Web2py, HTML and other web technologies. Designed, developed and integrated a PostgreSQL database of ontological information with a proprietary Scala- based NLP pipeline. Enabled AWS Data Migration services to fetch the data from Source systems viz Oracle to copy the records which are either inserted or updated on the fly to S3 bucket. Built reusable and customizable components for the new website using React.JS and React-Routes to create a single page web application. Worked on Django REST framework as it is much faster to read data and it can be cached. REST allows more formats than SOAP and gives better support for browser clients as it supports JSON. Also, Created templates for page rendering and Django views for the business logic. Enabled to trigger Lambda Services on top of S3 bucket whenever the file drops from DMS. This Lambda would update the record count in Dynamo DB to have a count of number of files dropped in every group. Designed and developed web crawler in python using Scrappy framework and using RabbitMQ as a messaging server between the micro services. Automated Testing Framework has been built to comply with CI/CD pipeline using Nose Test and PyTest also implemented CI/CD pipeline using Jenkins, Ansible Playbooks and Ansible Tower. Created an on premise CI/CD solution using Jenkins and the Pipeline plugin which uses pipeline as code. Developed a POC using Attunity for fetching files directly from Source Oracle system to Snowflake directly, but which involved a large licensing cost and processing charges. Used Elastic Container Service and Elastic Kubernetes service as part of Jenkins Job to enable any code changes in repository get reflected to services involved. Developed Cloud Formation scripts to create DMS tasks which involves to setup several variables and connections in the Airflow console.