Full Stack Python Developer At Fannie Mae
CurrentDeveloped Python based API (RESTful Web Service) to track the events and perform analysis using Django. Collaborated Flask and pandas to monitor, migrate and develop table database and work with large data set filesCreated a Python/Django based web application using Python scripting for data processing, MySQL for the database, and HTML/CSS/jQuery and High Charts for data visualization of the served pages.Designed Cassandra schema for the APIs and Parsed XML file using Python to extract data from database. Worked on Python Open stack API's and used NoSQL as database and followed Python test-driven development techniques.Involved in converting Hive/SQL queries into Spark transformations using Spark RDD and Pyspark concepts. Encoded and decoded json objects using PySpark to create and modify the data frames in Apache Spark.Implemented or exposing the Micro services to base on RESTful API utilizing Spring Boot with Spring MVC and Apache Kafka. Developed Rest API's with python with Django framework, mongo DB for front end team. Managed code versioning with GitHub, Bit Bucket and deployment to staging and production servers. Also Created Git repository and added to GitHub project. Support an Agile CI/CD Environment with DevOps where we make the Atlassian tools (Jira and Bitbucket) and provide layer 3 support on these tools if there are any issuesDesigned DynamoDB pipeline for routing/storing of email bounce handling records. Used Pandas API to put the data as time series and tabular format for local timestamp data manipulation and retrieval and storing it into MongoDB.Worked on Amazon Web Services (AWS), Open stack, Docker Puppet, Chef, Ansible, AWS Cloud Formation, AWS Cloud Front Built web-services using SOAP that allowed integrating the business application with the legacy applications and facilitates for future applications. Also, setup Hadoop cluster on Amazon EC2 using whirr for POC.