Sr Full Stack Python Developer
Current• Developed Pyspark scripts from source system like Azure Event Hub to ingest data in reload, append, and merge mode into Delta tables in Databricks.• Built the front-end dashboard with Angular 8 using Rest API calls and microservices.• Worked on the REST/Web API to create the services and tested on postman and used HTTP service calls and bind the data in the table.• Interacted with End users and gathered requirements for designing and developing common architecture for storing data within Enterprise and Building Data Lake in Azure cloud.• Responsible for implementing monitoring solutions in Ansible, Terraform, Docker, and Jenkins.• Experience as Application Developer and coding with analytical programming using Python, PySpark, Django, Flask, AWS, GCP, SQL• Used Groovy and Grails with spring, Java, J2EE for user interface.• Managing existing infrastructure and created new infrastructure using Ansible as Configuration Management Tool.• Having experience in performance tuning, dashboards and tableau reports.• Involved in developing user interactive web pages as the front-end part of the web application using various web technologies like HTML, JavaScript, Angular 8, jQuery, AJAX and implemented CSS for better appearance and feel.• Created a Python/Django based web application using Python scripting for data processing, PostgreSQL• for the database, and HTML/CSS/jQuery and AM Charts for data visualization of the served pages.• Knowledge on integrating different eco-systems like Kafka – Spark.• Developed Microservices by creating REST APIs and used them to access data from different suppliers and to gather network traffic data from servers.• Developed spark applications for data extractions, transformation and aggregation from multiple systems and stored in Azure data lake storage using Azure databricks notebooks.• Involved in development of Web Services using REST for sending and getting data from the external interface in the JSON format.