Python Developer
Current• Responsible for gathering requirements, system analysis, design, development, testing and deployment.• Rewrite existing Java application in Python module to deliver certain format of data.• Developed Python batch processors to consume and produce various feeds.• Developed complex web, middleware, and back end systems in Python, SQL for Linux and Windows.• Developed entire frontend and backend modules using Python on Django Web Framework.• Developed Business Logic using Python on Django Web Framework.• Worked on developing internal testing tools which were written in Python. Generated Python Django Forms to record data of online users.• Wrote Python routines to log into the websites and fetch data for selected options.• Created custom user with overriding key field and adding more fields other than that provided by the Django out-of-box features.• Created a Django dashboard with custom look and feel for end user after a careful study of the Django admin site and dashboard.• Experience in working with AWS features cloudwatch, Route53 , lambda , apigateway, SNS topics and have knowedge on Cloud Front, cloud foundary• Experience designing and developing cloud ELT and date pipeline with various technologies such as Python, Spark, PySpark, SparkSQL, Airflow, Talend, Matillion, DBT, and/or Fivetran• Ability to design, build and unit test applications on Spark framework on Python.• Implemented data pipelines using Apache Spark on Databricks to automate ETL processes, improving data accuracy and reducing processing time by 40%.• Written python module to view and connect to AWS S3 instance.• Constructed product-usage data aggregations using Py-Spark, Spark SQL and maintained in AWS S3 location for reporting, data science dash boarding and ad-hoc analyses.• Architected and implemented a robust data analytics platform using Databricks, enabling real-time processing and analysis of large datasets.