Sr. Python Developer
Current● Developed and tested web applications in Python Django Framework's model view control (MVC) architecture.● Developed web applications leveraging Python and Django Framework, focusing on MVC architecture, resulting in enhanced scalability and maintainability, critical for agile software development.● Managed an Apache Spark cluster with regular expressions and lambda functions for big data operations, achieving a 20% increase in data processing speed, crucial for time-sensitive analytics.● Implemented Spark with Python and SparkSQL, reducing data processing and testing times by 15%, significantly streamlining the workflow and improving productivity.● Developed sophisticated data pipelines in Databricks using Apache Spark, focusing on optimizing data flow and processing. This approach enabled efficient handling of large-scale datasets, significantly enhancing the data analytics pipeline's throughput and performance.● Engineered and refined robust data pipeline architectures within the Databricks environment using Spark, greatly improving the reliability and efficiency of data ingestion and transformation processes. This advancement directly contributed to more streamlined and effective data analysis operation● Utilized Spark for interactive queries and streaming data processing, integrating efficiently with NoSQL databases, essential for handling large volumes of data with agility.● Enhanced data transaction accuracy by connecting Django Models to databases using Django’s ORM, ensuring robust and seamless data transactions.● Employed advanced Python features such as list/dictionary comprehension and generators for sophisticated data manipulation, enhancing data analysis capabilities.● Improved system security by 30% by enhancing SPA authentication using Angular HttpClient, JSON web tokens, and local browser storage, ensuring robust data protection.