• Responsible for understanding requirements from Business Requirement Document, system analysis, design, development, testing and deployment.• Utilized various frameworks, including Flask(2+), Django(4) and built micro service based client-server applications on-premises and successfully deployed in cloud environments. • contributed in building database Model, APIs and Views utilizing Python, to build an interactive web-based solution.• Collaborated in development of Python based Web Services using REST for sending and getting data from the external interface in the JSON format and perform analysis using Django and PostgreSQL.• Worked with View Sets in Django-REST framework for providing web services and consumed web services performing CRUD operations.

• Designed and implemented real-time monitoring dashboards for Kinesis streams using AWS Lambdas, resulting in timely identification and resolution of issues.• Worked on data warehouse design and data integration using Apache Spark and Python, resulting in optimized data processing and improved data accuracy.• Utilized Spark SQL API in PySpark to extract and load data, and performed SQL queries, enabling efficient data processing and analysis.• Developed end-to-end Spark applications using Scala to perform data cleansing, validation, transformation, and summarization activities, resulting in accurate and useful data for business insights.• Designed and developed Spark workflows using Scala for data pull from AWS S3 bucket and Snowflake, applying transformations on it, resulting in efficient data processing and analysis.• Developed Spark code in Python and SparkSQL environment for faster testing and processing of data, and loading the data into Spark RDD, resulting in improved processing times and more efficient use of memory.• Utilized Spark, Scala, and Python for querying and preparing big data sources, and wrote pre-processing queries in Python for internal Spark jobs, improving the efficiency of data processing and analysis.

• Developed and maintained BI dashboards using Tableau, providing insights to stakeholders, and enabling data-driven decision making.• Conducted statistical analysis and machine learning experiments to identify patterns and insights in large datasets, resulting in increased sales by 10%.• Designed and developed data models and ETL processes to support the integration of data from various sources into a centralized data warehouse using AWS Glue and Redshift.• Analyze and obtain analytical report of the driver performance using SQL and salesforce to resolve the customer complaints and suggesting improvements in the network.

Designed, developed, and maintained ETL mappings and workflows applying the business rules, creating Technical Design and Unit Test Case Documents.• Implemented data pipelines utilizing Data Frames and Spark SQL for faster processing of data.• Collected and aggregated large amounts of web log data from different sources such as webservers, mobile and networkdevices using Apache Flume and stored the data into HDFS for analysis.• Developed and maintained data models and dashboards using BI tools such as Tableau and Power BI, providing actionableinsights to stakeholders and enabling data-driven decision making.