Deepthi N Email & Phone Number

United States

Louisville, Kentucky, United States

• Design and develop ETL processes in AWS Glue to migrate payments data from external sources like S3, Parquet/Text files into AWS Redshift.
• Implemented DBT (Data Build Tool) in an AWS environment to streamline and automate data transformation processes, enabling efficient and scalable data pipeline management for analytics and reporting.
• Created End-End Automation with CI Procedures using Jenkins & automated Maven builds by integrating them with Continuous Integration tools Jenkins
• Extract Transform and Load data from Sources Systems to AWS Storage services using a combination of AWS Glue, Apache MiFi.
• Implemented end-to-end data ingestion, enrichment, and accessibility solution on AWS, utilizing services such as AWS Glue, AWS Lambda, Amazon Redshift
• Designed and developed data ingestion pipelines using Snowflake's features, including bulk loading and streaming, to seamlessly integrate data from various sources into the Snowflake platform.

Libertyville, Illinois, United States

• Involved in the project life cycle including design, development and implementation and verification and validation
• Extensively utilized Python frameworks like Django, Flask, PyUnit, and libraries like matplotlib.
• Gathered design requirements from the client, analyzed, and provided solutions and met design requirements.
• Updated and manipulated content and files by using python scripts.
• Created logic using Python programming language to node, functions and pipelines to retrieve and manipulate data.
• Implemented Pandas, Pandas Data Frame query, NumPy Python libraries, performed complex table joins, extractions and transformation of financial data retrieved from NetSuite and migrated to SAP.

Cincinnati, Ohio, United States

• Used Pandas API to put the data as time series and tabular format for east timestamp data manipulation and retrieval.
• Worked on Data mapping, logical data modeling, created class diagrams and ER diagrams and used SQL queries to filter data within the Oracle database.
• Created a user review data classification pipeline using Apache Spark and Apache Airflow.
• Created a data extraction pipeline for migrating user review data from PostgreSQL dB to AWS Redshift.
• Deployed AWS Lambda functions to ingest user purchase data on a daily basis and stage it in S3.
• Designed a REST API backend using Django to provide access to marketplace trends dataset, this was used by product management team.

Portland, Oregon, United States

• Analyzed pre-existing predictive model developed by advanced analytics team and factors considered during model development.
• Analyzed metadata and processed data to get better insights of the data.
• Analyze and prepare data, identify the patterns on dataset by applying historical models.
• Designed and developed data management system using MySQL.
• Built application logic using Python.
• Angular.js is used to build efficient backend for client web application.

Boston, Massachusetts, United States

• Writing Python scripts to parse XML documents as well as JSON based REST Web services and load the data in database.
• data and for building the pipeline.
• Experienced in the conversion of unstructured data in the format of CSV, and JSON into structured data in parquet form and saved in AWS s3 buckets.
• Experienced in the creation of Data zones that included AWS Glue databases and AWS Glue catalog that help in giving easy access to business and Tableau connection setup.
• Performed SQL optimization for the creation of AWS Views in Glue DB.
• Writing ORM’s for generating complex SQL queries and building reusable code and libraries in Python for future use.