Deepthi Bobbili Email & Phone Number

United States

Los Angeles, Ca, Us

• Developing a Marketing Cloud Service on Amazon AWS. Developed serverless application using AWS Lambda, S3, Redshift, EMR and RDS. • Using Atom for coding, Postman and SQL Workbench for testing and debugging and PyCharm for developing and Cloud Formation authoring.• Involved in building database Models and Views utilizing Python, to build an interactive web based solution.• Collaborated with other developers to handle complicated issues related with deployment of Django based applications.• Handled development and management of front end user interfaces with help of HTML, CSS, JQuery and JavaScript.• Modify the existing Python/Django modules to deliver certain format of data and adding new features. • Automated a reporting process, using Python, Luigi (library for task workflow and dependencies), and other API’s.• Written python scripts using python libraries such as pandas, numpy that does read/write operations on large CSV files, perform data aggregations and compare data by columns.• Experience in integrating Python REST API Frame work using Django.• Working experience of Data Warehouse ETL /design and implementation of complex big data pipelines.• Used Python, PySpark, shell script, oracle scheduler, Luigi, Oracle Pl SQL etc.

Atlanta, Georgia, Us

• Developed data pipeline using Spark, Hive and HBase to ingest customer behavioral data and financial histories into Hadoop cluster for analysis.• Working Experience on Azure Databricks cloud to organize the data into notebooks and make it easy to visualize data using dashboards.• Performed ETL on data from different source systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, and Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure Synapse) and processing the data in In Azure Databricks.• Worked on managing the Spark Databricks by proper troubleshooting, estimation, and monitoring of the clusters.• Performed Data Aggregation, Validation, and Azure HD Insight using spark scripts written in Python.• Implemented Azure Stream Analytics for processing the real-time Geo-Spatial data for location-based targeted sales campaigns.

Wawa, Pa, Us

• Defined virtual warehouse sizing for Snowflake for different type of workloads.• Integrated and automated data workloads to Snowflake Warehouse.• Created tables in snowflake DB, loading and analyzing data using Spark-Scala scripts.• Developed ETL pipelines in and out of data warehouse using combination of Python and Snowflake’s Snow SQL.• Written POCs in Python to analyze the data quickly before applying big data solutions to process at a scale.• Responsible for data governance rules and standards to maintain the consistency of the business element names in the different data layers.• Build Data Warehouse in Azure platform using Azure data bricks and data factory.• Developed data pipeline using Sqoop to ingest cargo data and customer histories into HDFS for analysis.• Designed ETL using Internal/External tables and store in parquet format for efficiency.• Involved in porting the existing on-premises Hive code migration to GCP (Google Cloud Platform) BigQuery.•Involved in migration an Oracle SQL ETL to run on Google cloud platform using cloud Dataproc & BigQuery, cloud pub/sub for triggering the Apache Airflow jobs.

Hyderabad, Telengana, In

• Worked as Data Engineer to review business requirement and compose source to target data mapping documents. • Conducted technical orientation sessions using documentation and training materials.• Gathered the business requirements from the Business Partners and Subject Matter Experts.• Served as technical expert guiding choices to implement analytical and reporting solutions for client.• Worked closely with the business, other architecture team members and global project teams to understand, document and design data warehouse processes and needs.• Implemented Installation and configuration of multi-node cluster on Cloud using Amazon Web Services (AWS) on EC2. • Developed reconciliation process to make sure elastic search index document count match to source records.• Maintained Tableau functional reports based on user requirements.• Created action filters, parameters, and calculated sets for preparing dashboards and worksheets in Tableau.• Used Agile (SCRUM) methodologies for Software Development.• Developed data pipelines to consume data from Enterprise Data Lake (MapR Hadoop distribution - Hive tables/HDFS) for analytics solution.

Hyderabad, Telangana, In

• Responsible and involved in the start to end process of Hadoop cluster installation, configuration and monitoring.• Responsible for building scalable distributed data solutions using Hadoop. • Performed performance tuning and troubleshooting of Map Reduce jobs by analyzing and reviewing Hadoop log files.• Developed several custom User defined functions in Hive & Pig using Java.• Installed and configured Hadoop Map reduce, HDFS, Cassandra and developed multiple Map Reduce jobs in java for data cleaning and preprocessing.• Work with hive complex data types and involved in Bucketing.• Import millions of structured data from relational databases using Sqoop import to process using Spark and stored the data into HDFS in CSV format.

Dubai, Ae

• Effectively led client projects. These projects contained heavy Python, SQL, Tableau and data modeling.• Performed data merging, cleaning, and quality control procedures by programming data object rules into a database management system.• Created detailed reports for management.• Reported daily on returned survey data and thoroughly communicated survey progress statistics, data issues, and their resolution.• Involved in Data analysis and quality check.• Extracted data from source files, transformed and loaded to generate CSV data files with Python programming and SQL queries.• Stored and retrieved data from data warehouses.• Created the source-to-target mapping spreadsheet detailing the source, target data structure and transformation rule around it.• Wrote Python scripts to parse files and load the data in the database, used Python to extract weekly information from the files, and Developed Python scripts to clean the raw data.

Computers

Master'S Degree, Computer Science