S Deepthi Email & Phone Number

Des Moines, Iowa, United States

Developing new data streaming patterns leveraging an enterprise platform to support system to system data exchange. Formulates and defines the system scope and objectives for the assigned projects. Prepares detailed specifications to write programs. Designs, codes, tests, debugs, documents, and maintains those programs. Has good understanding of business.

Philadelphia, Pennsylvania, United States

St Louis, Missouri, United States

• Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats.
• Authoring Python (PySpark) Scripts for custom UDF’s for Row/ Column manipulations, merges, aggregations, stacking, data labeling and for all Cleaning and conforming tasks. Migrate data from on-premises to AWS storage.
• Developed frameworks and processes to analyze unstructured information. Assisted in Azure Power BI architecture design.
• Created a Python process hosted on Elastic Beanstalk to load the Redshift database daily from several source.
• Developed SQL scripts to Upload, Retrieve, Manipulate and handle sensitive data (National Provider Identifier Data I.e. Name, Address, SSN, Phone No) in Teradata, SQL Server Management Studio and Snowflake Databases.
• Experienced in running query using Impala and used BI tools to run ad-hoc queries directly on Hadoop.

Englewood, Colorado, United States

• Expertise in using Docker to run and deploy the applications in multiple containers like Docker Swarm and Docker Wave.
• Developed complex Talend ETL jobs to migrate the data from flat files to database. Pulled files from mainframe into Talend execution server using multiple ftp components.
• Developed complex Talend ETL jobs to migrate the data from flat files to database. Developed Talend ESB services and deployed them on ESB servers on different instances.
• Architect and design server less application CI/CD by using AWS Server less (Lambda) application model.
• Developed stored procedures/views in Snowfpyth authoring, scheduling and monitoring Data Pipelines
• Designed several DAGs (Directed Acyclic Graph) for automating ETL pipelines

St. Louis City County, Missouri, United States

• Migrating data from FS to Snowflake within the organization
• Created consumption views on top of metrics to reduce the running time for complex queries.
• Exported Data into Snowflake by creating Staging Tables to load Data of different files from Amazon S3.
• Compare the data in a leaf level process from various databases when data transformation or data loading takes place. I need to analyze and look into the data quality when these types of loads are done (To look for any.
• As a part of Data Migration, wrote many SQL Scripts for Mismatch of data and worked on loading the history data from Teradata SQL to snowflake.
• Created Metric tables, End user views in Snowflake to feed data for Tableau refresh.

Hyderabad, Telangana, India

• Developed and Configured Kafka brokers to pipeline server logs data into Spark streaming.
• Defined job work flows as per their dependencies in Oozie.
• Successfully Generated consumer group lags from Kafka using their API
• Deployed an Apache Solr/Lucene search engine server to help speed up the search of financial documents.
• Wrote queries Using DataStax Cassandra CQL to create, alter, insert and delete elements.
• Written the Map Reduce programs, Hive UDFs in Java.

Hyderabad, Telangana, India

• The custom File System plugin allows Hadoop MapReduce programs, HBase, Pig and Hive to work unmodified and access files directly.
• Performed and automated SQL Server version upgrades, patch installs and maintained relational databases.
• Developed complex parameterized reports which were used for making current and future business decisions.
• Analyzed requirement and impact by participating in Joint Application Development sessions with business client online.
• Created HBase tables and used HBase sinks and loaded data into them to perform analytics using Tableau.
• Used Spark-SQL to Load JSON data and create Schema RDD and loaded it into Hive Tables and handled structured data using Spark SQL.