Deekshitha P Email & Phone Number

United States

Charlotte, North Carolina, United States

Bothell, Washington, United States

• Build data pipelines in airflow in GCP for ETL-related jobs using different airflow operators.
• Experienced in GCP Dataproc, GCS, Cloud functions, and Big Query.
• Worked on machine learning on large-size data using Spark and MapReduce.
• Worked on Teradata SQL queries, Teradata Indexes, and Utilities such as Mload, Tpump, Fast load, and Fast Export.
• Configured Spark streaming to receive real-time data from Kafka and store the stream data to HDFS.
• Involved in CI/CD deploy pipelines automating manual processes and optimizing data delivery.

Columbus, Ohio, United States

• Worked on Resetting of customer attributes that provide insight about the customer. Purchase frequency, marketing channel, Groupon deal categorization. Advocate different sources of data using SQL, HIVE, and SCALA.
• Normalized the data according to the business needs like data cleansing, modifying the data types, and various transformations using Spark, Scala, and GCP Dataproc.
• Implemented dynamic partitioning in big query tables and used appropriate file format, and compression techniques to improve the performance of Pyspark jobs in the DATAPROC.
• Developed PySpark code to mimic the transformations performed in the on-premises environment.
• Analyzed the SQL scripts and designed solutions to implement using PySpark.
• Worked on querying data using Spark SQL on the top of PySpark engine jobs to perform data cleansing, validation, and applied transformations and executed the program using Python API.

Eagan, Minnesota, United States

· Used Azure Data Factory extensively for ingesting data from disparate source systems.· Used Azure Data Factory as an orchestration tool for integrating data from upstream to downstream systems.· Automated jobs using different triggers (Event, Scheduled, and Tumbling) in ADF.· Used Cosmos DB for storing catalog data and for event sourcing in order.

Chicago, Illinois, United States

• Design and Develop ETL Processes in AWS Glue to migrate Campaign data from external sources likeS3, ORC/Parquet/Text Files into AWS Redshift.
• Developed PySpark job to load the CSV files into the S3 buckets and created AWS S3 buckets, performed folder management in each bucket, and managed logs and objects within each bucket.
• Involved in file movements between HDFS and AWS S3 and extensively worked with S3 buckets inAWS.
• Developed data warehouse model in Snowflake for over 100 datasets using Where Cape andCreated reports in Looker based on Snowflake Connections.
• Developed MapReduce programs in Python using Hadoop to parse the raw data, populate staging,tables, and store their fine data in partitioned HIVE tables.
• Developed PySpark job to load the CSV files into the S3 buckets and created AWS S3 buckets,performed folder management in each bucket, and managed logs and objects within each bucket.

Hyderabad, Telangana, India

• Creating mappings, sessions, and workflows to use with Informatica PowerCenter to load data for Ultima tix projects from source to target database.
• Creating Informatica positions for SCD Types 1, 2, and 3. Transferring the processes and mappings from development to QA, QA to production, and unit testing the procedure.
• Participated in the seamless migration of the mappings, sessions, workflows, and repositories from Informatica 9.0 to Informatica 9.6.
• Created the Informatica Mappings by leveraging the Aggregator, SQL overrides in Lookups, source qualifiers, and Router to govern data flow into different targets.
• Developed shell scripts to optimize the Informatica workflows' ETL flow.
• Created Sessions, gathered data from multiple sources, processed it as needed, and loaded it into the data warehouse.