Deepika K.

Deepika K. Email and Phone Number

Senior Data Engineer | Expert in GCP & Big Data | Data Pipeline Architect | ETL Specialist | Data Modeling & Visualization Pro @ Optum
eden prairie, minnesota, united states
Deepika K.'s Location
Tampa, Florida, United States, United States
About Deepika K.

Data engineering requires a blend of technical precision and adaptive problem-solving. It’s not simply a series of steps; instead, it’s a field driven by analyzing trends, learning from experience, and innovating to overcome data challenges.My journey began with a fascination for programming, first realized through building models that uncovered data patterns. This initial spark pushed me toward data engineering, where I specialize in working with vast datasets to generate actionable insights. Through experience, I’ve become skilled in managing data processes, from data ingestion and cleansing to comprehensive analysis and visualization.Key to my skill set is the ability to implement big data frameworks like Hadoop, Spark, and Dask to optimize data workflows. Additionally, I’ve honed cloud expertise across major platforms: AWS (Redshift, S3, Glue), Google Cloud Platform (BigQuery, Dataproc, Cloud Storage), and Azure (Data Lake, Synapse Analytics, Databricks), enabling me to build, scale, and secure data infrastructure in cloud environments.I’m also proficient in data warehousing and modeling, specializing in Star and Snowflake Schema design for scalable architectures. I use tools like Erwin Data Modeler, PowerDesigner, and Embarcadero ER/Studio to create logical, conceptual, and physical data models and build Entity-Relationship Diagrams (ERDs) that represent complex datasets. My experience includes extensive work on migrating SQL databases to Azure Data Lake, Azure SQL Database, and Databricks using Azure Data Factory to orchestrate smooth transitions.

Deepika K.'s Current Company Details
Optum

Optum

View
Senior Data Engineer | Expert in GCP & Big Data | Data Pipeline Architect | ETL Specialist | Data Modeling & Visualization Pro
eden prairie, minnesota, united states
Website:
optum.com
Employees:
25083
Deepika K. Work Experience Details
  • Optum
    Senior Data Analyst
    Optum Jan 2024 - Present
    I specialize in developing and maintaining ETL pipelines using PySpark, Scala, and Hive for processing large datasets in both batch and real-time environments. My expertise includes implementing CI/CD pipelines for AWS Data Catalog, conducting dimensional modeling, and designing data warehouses with Snowflake and Redshift. I optimize Spark jobs, build AWS infrastructure (EMR, EC2, S3), and design end-to-end data pipelines with Kafka, Apache Spark, and Hadoop. Additionally, I automate data migration with UNIX shell scripting, Python, and SQL, ensuring data integrity and consistency. Using Databricks and Tableau, I create secure, high-quality data visualizations and analytics. My skills extend to engineering data ingestion frameworks, tuning SAS processes and SQL queries, and managing Tableau administrative tasks. I develop custom scripts with AWS SDK and CLI, automate ETL processes with Talend, and monitor Kafka clusters. I also use Elasticsearch and Kibana for real-time log analysis. My experience includes designing data models, providing 24/7 database support, and developing Looker reports for informed decision-making.
  • Capital One
    Data Engineer
    Capital One Jun 2022 - Dec 2023
    Collaborated with Agile teams to design and implement data pipelines using Python, Scala, and PySpark. Utilized pandas and Jupyter Notebook for exploratory data analysis. Implemented scalable data processing with Java and Spark. Designed ETL workflows in Kylo and NIFI, and created data flow diagrams in MS Visio.Prepared technical documentation and developed PowerPoint presentations for stakeholders. Utilized SQL for data extraction and transformation, and advanced analytics with SAS. Managed workflows with SharePoint and MS Project, and conducted data profiling for accuracy.Implemented data governance and automated processing with Python and shell scripting. Tuned SQL queries, integrated external data sources, and mentored team members. Designed data warehouses with dimensional modeling and ensured data security.Developed Tableau dashboards for insights, conducted root cause analysis, and recommended new technologies. Conducted user training sessions and supported continuous improvement in data engineering processes.
  • One Medical
    Data Engineer
    One Medical Dec 2020 - May 2022
    Developed Python and Shell scripts to automate tasks, enhancing efficiency. Designed AWS S3 security framework using Lambda and DynamoDB. Integrated Apache Airflow with AWS services for ML workflows.Created Python web services for data exchange using SOAP. Utilized Spark and Scala for ML algorithms on clickstream data. Implemented CI/CD pipelines with Jenkins and Airflow.Collaborated with teams to validate data mappings. Executed SQL queries and transformed them into ETL tasks. Supported AWS cloud architectures and engineered task scheduling on EC2.Designed Python-based modeling APIs for customer analytics. Implemented Star and Snowflake schema data models. Conducted data analysis using Databricks and Spark.Used Databricks notebooks for data analysis. Leveraged metadata tools for governance. Used Spark and HBase for data storage. Developed dashboard features with Python and JavaScript.Implemented a CI system with Git, Jenkins, and MySQL. Managed datasets with PySpark and Pandas. Wrote Python scripts for ETL and data quality checks. Created interactive charts with Highcharts and conducted data profiling. Optimized SQL queries and resolved data issues in data warehouses.
  • Dev It Solutions Pvt. Ltd.
    Data Engineer
    Dev It Solutions Pvt. Ltd. Sep 2018 - Jun 2020
    I developed and optimized SQL queries using Rapid SQL for efficient data retrieval and organized large datasets for analysis and reporting, ensuring data integrity. Utilizing Python and Spark, I handled data processing, ETL tasks, and real-time data streaming. My role included conducting data profiling to assess data quality and patterns, programming in MVS Assembler for low-level data manipulation, and creating detailed data flow diagrams and process models with MS Visio. Additionally, I managed project timelines and resources using MS Project, prepared comprehensive documentation and reports in MS Office, and provided data-driven insights and visualizations with Python.I collaborated with cross-functional teams to define data requirements, business rules, and data governance standards, while automating repetitive tasks and workflows with Unix shell scripting. I worked closely with data architects to design and implement scalable data solutions, ensuring data accuracy through rigorous validation checks. My experience also includes creating interactive dashboards with Tableau for business intelligence reporting and conducting performance tuning of ETL processes to improve data loading and querying efficiency.
  • Mindteck
    Data Engineer
    Mindteck Jul 2016 - Aug 2018
    Developed ETL workflows in Informatica PowerCenter for data extraction, transformation, and loading from various sources, while configuring and managing PowerExchange for real-time data integration and change data capture. Utilized Teradata for data warehousing and performance-tuned complex SQL queries. Created detailed process flow diagrams and data models using Visio, and extracted, transformed, and loaded data from Oracle and flat files into the data warehouse. Scheduled and monitored ETL jobs using AutoSys, wrote Unix shell scripts to automate ETL processes, and collaborated with business users to define data requirements, ensuring data accuracy and consistency. Performed data validation and quality checks, optimized Informatica workflows, and implemented data integration solutions to consolidate disparate data sources. Monitored and resolved data and ETL issues, designed logical and physical data models, developed data migration strategies, and provided technical support on Informatica, Teradata, and Unix. Created comprehensive documentation, conducted root cause analysis, automated data tasks, and ensured compliance with data governance and security policies throughout the data lifecycle.

Deepika K. Education Details

Frequently Asked Questions about Deepika K.

What company does Deepika K. work for?

Deepika K. works for Optum

What is Deepika K.'s role at the current company?

Deepika K.'s current role is Senior Data Engineer | Expert in GCP & Big Data | Data Pipeline Architect | ETL Specialist | Data Modeling & Visualization Pro.

What schools did Deepika K. attend?

Deepika K. attended St. Martin's Engineering College.

Who are Deepika K.'s colleagues?

Deepika K.'s colleagues are Mona Antony, Kiruthika Pachaiappan, Kate Goldberg, Ba, Bsn, Rn, Gajanan Vyavhare, Sandy Knudson, Joe Morrison, Garima Purang.

Not the Deepika K. you were looking for?

  • Deepika K

    Cloud Devops Engineer At Carbon Five | A West Monroe Company
    Fuquay-Varina, Nc
  • Deepika K

    Data Analysis, Quality Engineering, Product Manager
    United States
  • Deepika K.

    Full Stack Developer | It Analyst | Software Engineer | Front End Developer | Graduate Student
    United States
  • deepika k

    6+ Years Of Experience ||Certified Salesforce Developer||B2B Commerce Cloud||Sales Cloud
    Largo, Fl
  • Deepika K

    Looking For Full Stack Java Developer | Ui Engineer
    United States

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.