Deepika P Email & Phone Number

Philadelphia, Pennsylvania, United States

As a Senior Big Data Engineer at The Bridge Corp in Philadelphia, I have been instrumental in enhancing data processing capabilities and streamlining ETL processes since February 2022. My role involves developing and deploying complex data solutions in a dynamic AWS environment. I specialize in leveraging Spark, Scala, and Python to build efficient big data applications, ensuring optimal data flow between diverse databases like AWS Redshift, Oracle, MongoDB, and SQL Server. My expertise extends to real-time data streaming, machine learning applications, and large-scale data infrastructure management. My approach combines innovative big data technologies and traditional SQL systems, ensuring robust and scalable data architectures.Key Points:- Led the development of Spark code in Scala and Python, optimizing data processing and implementing functional programming principles for complex data sets.- Spearheaded automation and validation of ETL processes across multiple databases, and designed real-time streaming applications using Spark, Kafka, and Hive.- Extensively involved in AWS environment management, EMR setup, and big data technology integration including Hadoop, HBase, Cassandra, and Kafka.Skills:Scala, Spark-SQL/Streaming, Python, ETL Development, IBM Web Sphere, AWS, Hadoop, HBase, Cassandra, MongoDB, Kafka, Spark Streaming, Machine Learning, Data Mapping, Talend ETL, Hive, SQL, Apache Kafka, Sqoop, Teradata, Cloud Infrastructure, AWS EC2, SparkSQL, JSON, NoSQL, Data Analytics, Reporting, PL/SQL, Oracle, Autosys, MS SQL Server.

Scottsdale, Arizona, United States

In my role as a Big Data Engineer at Early Warning's, Scottsdale, AZ, from August 2020 to January 2022, I played a pivotal role in developing and implementing big data solutions in a dynamic Azure cloud environment. My responsibilities included handling large-scale data analytics projects, creating efficient data pipelines, and developing comprehensive BI solutions. I employed a variety of technologies such as Spark, Hive, Kafka, and Scala to manage and analyze big data. My work extended to creating robust ETL processes, developing real-time analytics solutions, and ensuring secure data access and transfer. I also focused on visualizing and reporting data insights using tools like Tableau and PowerBI, enhancing business decision-making processes.Key Points:- Designed and implemented large-scale BI solutions on Azure, utilizing services like Azure Data Lake, Data Factory, and HDInsight for efficient data management and analytics.- Developed and optimized data pipelines using Spark, Hive, Pig, and Python, and implemented real-time data analytics with Kafka and Spark Streaming.- Extensive experience in data visualization and reporting, developing dashboards in Tableau and PowerBI, and managing data security and access control using Apache Sentry and Kafka.Skills:Agile Methodologies, Azure Data Lake, HDInsight, Apache Sentry, MapReduce, Java, PIG Latin, Tidal, Oozie, Kafka, Tableau, Hive, Azure BI Solutions, AVRO, SSIS, PowerBI, Data Virtualization, Sqoop, Kerberos, Spark, Scala, SparkSQL, TeaLeaf, Spark MLlib, Snowflake, Python, Impala, HBase, Cassandra, CQL, Apache Drill, SQL, NoSQL, Azure Data Factory, SSRS, Oracle PL/SQL, Shell Scripting, Data Import/Export, Databricks.

Salt Lake City, Utah, United States

As a Data Engineer at Zions Bank in Salt Lake City, UT, from November 2018 to July 2020, I specialized in developing and optimizing data solutions in both cloud and on-premise environments. My role was pivotal in automating and improving data processes, focusing on the integration of AWS cloud services and Hadoop ecosystems. I designed and executed ETL processes using Informatica, managed large-scale data storage and processing using AWS Glue, PySpark, and HDFS, and ensured secure and efficient data access with AWS IAM configurations. My expertise also included creating advanced data analytics tools and visualizations using Python, enhancing data-driven decision-making capabilities within the organization.Key Points:- Expertise in cloud solutions with AWS, developing Python utilities for data validation and manipulation, and configuring IAM for secure data access.- Designed and implemented robust ETL processes using Informatica and orchestrated data workflows with Oozie, integrating various data sources into Oracle Data Warehouse.- Proficient in handling big data technologies like HDFS, Hive, Sqoop, and HBase, and developed Python scripts for efficient data management and analytics.Skills:Python, HDFS, Spark, Hive, Sqoop, AWS, Oozie, ETL, Informatica, Oracle 10g, MySQL, NoSQL, HBase, Data Validation, Cloud Solutions, Data Storage, IAM, AWS Glue, PySpark, Elasticsearch, UDF Development, Shell Scripting, Matplotlib.

India

As a Hadoop Developer at Riktam Software India Pvt. Ltd. from January 2017 to August 2018, my role was centered around deploying and managing Hadoop ecosystem components, developing data processing jobs, and integrating various data sources into the Hadoop environment. I played a key role in installing and configuring Hadoop, Hive, and working with NoSQL databases like HBase and Cassandra. My responsibilities also included the development of MapReduce jobs in Java and Scala for data cleaning and preprocessing, as well as implementing real-time data analysis pipelines using Kafka and Cassandra. I was instrumental in optimizing data queries and designing a product search service using Apache Solr.Key Points:- Led the installation and configuration of Hadoop ecosystem components, developing and optimizing MapReduce jobs in Java and Scala for efficient data processing.- Expertise in managing NoSQL databases, particularly HBase and Cassandra, and integrating them for enhanced data operations and analytics.- Designed and implemented real-time data processing and analysis solutions, utilizing Kafka for data movement and Apache Solr for search services.Skills:CDH, MapReduce, Scala, Kafka, Spark, Solr, HDFS, Hive, Pig, Impala, Cassandra, Java, SQL, Tableau, Python, Teradata, Pentaho, Sqoop, Data Cleaning, Data Preprocessing, NoSQL Databases, Real-Time Data Analysis, Cluster Management, Capacity Planning.

Bengaluru, Karnataka, India

As a Data Analyst at IPrism Technologies in Bangalore from October 2015 to December 2016, my role entailed collaborating closely with Business Analysts to understand and gather data requirements, and subsequently identify relevant data sources. I was responsible for the manipulation and management of data using a variety of tools and languages, including Python, SAS, and Teradata SQL. My key tasks included writing SAS programs to convert Excel data into Teradata tables, developing Python scripts for data parsing and cleaning, and performing data preprocessing and imputation. Additionally, I was involved in creating performance-enhancing SQL scripts and generating insightful weekly and monthly reports for Logistics and Manufacturing departments.Key Points:- Specialized in data extraction and transformation, utilizing SAS and Python for converting and cleaning data, and ensuring data quality for analysis.- Expertise in Teradata SQL for data manipulation and report generation, employing OLAP functions for enhanced query performance.- Developed and maintained large-scale data imports/exports between file systems and Teradata, and contributed to performance tuning and optimization.Skills:Teradata, BTEQ, VBA, Python, SAS, FLOAD, MLOAD, UNIX, SQL, Windows XP, Business Objects, Data Gathering, Data Preprocessing, OLAP Functions, Data Imputation, Report Generation, Data Cleaning, Performance Tuning.