Dipika D Email & Phone Number

Mount Prospect, Il, Us

Minneapolis, Mn, Us

• Responsible for developing a highly scalable and flexible authority engine for all customer data. • Worked on Resetting of customer attributes that provide insight about customer. Purchase frequency, marketing channel, Groupon deal categorization. Advocate different sources of data using SQL, HIVE, SCALA.• Integrated 3rd party data agencies (Gender, age, other purchase history from other sites) try to integrate that data to existing data store.• Used Kafka HDFS Connector to export data from Kafka topic to HDFS files in a variety of formats and integrates with apache hive to make data immediately available for SQO querying.• Normalized the data according to the business needs like data cleansing, modifying the data types and various transformations using Spark, Scala and GCP Dataproc.• Implemented dynamic partitioning in bigquery tables and used appropriate file format, compression technique to improve the performance of Pyspark jobs in the DATAPROC.• Built a system for analyzing the column names from all tables and identifying personal information columns of data across on-premises Databases (data migration) to GCP• Process and load bound and unbound Data from Google Pub/Sub topic to Big-Query using cloud Dataflow with Python.• Worked on partitions of Pub/Sub messages and setting up the replication factors.• Operation focused, including building proper monitoring on data process and data quality.• Effectively worked and communicated with product, marketing, business owners, and business intelligence and the data infrastructure and warehouse teams. • Performed analysis on data discrepancies and recommended solutions based upon root cause.• Designed and developed job flow using Apache Air flow. • Worked on intellij IDE, Eclipse IDE, Maven, SBT, GIT

Us

• Participated in weekly release meetings with Technology stakeholders to identify and mitigate potential risks associated with the releases. • Implemented Responsible AWS solutions using EC2, S3, RDS, EBS, Elastic Load Balancer, and Auto scaling groups, Optimized volumes and EC2 instances. • Wrote Terraform templates for AWS Infrastructure as a code to build staging, production environments & set up build & automations for Jenkins. • Configured Elastic Load Balancers (ELB) with EC2 Auto scaling groups. • Created Amazon VPC to create public-facing subnet for web servers with internet access, and backend databases & application servers in a private-facing subnet with no Internet access. • Created AWS Launch configurations based on customized AMI and use this launch configuration to configure auto scaling groups. • Utilized Puppet for configuration management of hosted Instances within AWS Configuring and Networking of Virtual Private Cloud (VPC). • Utilized S3 bucket and Glacier for storage and backup on AWS. • Using Amazon Identity Access Management (IAM) tool created groups & permissions for users to work collaboratively. • Implemented /setup continuous project build and deployment delivery process using Subversion, Git, Jenkins, IIS, Tomcat. • Connected continuous integration system with GIT version control repository and continually build as the check-in's come from the developer. • Knowledge in build tools Ant and Maven and writing build.xml and pom.xml respectively. • Knowledge in authoring pom.xml files, performing releases with the Maven release plug-in and managing Maven repositories. Implemented Maven builds to automate JAR and WAR files.

Dublin, Ie

• Participated in weekly release meetings with Technology stakeholders to identify and mitigate potential risks associated with the releases. • Implemented Responsible AWS solutions using EC2, S3, RDS, EBS, Elastic Load Balancer, and Auto scaling groups, Optimized volumes and EC2 instances. • Wrote Terraform templates for AWS Infrastructure as a code to build staging, production environments & set up build & automations for Jenkins. • Configured Elastic Load Balancers (ELB) with EC2 Auto scaling groups. • Created Amazon VPC to create public-facing subnet for web servers with internet access, and backend databases & application servers in a private-facing subnet with no Internet access. • Created AWS Launch configurations based on customized AMI and use this launch configuration to configure auto scaling groups. • Utilized Puppet for configuration management of hosted Instances within AWS Configuring and Networking of Virtual Private Cloud (VPC). • Utilized S3 bucket and Glacier for storage and backup on AWS. • Using Amazon Identity Access Management (IAM) tool created groups & permissions for users to work collaboratively. • Implemented /setup continuous project build and deployment delivery process using Subversion, Git, Jenkins, IIS, Tomcat. • Connected continuous integration system with GIT version control repository and continually build as the check-in's come from the developer. • Knowledge in build tools Ant and Maven and writing build.xml and pom.xml respectively. • Knowledge in authoring pom.xml files, performing releases with the Maven release plug-in and managing Maven repositories. Implemented Maven builds to automate JAR and WAR files.

New Delhi, Delhi, In