Palak Agarwal work email
- Valid
Palak Agarwal personal email
Having done numerous projects in the field of data engineering, my interest in working as a data engineer has increased exponentially. I believe that my aspirations to delve deeper will mutually benefit all. Seeking work in fields of data engineering, ETL, Big data and, Cloud Technologies• Experience in building pipelines using python and the subsequent trigger notifications for Cadenz Customer Profiling.• Majorly skilled in different Cloud Stack, Big data Technologies, Python, ETL, Building pipelines, Customer data analytics, including customer segmentation, behavioral and direct marketing strategies.• Demonstrated business intelligence and attention to detail.• Developed the feature to automatically on-board the new attributes in Cadenz User Profiling and the subsequent trigger notifications using SNS.• Successfully architectured and independently created the campaign management system via AWS Step Functions, Kinesis and json parser.• Created AWS Data Ingestion Pipelines using pagination to query DynamoDB using AWS lambda for serving the subsequent API calls.• Implemented the Flink framework for calculating the attributes for upto 180 days by maintaining their states on different realtime Kafka Streams.• Worked on re-orchestrating and migrated the entire system from airflow to AWS managed airflow to make it more manageable and effective.Specialties:• Proficient in handling various business scenarios and converting them into technical code and offering business solutions/recommendations or insights• Strong expertise in SQL concepts, Python, Scala, Spark and AWS.• Good ETL development experience to load and unload the data in data warehouse. Experience working with tool named Abinitio.• Expert in creating AWS data ingestion pipelines using pagination.• Implemented the stateful Flink framework and efficiently optimized the redshift queries.• Knowledge of Parsing json format for various APIs and sdks.
-
Data EngineerIntuitSan Jose, Ca, Us -
Data EngineerAutodesk May 2023 - May 2024San Francisco, Ca, Us· Designed batch ETL PySpark scripts to process weekly user revenue data uploads from SharePoint API, leveraging Spark transformations.· Developed intermediate tables and temporary views using UPSERT transactions for incremental data loading in Hive, optimizing revenue tracking dashboards by reducing processing time by 25% and ensuring idempotency.· Created testing scripts for Mock APIs and developed common utility scripts to retrieve data from APIs using AWS Secrets Manager.· Conducted comparative analysis between Snowflake and Hive finance tables to architect data pipelines, reducing manual efforts by 40%.· Built AWS data ingestion pipelines with pagination to efficiently query DynamoDB and utilized AWS Lambda for handling subsequent API calls. -
Data EngineerThedatateam Mar 2021 - Apr 2023Pune, Maharashtra, In· Designed Spark data pipeline architecture to onboard new attributes for User Profiling and triggered notifications via SNS, Slack, and Airflow.· Worked on optimizing and performance tuning the SQL queries for achieving joins on 10 tables reducing execution time to 40%· Implemented a Spark framework to ingest telecom attributes, validate data configurations, transform, and load the processed data into PostgreSQL and S3 in Parquet format. The data was leveraged to send alerts to telecom users about remaining data quotas.· Re-architected and migrated the entire system from Airflow to AWS services using Python, achieving a 60% reduction in MapReduce processing time. Implemented auto-scaling for EMR clusters and EKS pods to execute Ruby scripts within Docker images, following Agile methodologies.· Developed Airflow orchestration using Python and DAG operators to manage upstream and downstream data flows in the Spark pipeline for specific dates. Configured retry and resume functions using CRON-based date and time settings.• -
Solution Integration ConsultantFico May 2018 - Mar 2021Bozeman, Montana, UsWorking on Creating the Abinitio ETL workflows for different clients and further using Tableau for visualization.• Entirely responsible for delivering the brand campaign flows with numerous segmentation techniques.• Automating the data extraction and uploads via effective scripts in graphs for data formatting and transforming.• Working on managing and logically suppressing the database tables using the ETL graphs for filtering the target customers.• Analyzing and creating the visualizations for operational data extracted from campaign executions.• Tools Used: Abinitio, Putty, WinScp, WinSQL, Customer Dialogue Manager CDM, Db Visualizer, MS Excel, Tableau, AWS -
InternHcl Technologies Dec 2017 - Jan 2018Noida, Uttar Pradesh, In -
InternGnxt Systems Jun 2017 - Aug 2017Noida, Uttarpradesh, InGot an hands-on experience of working on Android application development. I have single handedly developed an Android app for the active investors seeking for the new ideas. It's a platform that bridges the gap between the investors and the investment seekers. It involved modules like1. Setting up of the notification triggers based on GCM IDs. 2. Retrieving the JSON through retrofit.3. Technologies like Java, PHP.4. A proper server space. -
Summer InternNtpc Limited May 2017 - Jun 2017New Delhi, InThe designing and development of automated gate pass system under the guidance of senior IT specialist not only rewarded me the knowledge but also gave me the confidence. This interactive system was the biometric attendance system where the time-in and time-out of all the employees could be recorded. The challenge of scaling it according to all the dynamic vendors and their specific requirements was overcome. This involved:1. The use of sensors and the bar code detection.2. The setting up of server.3. jdbc connection.4. And the technologies like Java, html, PHP and css. -
Summer InternMetlife Global Operations Support Center Jun 2016 - Jul 2016
Palak Agarwal Skills
Palak Agarwal Education Details
-
San José State UniversityComputer Software Engineering -
Jaypee Institute Of Information TechnologyComputer Science And Engineering -
Jaypee Institute Of Information TechnologyComputer Science
Frequently Asked Questions about Palak Agarwal
What company does Palak Agarwal work for?
Palak Agarwal works for Intuit
What is Palak Agarwal's role at the current company?
Palak Agarwal's current role is Data Engineer.
What is Palak Agarwal's email address?
Palak Agarwal's email address is pa****@****team.in
What schools did Palak Agarwal attend?
Palak Agarwal attended San José State University, Jaypee Institute Of Information Technology, Jaypee Institute Of Information Technology.
What skills is Palak Agarwal known for?
Palak Agarwal has skills like Leadership, Career Management, Diversity And Inclusion, Javaserver Pages, Social Network Analysis, Personal Development, Java Database Connectivity, C, Relational Databases, Workplace Relations, Data Analytics, Communication.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial