Who is Palak Agarwal? Overview
A concise factual answer block for searchers comparing this professional profile.
Quick answer
Palak Agarwal is listed as Data Engineer at Intuit, based in San Jose, California, United States. AeroLeads shows a work email signal at thedatateam.in and a matched LinkedIn profile for Palak Agarwal.
Palak Agarwal previously worked as Data Engineer at Autodesk and Data Engineer at Thedatateam. Palak Agarwal holds Master Of Science - Ms, Computer Software Engineering from San José State University.
Company email context
Email format at Intuit
This section adds company-level context without repeating Palak Agarwal's masked contact details.
{first}.{last}@thedatateam.in
86% confidence
AeroLeads found 1 current-domain work email signal for Palak Agarwal. Compare company email patterns before reaching out.
Profile bio
About Palak Agarwal
Having done numerous projects in the field of data engineering, my interest in working as a data engineer has increased exponentially. I believe that my aspirations to delve deeper will mutually benefit all. Seeking work in fields of data engineering, ETL, Big data and, Cloud Technologies• Experience in building pipelines using python and the subsequent trigger notifications for Cadenz Customer Profiling.• Majorly skilled in different Cloud Stack, Big data Technologies, Python, ETL, Building pipelines, Customer data analytics, including customer segmentation, behavioral and direct marketing strategies.• Demonstrated business intelligence and attention to detail.• Developed the feature to automatically on-board the new attributes in Cadenz User Profiling and the subsequent trigger notifications using SNS.• Successfully architectured and independently created the campaign management system via AWS Step Functions, Kinesis and json parser.• Created AWS Data Ingestion Pipelines using pagination to query DynamoDB using AWS lambda for serving the subsequent API calls.• Implemented the Flink framework for calculating the attributes for upto 180 days by maintaining their states on different realtime Kafka Streams.• Worked on re-orchestrating and migrated the entire system from airflow to AWS managed airflow to make it more manageable and effective.Specialties:• Proficient in handling various business scenarios and converting them into technical code and offering business solutions/recommendations or insights• Strong expertise in SQL concepts, Python, Scala, Spark and AWS.• Good ETL development experience to load and unload the data in data warehouse. Experience working with tool named Abinitio.• Expert in creating AWS data ingestion pipelines using pagination.• Implemented the stateful Flink framework and efficiently optimized the redshift queries.• Knowledge of Parsing json format for various APIs and sdks.
Listed skills include Leadership, Career Management, Diversity And Inclusion, Javaserver Pages, and 36 others.
Current workplace
Palak Agarwal's current company
Company context helps verify the profile and gives searchers a useful next step.
8 roles
Palak Agarwal work experience
A career timeline built from the work history available for this profile.
Data Engineer
· Designed batch ETL PySpark scripts to process weekly user revenue data uploads from SharePoint API, leveraging Spark transformations.· Developed intermediate tables and temporary views using UPSERT transactions for incremental data loading in Hive, optimizing revenue tracking dashboards by reducing processing time by 25% and ensuring idempotency.· Created testing scripts for Mock APIs and developed common utility scripts to retrieve data from APIs using AWS Secrets Manager.· Conducted comparative analysis between Snowflake and Hive finance tables to architect data pipelines, reducing manual efforts by 40%.· Built AWS data ingestion pipelines with pagination to efficiently query DynamoDB and utilized AWS Lambda for handling subsequent API calls.
May 2023 - May 2024
Data Engineer
· Designed Spark data pipeline architecture to onboard new attributes for User Profiling and triggered notifications via SNS, Slack, and Airflow.· Worked on optimizing and performance tuning the SQL queries for achieving joins on 10 tables reducing execution time to 40%· Implemented a Spark framework to ingest telecom attributes, validate data configurations, transform, and load the processed data into PostgreSQL and S3 in Parquet format. The data was leveraged to send alerts to telecom users about remaining data quotas.· Re-architected and migrated the entire system from Airflow to AWS services using Python, achieving a 60% reduction in MapReduce processing time. Implemented auto-scaling for EMR clusters and EKS pods to execute Ruby scripts within Docker images, following Agile methodologies.· Developed Airflow orchestration using Python and DAG operators to manage upstream and downstream data flows in the Spark pipeline for specific dates. Configured retry and resume functions using CRON-based date and time settings.•
Mar 2021 - Apr 2023
Solution Integration Consultant
Working on Creating the Abinitio ETL workflows for different clients and further using Tableau for visualization.• Entirely responsible for delivering the brand campaign flows with numerous segmentation techniques.• Automating the data extraction and uploads via effective scripts in graphs for data formatting and transforming.• Working on managing and logically suppressing the database tables using the ETL graphs for filtering the target customers.• Analyzing and creating the visualizations for operational data extracted from campaign executions.• Tools Used: Abinitio, Putty, WinScp, WinSQL, Customer Dialogue Manager CDM, Db Visualizer, MS Excel, Tableau, AWS
May 2018 - Mar 2021
Intern
Dec 2017 - Jan 2018
Intern
Got an hands-on experience of working on Android application development. I have single handedly developed an Android app for the active investors seeking for the new ideas. It's a platform that bridges the gap between the investors and the investment seekers. It involved modules like1. Setting up of the notification triggers based on GCM IDs. 2. Retrieving the JSON through retrofit.3. Technologies like Java, PHP.4. A proper server space.
Jun 2017 - Aug 2017
Summer Intern
The designing and development of automated gate pass system under the guidance of senior IT specialist not only rewarded me the knowledge but also gave me the confidence. This interactive system was the biometric attendance system where the time-in and time-out of all the employees could be recorded. The challenge of scaling it according to all the dynamic vendors and their specific requirements was overcome. This involved:1. The use of sensors and the bar code detection.2. The setting up of server.3. jdbc connection.4. And the technologies like Java, html, PHP and css.
May 2017 - Jun 2017
Summer Intern
Metlife Global Operations Support Center
Jun 2016 - Jul 2016
3 education records
Palak Agarwal education
Master Of Science - Ms, Computer Software Engineering
San José State University
Masters Of Technology, Computer Science And Engineering
Jaypee Institute Of Information Technology
Bachelor Of Technology, Computer Science
Jaypee Institute Of Information Technology
FAQ
Frequently asked questions about Palak Agarwal
Quick answers generated from the profile data available on this page.
What company does Palak Agarwal work for?
Palak Agarwal works for Intuit.
What is Palak Agarwal's role at Intuit?
Palak Agarwal is listed as Data Engineer at Intuit.
What is Palak Agarwal's email address?
AeroLeads has found 1 work email signal at @thedatateam.in for Palak Agarwal at Intuit.
Where is Palak Agarwal based?
Palak Agarwal is based in San Jose, California, United States while working with Intuit.
What companies has Palak Agarwal worked for?
Palak Agarwal has worked for Intuit, Autodesk, Thedatateam, Fico, and Hcl Technologies.
How can I contact Palak Agarwal?
You can use AeroLeads to view verified contact signals for Palak Agarwal at Intuit, including work email, phone, and LinkedIn data when available.
What schools did Palak Agarwal attend?
Palak Agarwal holds Master Of Science - Ms, Computer Software Engineering from San José State University.
What skills is Palak Agarwal known for?
Palak Agarwal is listed with skills including Leadership, Career Management, Diversity And Inclusion, Javaserver Pages, Social Network Analysis, Personal Development, Java Database Connectivity, and C.
Find 750M verified contacts
Search by job title, company, industry, location, and seniority. Export verified B2B contact data when you need it.
Start free trial