Please complete the CAPTCHA to continue
A concise factual answer block for searchers comparing this professional profile.
Pavan P is listed as Big Data Developer @ American Express at American Express, based in United States. AeroLeads shows a matched LinkedIn profile for Pavan P.
Pavan P previously worked as Big Data Developer at American Express and Big Data Developer at Great American Insurance Group. Pavan P holds Master'S Degree, Computer And Information Systems Security/Information Assurance from New England College.
This section adds company-level context without repeating Pavan P's masked contact details.
Review company-level records connected to Pavan P before choosing the right outreach path.
I have 8 years of expertise in developing and managing data pipelines and data products to ingest, process, and analyze a sizable volume of structured and unstructured data from multiple sources. I am a skilled data engineer. I have a lot of expertise assessing data requirements, moving data into enterprise data lakes, and developing data products and reports. I am well-versed in large data technologies and distributed processing frameworks, and I have successfully led the delivery of real-time and batch-based ETL pipelines.
Company context helps verify the profile and gives searchers a useful next step.
A career timeline built from the work history available for this profile.
New York, Ny, Us
• Developed centralized Data Lakes on AWS using S3, EMR, Redshift, and Athena.• Built Spark applications, Hive scripts, and real-time streaming pipelines with Kafka.• Automated infrastructure with AWS CloudFormation, Terraform, and CI/CD tools.
Cincinnati, Oh, Us
• Managed the development and maintenance of data pipelines in a large-scale distributed environment.• Delivered both batch and real-time data pipelines using frameworks like Spark.• Collaborated with cross-functional teams to optimize data processing efficiency.
• Integrated multiple sourced data from ftp servers, oracle databases, teradata, and external APIs into a central data lake using tools like swoop, PySpark, Scala, and Kafka.• Designed Spark applications to prepare, aggregate, and clean data for machine learning and reporting purposes.• Analyzed user activities and customer profiles to generate valuable analytics and reports for Citi Bank in Texas, United States.
Englewood, Co, Us
• Developed and implemented Spark transformations and actions using Spark RDDs and Data frames to analyze customer and sales data• Utilized Kafka to stream data from various sources into HDFS for analysis• Collaborated with cross-functional teams to ensure data quality and availability• Managed large datasets using Panda data frames and MySQL
Houston, Texas, Us
• Built scalable distributed data solutions using Hadoop, managing cluster maintenance and troubleshooting• Analyzed data using Hadoop components Hive and Pig, transforming large sets of structured and unstructured data• Imported and exported data from RDBMS to HDFS using Sqoop, creating Hive tables and writing queries
Hyderabad, Ts, In
• Developed complex MapReduce jobs in Java for data extraction, aggregation, and transformation• Integrated hive warehouse with HBase for information sharing among teams• Scripted complex Hive QL queries for analytical functions• Developed Pig Latin scripts for data joins and custom processing of Map Reduce outputs
Quick answers generated from the profile data available on this page.
Pavan P works for American Express.
Pavan P is listed as Big Data Developer @ American Express at American Express.
Pavan P is based in United States while working with American Express.
Pavan P has worked for American Express, Great American Insurance Group, Citi Bank, Dish Network, and Hewlett Packard Enterprise.
You can use AeroLeads to view verified contact signals for Pavan P at American Express, including work email, phone, and LinkedIn data when available.
Pavan P holds Master'S Degree, Computer And Information Systems Security/Information Assurance from New England College.
Search by job title, company, industry, location, and seniority. Export verified B2B contact data when you need it.
Start free trial Search contacts