Hi there! I'm a data engineer having around 4 years of experience in designing and building data pipelines for large-scale data processing. I have a strong background in Python, SQL, PySpark, and Hive, as well as experience with various Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics, ACR, AKS, AKV.Along with that I also have industry exposure of Docker , Kubernetes and IaC tools such as Terraform.My expertise lies in building efficient, scalable, and fault-tolerant data pipelines that can handle large volumes of data with high performance. I have experience in data integration, data modeling, ETL processes, and data warehousing, as well as knowledge of data quality and data governance best practices.I'm passionate about solving complex data engineering challenges and leveraging the latest technologies and tools to create innovative solutions that drive business value. Whether you need help with building a new data pipeline or optimizing an existing one, I'm here to help.Let's work together to unlock the full potential of your data!
-
Software EngineerEpam SystemsGurugram, Hr, In -
Associate Data Engineer L2Publicis Sapient May 2022 - PresentBengaluru, Karnataka, IndiaWorked heavily on Azure Databricks & Pyspark for migration of code from previous databricks LTS version to newer version.Cleansing the data which we are receiving from our client app on daily basis.Created a tool using which we are validating our json file and can be use for all sorts of json validation.Worked on the containerization of data pipelines using AKS, ACR and terraform -
Data EngineerFuturense Technologies Feb 2022 - Apr 2022Bengaluru, Karnataka, IndiaDesigned and developed data pipelines and maintained the data quality to support a rapid growing business.Designed ETL data flows creating mappings/workflows to extract data from SQL Server and Data Migration and Transformation using HDFS and Pyspark.Handled Data Processing using PySpark on Premises as well as Cloud. Experience in Airflow and workflow scheduler to schedule spark jobs. -
Project EngineerWipro Limited Sep 2020 - Jan 2022Bengaluru, Karnataka, India
Divya Anand Education Details
-
Information Technology
Frequently Asked Questions about Divya Anand
What company does Divya Anand work for?
Divya Anand works for Epam Systems
What is Divya Anand's role at the current company?
Divya Anand's current role is Software Engineer.
What schools did Divya Anand attend?
Divya Anand attended Heritage Institute Of Technology.
Who are Divya Anand's colleagues?
Divya Anand's colleagues are Anyeli Cárdenas, Valiantsin Danilau, Oleg Golenko, Aleh Katsuba, Reka Enyedi, Gajanan Khule, Dmytry Rastsvietalov.
Not the Divya Anand you were looking for?
-
Divya Anand
Strategic Initiatives For Law Firms With Tier-1 Experience | Legal Consultant | Forbes India Top Management Professional 2023 | Ex: Azb Nishith Desai AssociatesMumbai2gmail.com, blueoceanimc.com -
Divya Bhatnagar
Sustainability And Esg Champion At Nippon Paint Groupar Driving Global InitiativesDelhi, India -
Divya Anand
Bengaluru -
Divya Anand
Bengaluru5dlogixconsulting.com, mcafee.com, mcafee.com, cleartrip.com, gmail.com1 +140834XXXXX
-
Divya Anand
Bengaluru
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial