Alwin Antony

Alwin Antony Email and Phone Number

Big Data Developer - Scala | Spark | Python |Pyspark | SQL | Azure | Bigdata | Airflow | Hive | ETL @ NielsenIQ
chicago, illinois, united states
Alwin Antony's Location
Thrissur, Kerala, India, India
About Alwin Antony

AboutServing Notice Period as a Big Data Engineer with 2.4 years of experience. Spearheading the development of data-intensive applications using Azure technology. Proficient in Spark, Scala, Pyspark, SQL, Python, Azure ETL tools, and Data Engineering. Passionate about optimizing data processing systems and driving organizational growth through valuable insights.Highlights:• Achieved 80% reduction in cloud computing costs through query-logic optimization.• Created seamless ETL pipelines using Azure ETL Tools.• Integrated user-friendly UI to trigger data pipeline jobs.• Implemented Airflow in Python for efficient job orchestration on Databricks clusters.• Conducted code reviews, resolved issues, and prepared code for deployment.• Ensured high-quality deliverables and production releases.• Go-to person for troubleshooting and smooth operations.• Utilized cloud computing for scalable data processing.• Transformed Hive/SQL queries to Spark transformations using Scala and Python.• Collaborated on country onboarding scripts and database management.• Contributed to table development and optimized queries.• Provided technical support to project stakeholders.Let's connect to explore opportunities in the Big Data and Data Engineering field.

Alwin Antony's Current Company Details
NielsenIQ

Nielseniq

View
Big Data Developer - Scala | Spark | Python |Pyspark | SQL | Azure | Bigdata | Airflow | Hive | ETL
chicago, illinois, united states
Website:
niq.com
Employees:
2409
Alwin Antony Work Experience Details
  • Nielseniq
    Software Engineer
    Nielseniq Apr 2024 - Present
    Chennai, Tamil Nadu, India
  • Tata Consultancy Services
    Assistant System Engineer
    Tata Consultancy Services Apr 2022 - Apr 2024
    Kochi, Kerala, India
    - Worked on creating functions that will generate results based on the business rules. Developed a Spark Scala framework for performing multiple user-specified operations on the data, like creating, editing, and deleting characteristics. It's a fully automated process based on the UI trigger.- Developed a pipeline that will read and validate external database tables parallelly and upload to our application and use that as an sources for further data process.- Expertise in working with Hive and Azure Blob storage options for reading, updating, and writing data back to these storage accounts. Additionally, I've worked on establishing ETL pipelines and managing connections to databases like Postgres and Presto.- Worked on optimizing the code thus reducing the run time and cost by 80% .Implemented Airflow written in Python as scheduler ,orchestrating job execution on DataBricks cluster.- Utilized cloud computing to process large volumes of data, maximizing computational power and stability.- Engaged with Jira, Bitbucket, and various other collaborative tools as an integral part of the Agile methodology. These tools have facilitated efficient project management, streamlined communication, and enhanced collaboration among cross-functional teams during the Agile development process- Recognized as the first choice for addressing urgent bug reports, I consistently demonstrated a rapid response to critical issues that had the potential to disrupt user experience or compromise system functionality.- Conducted interactive knowledge transfer sessions, presenting technical concepts, project architecture, coding standards, and domain-specific insights to equip new team members with the information they needed to excel.
  • Tata Consultancy Services
    Assistant System Engineer Trainee
    Tata Consultancy Services Aug 2021 - Apr 2022
    Kochi, Kerala, India
    - Developed spark Scala frame work for generating the item characteristics file based on the business rules .- Developed a Airflow dag which will accept a set of job request and trigger the respective task from it.- Worked in Jenkins, a robust automation and continuous integration/continuous deployment (CI/CD) tool,- I have leveraged REST APIs for a multitude of purposes, including status updates and various other essential functionalities- In charge of cross checking the functionalities of application for production releases. Developed unit test cases for the same - Worked with project mangers, leads and clients to generate results as per the requirement and complete on time

Alwin Antony Education Details

  • Sahrudaya College Of Engg & Tech., Kodakara
    Sahrudaya College Of Engg & Tech., Kodakara
    Electrical, Electronics And Communications Engineering

Frequently Asked Questions about Alwin Antony

What company does Alwin Antony work for?

Alwin Antony works for Nielseniq

What is Alwin Antony's role at the current company?

Alwin Antony's current role is Big Data Developer - Scala | Spark | Python |Pyspark | SQL | Azure | Bigdata | Airflow | Hive | ETL.

What schools did Alwin Antony attend?

Alwin Antony attended Sahrudaya College Of Engg & Tech., Kodakara.

Who are Alwin Antony's colleagues?

Alwin Antony's colleagues are Iputu I Putu Febrian Wahyudi, P. Sathyamurthy, Luis Gerardo Vázquez, Harsh Ashra, Pavlo Guyvan, Greta Karst-Cichocka, Varshni Karthikeyan.

Not the Alwin Antony you were looking for?

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.