Big Data Engineer
CurrentPart of the core data team which acts as a data funnel for the rest of the company, providing our consumers (a.k.a. other teams) with Terabytes of mission critical data that goes through our pipelines daily.Stack:- Task orchestration: Airflow (python)- code: python/scala (using spark)- data management: multiple AWS solutions/HDFS- CI/CD: gitlab CI/teamcity.