Data Engineer
CurrentBuilt and maintained data pipelines, processing over 100 gigabytes of data a month, andensuring data availabilityImplemented all Cloud infrastructure via Terraform, including the creation of custommodules for easier CI/CD workflows.Utilized Python and Spark to built robust pipelines with data from 30 different sourcesImplemented data quality checks.