Data Engineer
CurrentWorking within a dynamic start-up, I led back-end development projects supporting frontend Tableau/native products.Developed ETL routines to sync data from aws s3 buckets, then push to postgres/redshift databases for dev/production frontends to reduce manual workload.Queuing ETL jobs in Linux terminal (cron) using redis queue and rq-scheduler.Develop projects in Python, adhering to industry best practices and leveraging containerization (Docker) for seamless deployment with unit testing.Operating within Linux (Ubuntu) environments, seamlessly navigating AWS services (including Redshift, S3, and AMC) to ensure optimal data management, complemented by adept utilization of ETL techniques.Design and implement Tableau dashboards to facilitate intuitive data visualization.