Data Engineer
• As part of PerfectMile team, supported Business Insights UI platform for other teams by building data pipelines• Built data pipelines handling millions of records per day using Python, SQL, S3, SQS, Redshift, DynamoDB etc.• Built a custom application in Java to load datatypes JSON, TSV, CSV, Parquet etc from EDX (a S3 UI) to Redshift.• Worked with stakeholders on a daily basis to understand pipeline requirements, data quality testing etc.