Senior Aws Data Engineer
CurrentDeveloped scalable and cost-effective AWS Big Data architecture for data lifecycle management including collection, ingestion, storage, processing, and visualization of large, rapidly changing datasets. Implemented end-to-end data pipelines using PySpark for data ingestion into HIVE tables, performing data cleansing, aggregation, and de-duplication..