Data Engineer
CurrentManaging end-to-end data ingestion from various EDC and non-EDC sources to support clinical trials for a life sciences client.Designing and developing ETL scripts with Python and PySpark, performing ad hoc code adjustments, and extracting essential data using SQL. Creating and monitoring DAGs in Apache Airflow for seamless data pipeline orchestration and.