Senior Software Engineer
Current- Developed config-driven ETL pipelines for data profiling and data quality statistics for datasets up to a few TBs using Apache Airflow, Spark, and Python, enabling execution on different datasets without code changes. - Created end-to-end analytics dashboards with backend and frontend components using Flask for server-side logic and Plotly Dash for.