Senior Software Advisor
CurrentData engineer and project lead in Data Analytics and Engineering department.Led development of process to convert ActiveBatch ETL scheduling jobs to Airflow/MWAA, parsing and interpreting ActiveBatch XML to generate thousands of Airflow DAGs automatically.Built Python-based SQL tokenizer and parser to convert thousands of Teradata SQL statements and stored procedures to Databricks / Spark SQL. Includes rewriting DDL, DML, and SQL functions; supports conversion of arbitrary-depth subqueries and flow control statements.Designed and developed prototype Semantic Layer using AtScale, dbt, and Databricks, providing a unified, self-service OLAP layer to data analysts.