Created and maintained data pipelines to support multiple business- and ad-related product teams. Optimized SQL generation frameworks to significantly reduce CPU and memory consumption as well as wall-clock execution time. Created and hosted training classes to on-board new employees and interns as well as training existing employees in SQL and various internal frameworks and tools.

Maintained and rewrote large portions of the event ingest framework that processed ProtoBuf and JSON events and loaded them into Redshift and generated Parquet files for use in Hadoop. Created generic frameworks to enrich events, including basic bot flagging an well as user agent and URL parsing. Created frameworks for ingesting CDC records from DynamoDB and from an internal messaging queue to Parquet using PyArrow. Took ownership of ETL processes that handled user session, bot flagging, and content taxonomy.

Operations architect of platforms and processes supporting Business Intelligence, my primary focus is on automation and reliability. I support many different software products and platforms including Teradata, Oracle, SAP Business Objects, Tableau, MapR Hadoop, UNIX, and CA Workload Automation ESP Edition. I build automation and integrate various application servers using Python, Perl, and Java.

• Integrated report usage data across Business Objects, web reports, and filesystems to create a single repository of report usage.• Assisted in the implementation of an automated report security system, applying report permissions from a central authority to the various publication mechanisms and platforms• Converted batch schedule from AutoSys to ESP• Enhanced existing batch framework to support Teradata, including the creation of tools to replicate data between Oracle and Teradata with a minimum of development time.

Hired to perform Y2K conversion of mainframe reports to and Oracle datamart. Retained on contract for over 6 years. Projects included:• Designed and wrote tools to manage database and report documentation, including data lineage and integration with AutoSys.• Assisted with ongoing enhancement and redesign of Oracle datamart to incorporate new database features.• Primary architect of a reliable and flexible batch job framework, significantly reducing development time on new jobs.• Assisted in numerous report development and ETL (SQL) development projects.• Wrote Java programs using the Business Objects SDK integrate AutoSys batch scheduling with Business Objects reports.• As part of a small team, designed and built an application for analyzing key financial metrics including profitability predictions. Application is a key decision-making application for sales and finance.

Programmer/Developer

Programmer on various client projects involving MS Access, Visual Basic, and C.

General IT support, MS Access programming.