Director Of Technology For Catalyst Digital | Software Engineer
New York, Us
Technical Highlights: Built FUSION, Catalyst Digital’s and GroupM’s data management platform for SEO, SEM, and social data.• Built FUSION in Java, using Spring and Hibernate frameworks. Runs on Linux and Windows servers, using Apache HTTP Server, Apache Tomcat, and multi-TB MariaDB/MySQL/Aurora databases. Supports +250 North American clients.• Designed and implemented a distributed web architecture that elastically scales to meet growing demand.• Federated development tasks by enabling the data pipeline team to build packages in KNIME and execute them in FUSION.• Architected a custom, clustered environment to run “sharded” KNIME packages in FUSION. Built over 200 API and Java library adapters for connection to APIs like Tableau Server, Amazon Advertising, Facebook Insights, and Google AdWords and to libraries like Tableau SDK, Apache Lucene, and JSON processing.• Built KNIME custom nodes in Java, using the Eclipse Plugin Development Environment provided by KNIME.• Designed and implemented a framework for rapid KNIME Java node development based on JSON configuration files.Migrated all FUSION VMware servers from GroupM’s physical data center to the Amazon AWS cloud with zero downtime.• Architected, built, and configured FUSION AWS cloud (EC2, EBS, S3, EFS, RDS), including: (i) Linux servers for the HTTPS and SSH edge servers, (ii) Linux servers for the Tomcat app servers running the frontend service and RESTful middleware, and (iii) Windows servers for the Tomcat app servers running the backend service and KNIME custom packages.• Scripted servers to self-deploy code at startup based on AWS metadata, using configured server AMIs and Auto Scale Groups (ASGs). Server patching and code deployment requires registering a new AMI and restarting servers via the ASGs.• Implemented integrations with other GroupM technologies, including its Tableau Server environment and its MS SQL Server and Vertica data warehouses.