Doug Balog Email & Phone Number

Pittsburgh, Pa, Us

Chicago, Il, Us

Chicago, Il, Us

* Worked directly with portfolio company FIGS assisting Director of Data Science with Data Engineering.* Developed Singer.io TAPS to extract data from various 3rd service providers.* Developed Python application to extract feature data from PDF manufacturing documents.* Created ML Pipelines using Prefect.io to prepare training data for Demand Forecasting Models.

Minneapolis, Mn, Us

* Brought Apache Spark to Target.* Modified Spark to run on a Hortonworks Secure Hadoop Cluster, incorporated changes back to upstream source code repository SPARK-6207* Supported Spark at Target for 2.5 years, answered questions, helped debug applications.* Lead developer on Target's Advanced ML pipeline that served ad recommendations on Target.com using Spark, Kafka, Cassandra and Spray* Deployed ML pipeline to multiple cloud providers using Netflix's Spinnaker and Kubernetes* Developed Data Validation framework to evaluate data quality of input data to ML models. Presented work at Spark AI Summit in April 2019. Released framework via Apache2 license on Github.

* Worked on Watson Explorer (aka Vivisimo Velocity), a high performance search engine written in C.* Created library to encrypt communication between servers using OpenSSL.* Created python library to capture and graph linux performance counters. * Ported Watson Explorer specific features to Apache Solr/Lucene.

Pittsburgh, Pa, Us

Was Responsible for development of kWantera's cloud based energy management applications.Developed interactive HTML5 run anywhere (Desktop, Tablet, Mobile) web application.Developed custom visualizations using D3JS.org. Utilized Amazon Web Services to minimize capital costs while providing a fault tolerant, scaleable backend infrastructure.Was responsible for operational issues for all of kWantera's products.

Foster City, Ca, Us

- Designed and implemented near "Realtime" application monitoring and alerting system. This system was integrated with NAGIOS to provide DevOps with valuable information about production system performance.- Designed and implemented large scale multi dimensional data analysis system using Hadoop and MySQL.- Designed and implemented HTTP/XML application gateway to MySQL database.- Designed and implemented database loader to read Hadoop job output from HDFS and load into MySQL. This was a multi threaded java application.

Pittsburgh, Pa, Us

Member of the Advanced Systems Group. Responsible for design and development of high performance storage systems for the centers Cray Xt3 supercomputer. Senior developer on center's Zest project. Made significant contributions to first working prototype demonstrated during the SC 07 Storage Challenge. Lead the centers research effort in running the Lustre file system across the Teragrid's high speed (30Gb/sec) research network.

Cambridge, Ma, Us

Lead developer of component that provides first level mapping from clients to Akamai servers. Rewrote parts of the component to make it more scalable and reduced cycle time by 10x.Developed scripts to monitor and alert Operations of problems in the system. Akamai maintains the largest geographically distributed system on the Internet. The network contains over 75000 servers in over 1000 different locations around the world.

Developed virtual operating system "Viva" that is similar to Sun's Java.Responsible for developing demo applications, testing, and debugging of Viva.Implemented TechMetrix's TMBench in Viva and benchmarked it against available application servers, out-performing all of those tested.Also implemented classes to support FastCGI and HTTP.Built Redhat Linux cluster using Linux Virtual Server to evenly distribute workload across nodes. Wrote shell scripts to fully automate installation of new nodes.

Haarlem, ., Nl

One of four engineers responsible for designing/implementing Lycos's search infrastructure. Personally responsible for catalog and indexing software, developing tools to distribute a single 150GB+ index to a cluster of Linux workstations; developed tools/procedures to speed indexing onlarge multiprocessor Compaq Alphaserver 8400 developed test harnesses and test suites to verify integrity of distributed catalogs. Worked with Compaq engineers to improve IO performance of Digital Unix. Internationalized the indexer and catalog tools to handle Unicode, (Japanese, Korean, and Chinese.) Developed the Internet's first pictures and sounds index, and a configurable Spam filtering system based on statistical analysis of web documents. Maintained portable development environment across Digital Unix, Linux, FreeBSD, Irix, Solaris.

Pittsburgh, Pa, Us

Education record

Bs, Computer Science