Dan Johnson Email & Phone Number

The Villages, FL, US

I'm taking my time off to learn and review various technologies like AWS, Scala and the JVM in general, Data Intensive Applications, and the use of GenAI as a programming assistant

Glendale, CA, US

I implement data pipelines using Airflow and Snowflake SQL. This system reads data from an Azure blob and processes it through a metadata registry into a Snowflake Lakehouse architecture for use by AI and data scientists. The pipeline uses a combination of straight SQL calls and stored procedures written in JavaScript. I also one a hackathon by showing how.

Seattle, Washington, US

I oversee all the technical work on our back-end data. That means the legacy system built as a single tenant monolith with Python and SQL Alchemy for the ETL and data processing.We also redesigned the system for a specific vertical by using GKE and Airflow to run the python workloads that used to be part of the monolith. I worked on the Airflow and GKE.

I build pipelines using Airflow, Python, Lambda, DynamoDB, Eventbridge, ECS, and Docker to automate the ingest and movement of data into a data lake for use by the analysts. The systems are designed to scale to ingest 10’s of 1000’s of files a day with 100’s of TB’s.

Chicago, Illinois, US

I lead the deployment and integration of an Azure based data platform based on Azure Data Factory and Databricks for Blackstones family of portfolio companies. I am also an architect on the development of an AWS based version of this platform. We are in the early stages of selecting technologies in AWS for this version.

New York, NY, US

Senior Data Architect for Outcomes and Planning businessProvide input on various architectural plans and problems for various products within this part of Nielsen. The architecture team worked on moving the MMM (Marketing Mixed Model) series of products to a more Microservice type architecture. We added messaging API’s to existing components to pass.

Burlington, MA, US

In this role I am taking the lead on moving the previous POC work into a corporate wide datalake and analytics capability. We are using Hortonworks HDP 2.3 Hadoop distribution. I have deployed several analytics tools, including Hive, Spark, and R server. I have deployed an ingestion framework called Enigma Parsekit for parsing all of our data from the.

This job entails building a data lake to help visualize and co-locate data from various organizations across the company. The project is using Hortonworks HDP 2.x along with ElasticSearch. Tableau and Kibana are used for visualization.

Boston, Massachusetts, US

I architect and lead development of a reporting/analytic system based on Hadoop and Hive that supports our advertising products.

Boston, Massachusetts, US

• I helped lead the team into a SCRUM development process.
• I co-wrote a presentation on the practices from XP (eXtreme Programing) that we could use in our process; for example: Test Driven Development.
• I documented and prototyped a system for how we might use NUnit unit testing on our new C# projects.
• I co-developed an architecture for a possible new product.
• I learned how to add an SCTE-35 message to an mpeg stream and added the code to a testing tool used for simulating a network feed
• I lead the effort to integrate our product with Active Directory.

US

• I lead or coached the lead for every release since I joined the company.
• I co-architected the entire software system to be more modular and easier to add new data points by making the modules less dependent on each other.
• I co-architected a new system to run the management software on rPath Linux, using DBus
• I helped lead the redesign of the current features into the DBus based architecture for use on Linux. This separated the backend service code from the UI model/view/controller design.
• I updated the UI technology the team was using to use an AJAX style for implementing the Web UI.
• I helped engineer a way to secure the Microsoft Operations Manager agent on an appliance running windows, so that changes to the appliance could be controlled and tracked.

• I was in charge of all technical decisions to be made about the software.
• I continued the company product’s transition to Microsoft’s Visual C++.NET 2003.
• I evaluated copy protection software and recommended the best solution for the company.
• I brought the whole software user interface up to a Windows XP look and feel.
• I fixed and updated the software’s ability to read and export AutoDesk’s DXF file format.
• I integrated and updated a foot inch calculator into the software.

US

• I built a group of test tools to test a major addition to the eHealth Suite using a special form of Tcl called Scotty, as well as C/C++ and Perl.
• I customized Scotty (Tcl) to allow a script to be written that simulated 1 or more SNMP agents sending SNMP v1 or v2 traps from a single computer.
• I was required to make all of the testing tools work together using UNIX command line piping.
• I wrote an HP OpenView service that would log all traps sent to the server using C.
• I customized Scotty (Tcl) so that it could be used to process SNMP MIB’s.
• I maintained a C++ tool used to compile multiple rules files used to configure eHealth.

London, United Kingdom, GB

• I brought an Object Naming Service up to the written specification. The system was developed on Windows using C++, COM and MFC.
• I investigated where the Object Naming Service did not meet specification and suggested the solutions that made the most sense given schedule and budget.
• I added a simple lock on the object name database to synchronize the different threads access to it.
• I added a feature to the in memory database so that if the service died it could rebuild itself by adding in all of the object names that were added or deleted since the last time the database did a full write to disk.
• I help debug network communication issues with the socket level programming libraries.
• I wrote a Testing Utility for the Object Naming Service using C++ and MFC.

Houston, Texas, US

• I wrote a C++ class library on Solaris to implement a generic communications interface so the protocol and OS internals could be hidden.
• I added to the design of a new system for encapsulating SNMP toolkit functions.
• I added to the design of an enterprise view reporting product using Actuate and C++ on Windows.
• I helped design the wizard user interface that will drive the reports.
• I built a DLL in Visual C++ to encapsulate the Actuate API.
• I prototyped various console utilities needed during development using the above DLL.

Las Rozas, Madrid, ES

• I was responsible for maintaining and enhancing the InstallShield projects.
• I implemented a Windows NT DLL in Visual C++ to link with InstallShield's uninstall program.
• I helped Investigate problems with the AIX C++ compiler in which templates were not being instantiated correctly.
• I organized the Windows NT part of the Release area for the project using ClearCase.
• I jumped in where ever help was needed to try to get the product released on time.
• I built an Intranet site used for releasing test version of the product using Apache Web server on Solaris 2.51.

• I worked on an automated travel reservation system web client.
• I built the user interface forms in HTML to accept and formulate requests from the user.
• I wrote the code to interpret the request and communicate with the database server to build lists of possible reservations using Visual C++.
• I built the HTML pages using C++ to write out the HTML files dynamically to show the lists to the user and allow them to select the one that they wanted.
• I used Visual C++ 5.0, HTML and JavaScript on Windows NT server.

US

• I worked on a proof of concept that a correlation engine written in TCL/TK and CLIPS could be integrated into an event monitoring system whose server was written in C and user interface was written in C++.
• I removed the interface from the correlation engine.
• I reverse engineered the event monitoring system to understand the flow of an event to find where the correlation engine should go within that flow.
• Added the correlation engine into the event flow so that its process received the events first and then sent them to the next process based on rules files written in CLIPS.
• I added changes to the user interface so that a new event type would show up when a correlated event was displayed.
• I added the feature to show what the events were that the correlated event rolled up.

• I designed and implemented customized features to a set of telephone call answering system administration tools in C and Bourne Shell.
• I worked with the QA department to recreate bugs and make sure that they are fixed.
• The system was developed using SunOS and cross-compiled for either UnixWare or SCO UNIX.
• I used my own initiative to experiment with parallel compilation and decreased the time to compile common libraries for the product from 12 hours to 6 hours using the Clearmake tool within ClearCase.

Lowell, MA, US

• I designed and implemented control software for signal processing systems as a team.
• I designed and implemented parts of the system ranging from the top level interface down to the low level device control software. The system was developed using Sun Professional C on a UNIX (Solaris) platform.
• I implemented the UI in X windows with the Motif Widget set.
• I used several communications protocols including RS 232, RS 422 and IEEE 488(GPIB).
• I was responsible for the design and implementation of a top level control program that starts several device drivers, interacts with resource management and manages interactions between device controllers and other.
• I was involved in formal acceptance testing at various milestones.

US

• I designed and implemented real time solutions to problems both at the main factory and in the field using Borland C and an in house language.
• I was involved in debugging SECS/GEM protocol issues used within PRi’s system and between PRi’s system and material control systems.
• I actively participated in several successful acceptance tests.
• I spent significant time in clean rooms debugging equipment.
• I provided solutions to bring a machine in the field from 50% up time to 95% uptime.
• I developed a training project to teach new hires the in house language that PRi uses.