HPC software engineering in Python and C++ for AI

SRE for the Pinot team: https://github.com/linkedin/pinot

Responsibilities included optimizing and adding functionality to existing C++ code bases, and managing and building clusters.* Improved the speed of an in house C++ machine learning library by 10x using OpenMP, MPI and CUDA.* Added a diskless provisioning system to the Emulab cluster management system by using Python, Flask, REST, Linux, iSCSI and ZFS.* Architected and supervised the building multiple clusters, the largest had 1176 nodes.* Created various cluster management utilities using Python and C for handling remote console, remote power and serial console logging.* Performed day to day cluster management using Linux, FreeBSD, Warewulf, slurm, Emulab, NFS, and SSH.

Responsibilities: Write C++, GLSL and GPGPU write code, sysadmin* Implemented DomeLib, a C++/OpenGL/Qt based application framework that simplified the design of multiprojector-based applications in an immersive dome environment.* Created GPU-based simulations using OpenGL.* Mentored students in the use of OpenGL.* Implemented an automated, scalable version controlled systems administration management platform using Puppet* Improved reliability and uptime through the use of virtualization technologies and load balancing.* Perform day-to-day systems administration tasks using Linux and other Unix-like technologies* Assisted with general debugging and maintenance of custom software written in the UNM Computer Science Department.

Responsibilities: Write custom software, sysadmin, manage technical aspects of acquiring ISPs, manage custom billing codebase, manage email, day-to-day systems administration.* Coordinated the technical aspects of the acquisition of ten companies. This included writing custom software to merge customer owned onto ZiaNet infrastructure and to provide seamless integration of services with as little downtime as possible.* Developed and maintained custom web-based billing software using Perl, Apache and MySQL.* Developed and maintained custom web-based spam filtering software based on SpamAssassin, ClamAV and MySQL.* Played a principal part in the design, implementation and continued administration of a highly available and reliable email system that handled twenty million messages per day for sixty thousand mailboxes using Linux Virtual Server, qmail and Network Appliance filers.* Performed day-to-day systems administration using a combination of Linux and FreeBSD.

Responsibilities: write custom software, provide heavy lifting systems administration* Designed, developed and tested web-based software for customers such as Sony Pictures using PHP and Perl.* Designed and developed online ordering and warehouse management system in Perl for a fulfillment company.* Specified, installed and configured custom Linux and Sun systems to provide web services.* Provided heavy lifting systems administration support to non-technical computer consultants providing web-based services.

Responsibilities: network and systems administration* Architected and administered a five site wide-area network using frame relay, T1s and Cisco routers and switches.* Performed system administration duties using Linux, Sun Solaris and Windows NT and NetApp file servers.* Managed and supported Sun Solaris systems running GIS applications

Responsible for assisting with adding internode communication facilities to the Puma operating system* Assisted in the design, testing and documentation of internode communication and debugging utilities using C.

Designed, implemented and documented a C++ object-oriented framework for data acquisition in support of the Combined Thermal/Epithermal Neutron waste assay system.