Nick Hill

Nick Hill Email and Phone Number

Senior Principal Software Engineer, Gen AI Inferencing @ Red Hat
Nick Hill's Location
San Jose, California, United States, United States
Nick Hill's Contact Details
About Nick Hill

Senior research engineer, technical leader and architect. I design and build enterprise Machine Learning infrastructure at scale, with a focus on performance, concurrency, resiliency, automation and consumability. Expertise spans LLM inferencing and distributed systems – Cloud, Linux, containers, Kubernetes, serverless, microservices, K/V stores, networking, PyTorch. Skilled in Python, Rust, Java, Go. Prolific open source contributor.More than 15 years’ experience leading development and performance teams. Consistent track record of major technical contributions.

Nick Hill's Current Company Details
Red Hat

Red Hat

View
Senior Principal Software Engineer, Gen AI Inferencing
Nick Hill Work Experience Details
  • Red Hat
    Senior Principal Software Engineer, Ai Engineering
    Red Hat Nov 2024 - Present
    Raleigh, Nc, Us
  • Ibm
    Inferencing Stsm, Ai Platform Engineering, Ibm Research
    Ibm Jan 2022 - Nov 2024
    Armonk, New York, Ny, Us
    • Built the back-end LLM inferencing platform that was released as the flagshipwatsonx.ai Gen-AI cloud service in July 2023, lauded by the CEO and head ofResearch as unprecedented in terms of Research time-to-market. • Deployed and supported highly successfully IBM-internal LLM inferencing service used by thousands of IBMers as a vehicle for other research and services. • Early significant contributor to the first and most prominent open source LLM inferencing engines - Hugging Face TGI and vLLM. • vLLM committer. Represent IBM in the vLLM community, supporting and coordinating contributions by others. • Drive collaboration across IBM Research in support of common goals - bridging efforts/workstreams and connecting the dots between different projects and teams. • Work as a conduit between Research and product teams in IBM and Red Hat; assisted with early Gen AI customer engagements. • Lead ongoing Gen AI inference engineering and optimization efforts - setting technical strategy, educating and enabling other team members.
  • Ibm
    Senior Software Engineer, Ibm Watson Ai Infrastructure
    Ibm 2013 - Dec 2021
    Armonk, New York, Ny, Us
    Conceived, designed and implemented much of the infrastructure underpinning IBM’s most successful AI Cloud offerings including IBM Watson Assistant and Natural Language Classifier services. Lead and mentor development teams. Build and support distributed, scalable, resilient production systems and components/libraries used within them. Consistent top performer and regular award recipient.• Designed and implemented back end Kubernetes-based engine for orchestrating self-service ML model lifecycles used by Watson Assistant, Natural Language Classifier and Discovery services – co-ordinates model training, retraining and deployment in a fault-tolerant manner.• Designed and implemented general-purpose mesh-based model serving platform now central to most Watson AI cloud services – manages hundreds of thousands of production models.• Generalized components with abstractions to enable seamless migration between changing underlying platform services – container scheduler, data stores, etc.• Create and maintain various low-level libraries used across multiple Watson cloud products – including a service discovery and RPC framework, java etcd client and utilities.
  • Ibm
    Watson Performance/Runtime Technical Lead
    Ibm Sep 2012 - 2015
    Armonk, New York, Ny, Us
    Taking IBM Watson from gameshow to product. Applied performance analysis and engineering to parallelize and shrink room-sized question-answering system down to a single server, taking everyone by surprise and driving a fundamental change in architectural direction.Created high-performance concurrent runtime library for Apache UIMA NLP pipelines, onto which all commercial Watson QA pipelines were based. Re-implemented the core Apache UIMA 2.x library internals with a new approach that became the basis for UIMA 3.0.
  • Ibm
    Cloud Solutions Architecture And Development Lead
    Ibm 2008 - Aug 2012
    Armonk, New York, Ny, Us
    Technical lead for IBM Cloud Labs’ solutions architecture and development. Varied role included:• Leading distributed development team – full stack design and implementation of cloud-related solutions and proof-of-concept work (including front-end); Driving architecture, strategy, direction, innovation - Jump-starting technology initiatives.• Conduit between customers and product development teams; Key facilitator in transition of solutions and technology assets into product groups.• Partnering with other teams across IBM’s divisions – Systems, Research, Software brands; Enabling sales/deployment; Consultancy to IBM public compute cloud – advising on early technical direction, later with operational issues.• Customers – Tech lead for early cloud engagements with high-profile accounts (major telco, service provider and financial customers); Consultancy; Gathering, interpretation and negotiation of complex and changing requirements; Conducting briefings / workshops / demonstrations; Called in to resolve crit-sits in key engagements; Supported solution deployment “on the ground” at customer and IBM sites.
  • Ibm
    Solutions Architect And Developer
    Ibm Sep 2006 - 2008
    Armonk, New York, Ny, Us
    Cloud Labs / High Performance On Demand Solutions team(details included in lead role description above)
  • Ibm
    Performance And Emerging Technology Specialist
    Ibm Sep 2004 - Sep 2006
    Armonk, New York, Ny, Us
    Partnered with leading edge clients to deliver high-volume web and on-demand operating environments.Performed performance benchmark and troubleshooting consultancy; Technically lead development and delivery of first-of-a-kind PoC solutions for customers based around self-service infrastructure provisioning (Cloud before it was called Cloud!)
  • Ibm United Kingdom Ltd
    Extreme Blue Intern
    Ibm United Kingdom Ltd Jul 2003 - Sep 2003
    Armonk, New York, Ny, Us
    One of eight students chosen nationally, working in a team of four on research-based software project: an autonomic knowledge-management system based on Semantic Web concepts. Filed three patents.
  • Ibm United Kingdom Ltd
    Pre-University Co-Op
    Ibm United Kingdom Ltd Aug 2000 - Jul 2001
    Armonk, New York, Ny, Us
    Software Engineer in small team integrating Voice over IP into an existing telephony product. Personally took over coding of a significant proportion of the software (in C). Chosen for IBM student Bursary scheme.Returned for subsequent summer internship (Jul 2002 - Sep 2002) – made responsible for the design and development of new SIP (Session Initiation Protocol) functionality. Liaised with vendors while evaluating their protocol stacks and delivered a full solution with one of the offerings.

Nick Hill Skills

Requirements Analysis Itil Unix Integration Testing It Service Management Solution Architecture Project Delivery It Strategy Test Planning Agile Test Management Devops Staff Recruitment Test Management Agile Methodologies Db2 Test Cases Service Management Software Development Incident Management Test Strategy Process Improvement Project Planning Manual Testing Performance Testing Waterfall System Testing Management Regression Testing Software Project Management User Acceptance Testing Sql Windows System Integration Testing Quality Center Aix Change Management Defect Tracking Cloud Computing Soa Linux Eclipse Enterprise Architecture Distributed Systems Java Kubernetes Software Engineering Databases Enterprise Software Web Services

Nick Hill Education Details

  • University Of Warwick
    University Of Warwick
    Mathematics

Frequently Asked Questions about Nick Hill

What company does Nick Hill work for?

Nick Hill works for Red Hat

What is Nick Hill's role at the current company?

Nick Hill's current role is Senior Principal Software Engineer, Gen AI Inferencing.

What is Nick Hill's email address?

Nick Hill's email address is nh****@****ibm.com

What is Nick Hill's direct phone number?

Nick Hill's direct phone number is +1.408.463*****

What schools did Nick Hill attend?

Nick Hill attended University Of Warwick.

What are some of Nick Hill's interests?

Nick Hill has interest in Children, Environment, Education, Poverty Alleviation, Science And Technology, Disaster And Humanitarian Relief, Human Rights, Arts And Culture, Health.

What skills is Nick Hill known for?

Nick Hill has skills like Requirements Analysis, Itil, Unix, Integration, Testing, It Service Management, Solution Architecture, Project Delivery, It Strategy, Test Planning, Agile Test Management, Devops.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.