Patrick Mcdonnell Email & Phone Number

New York, United States

New York, Ny, Us

Director/Sr. Director level role.• Evolved a mixed group of 25 software engineers and systems administrators into a 75 person globally-distributed platform engineering organization managing tens of thousands of physical and private cloud-based hosts, providing a secure and high-performance managed environment on which thousands of applications are homed• Created the concept of a “managed” platform team combining end-to-end lifecycle management for clusters, using an infrastructure-as-code approach to defining the networking layer through to OS, runtime environment, and deployment stack• Led a shift in thinking toward providing a holistic internal product complete with API and UI abstractions for cluster and host management tied into inventory management, budgeting, and deployment systems, with clearly defined service level objectives and a high degree of customer support for the thousands-strong Bloomberg engineering department• Scaled fleet size by 700% by fully automating and modularizing a dependency-laden, manually coordinated, monolithic provisioning process, reducing lengthy lead times for customer delivery to within hours• Developed and implemented best practices and policy for managing thousands of disparate clusters, including defining data structures and interfaces for cluster metadata management, automated maintenance patterns, workload security management, and disaster recovery testing patterns to improve the stability of the Bloomberg Terminal product• Championed shift toward SRE mindset by focusing on improving observability, monitoring, SLO creation, blameless postmortems, and high-availability design techniques for managed services• Built out and scaled up foundational platform services including automation, configuration management, DNS/DHCP/IPAM, and timekeeping to support the needs of the fleet and real-time applications relying on them

Brooklyn, Ny, Us

Led a 24 person operations engineering organization, including generalist, database, network, and datacenter disciplines. Responsibilities included hiring, roadmapping, scaling of organizational structure, and ensuring technical compliance with PCI DSS and SOX.- Fostered a culture of holistic engineering in which individual contributors participate in all stages of planning, triage, project leadership, and mentorship of others - Developed and led integration of user access IT controls for fulfillment of Sarbanes-Oxley requirements, maintaining tight scoping and eschewing separation of duties in favor of imaginative audit trail logging and monitoring techniques- Managed vendor relationships and maintained budget for the majority of the engineering organization, handling contract negotiations and liaising with financial planning, accounting, and legal teams - Advised upon and approved all capital acquisitions for the datacenter, planning for capacity growth with an emphasis on efficiency and manageability- Led a sustainability-focused task force working on reducing energy use in the datacenter by optimizing both software and hardware platforms, consolidating and dramatically shrinking footprint of database and web application cluster footprints

Brooklyn, Ny, Us

Managed a 10 person production operations engineering team of generalist and database engineers.- Wrote a full-stack order processing application for tracking asset acquisition using Sinatra, Bootstrap, and ElasticSearch, an application which has become indispensable to the capital expenditure budgeting process and accounts payable reconciliation - Recruited, hired, onboarded, and managed the long-term career development of numerous operations engineers, including a year-long effort creating a role for the opportunistic hire of an experienced hardware specialist - Transitioned responsibilities for payments and business continuity planning disciplines to new manager hire and advised him on best practices for success at the company - Designed a ticketing workflow optimized for triage around a community model, creating scripts to graph various productivity metrics to gauge the workflow’s success

Brooklyn, Ny, Us

Scaled Etsy’s production infrastructure out from a single datacenter to a three-datacenter footprint using high availability design patterns and intelligent configuration management strategies. - Envisioned and co-developed internal hardware provisioning and OS installation automation platform, written entirely in-house (learn more at http://bit.ly/1VDQqRp) - Containerized Jenkins continuous integration platform on LXC, thereby quadrupling concurrency and reducing test suite SLAs to under five minutes per build (learn more at http://bit.ly/22Y08zp) - Stood up several new production datacenter environments, implementing core services such as LDAP, DNS, NTP, monitoring and graphing infrastructure, and build hosts - Created a platform for easily spinning up development VMs and undetectably migrating VMs between physical hosts using KVM/QEMU, OpenStack Glance, and Chef - Co-developed narrowly scoped, segregated PCI DSS environment for the implementation of gift card processing and our Direct Checkout product

Brooklyn, Ny, Us

Significantly overhauled Etsy’s core infrastructure, bringing software into the modern era and creating scalable architecture optimized for future growth. Member of an on-call rotation tasked with 24/7 response to site operability issues, leading engineering-wide troubleshooting and remediation for all incidents.

New York, Ny, Us

One of two operations engineers responsible for the growth and maintenance of production infrastructure.

New York, Ny, Us

Boston, Massachusetts, Us