Since the Large Hadron Collider (LHC) started making news in 2008, CERN has become a household name – and not just among science enthusiasts. Responsible for a network of half-a-dozen particle accelerators, CERN has been providing the world with cutting-edge science and research since it was founded in the 1950s. Discovery of the Higgs boson or “God particle” led to two CERN scientists, Peter Higgs and François Englert, receiving the Nobel Prize for physics in 2013.
There are about 2,500 scientific, technical, and administrative staff members at CERN. They also host about 12,000 users, all of which requires an impressive IT infrastructure. In addition to all of the users, CERN deals with an incredible amount of data. In 2017, they passed the 200 petabyte milestone. Their accelerators and experiments had by then recorded data equal to 680 years of constant full HD video.
At-scale automation is a must
CERN has grown so large that it simply cannot function without automation. In 2011, CERN adopted Puppet to manage their growing infrastructure. With Puppet, the CERN IT team now automates over 40,000 managed nodes with more than 100 virtual servers to provide the necessary infrastructure support.
Check out this Puppetize Live talk presented by David Moreno García, a DevOps engineer at CERN, where he discusses the scale of infrastructure at CERN.
Keeping the scientists happy and experiments running smoothly is one of the priorities for IT at CERN. This presents unique challenges, however. Research projects at CERN deal with staggering amounts of data, and it requires massive compute resources to process and analyze it all. The LHC accelerates protons through its 27 km circular tunnel to 299,792,455 m/s – just 3 m/s shy of the speed of light – and slams them together at energies surpassing one trillion electron volts. 40 million particle collisions can happen every second. All of this data needs to be analyzed!
Everyday automation lowers costs, improves monitoring
Puppet automates the provisioning and decommissioning of thousands of virtual servers every day at CERN. With this level of automation, the rate of managed services per DevOps personnel has increased substantially. Though the number of members in the IT department at CERN has remained stable, they have been able to enhance IT functionality, improve monitoring, and offer more services.
Automation has also reduced the number of support calls received by the IT team. In 2011, before adopting Puppet, the system administration team dealt with 60,000 tickets. This number has fallen to just a few hundred. Automation enables them to continuously introduce service changes while minimizing service disruption. This gives them time to develop better software to serve the physics community while building more resources for CERN researchers.
At Puppet, we are thrilled to know that our automation technology helps make the most important physics research in the world possible.
Andrew Nhem is the managing editor of the Puppet blog.