DevOps “Look-Fors”: Five Milestones for the Three Ways
A few months ago, colleague Aliza published a quick overview of five KPIs you can use to assess how well DevOps culture and practices are taking root in your organization:
- Deployment frequency
- Speed of deployment
- Deployment success rate
- How quickly service can be restored after a failed deployment
- Culture (which you really can't measure)
The KPIs came from respondents to our 2013 State of DevOps survey, who said those were their most important measures of improvement.
The KPIs our respondents were reporting could easily turn up as a small part of his milestones, which are less about mandating certain metrics than they are helping you figure out what you should expect to see as your teams climb out of a state of chaos -- "unable to predict how long common tasks take to complete" and "the team can't enumerate all the processes a team does (even at a high level)" -- and progress to better states: "dashboards show defect and rework counts" and "cycle time enjoys month-over-month improvements."
It's a comprehensive list -- almost 50 look-fors over the five milestones. It ends with a useful reminder, lest you get it in your head that he's trying to sell you a top secret DevOps decoder ring:
"DevOps culture is about doing things because there is a need and a problem to be fixed. There are no "rules" for DevOps, only guidelines, best practices and techniques that can be deployed. Contrast this to process-heavy systems encourage people to do things because some book says you have to do them. Such systems often results in management cargo cult where you do things out of blind obligation.
"DevOps is a culture, not a system of "rules" that must be blindly obeyed. Therefore these "look for's" are not rules. A team should not try to "check every box". If management gives you a bad performance review because they can't find evidence of everything on the list, they're doing it wrong. These are not the only look for's, there are simply the ones that I have found work for me."
- Download our 2013 State of DevOps survey findings, which include recommendations on how to bring DevOps practices to your own organization
- Read about the 25/75 mix of technology and culture DevOps practices require
- Learn how DevOps isn't just for the Valley: People are embracing DevOps practices and culture everywhere