Beyond the Phoenix Project: The Origins and Evolution of DevOps
Gene Kim and I discuss some of the origins of DevOps through the lens of Dr. Deming and Dr. Goldratt.
Out of the Crisis – What Would Deming Do? – Techstrong Con 2022
In 1982 Dr. Edwards Deming published a book called “Out of the Crisis.” dealing with his frustration leading up from the prior decade. He was 82 years old; he wasn’t writing this as a get-rich management consulting book. Dr. Deming wrote it as a stark warning for everyone, manufacturing, healthcare, government, and education alike. Fast forward forty years, and imagine what he would say today if he were alive. Take, for example, the Knight Capital story, a configuration mistake in a High Frequency Trading (HFT) algorithm that purchased an errant 150 different stocks in 45 minutes, at a total cost of around $7 billion. In this presentation, we will look at the Knight Capital incident through some fundamental DevOps principles with the lens of Dr. Demings System of Profound Knowledge.
Some Swan Talk
On Linkedin today, my friend Laksh Raghavan discussed the concept of Black Swans. Several years ago, I wrote some old blog posts about this topic. Please accept my apology for the following old blog posts scientific voracity. I was just trying to have me some fun.
Enumerated and Analytical Statistics (Part 1)
Dr. Deming introduced the distinction between what he called enumerated and analytical use of data in his 1950 book "Some Theory of Sampling." Dr. Deming often discussed enumerated versus analytical statistical studies throughout his career. According to him, statistical data should be used to provide a rational basis for actions. He repeatedly emphasized the consequences of failing to distinguish between enumerated and analytical statistics. Essentially, enumerative studies are concerned with categorizing data. For example, how many software builds failed? The purpose of analytical studies is to determine cause and effect based on data (i.e., to build theories explaining why the data is the way it is).
Supply Chain the Missing Link
I was researching post-World War II Sarashon and CCS contributions to Japan this morning based on this paper (https://www.jstor.org/stable/27919728). In addition, I listened to Katie Anderson's excellent book Learning to Lead, Leading to Learn this morning while working out. Then it hit me, Toyota's supply chain success can be traced back to a very recognizable thread.
Which Came First, the Chicken or the Egg?
Denso may be unfamiliar to you, but I suggest you are familiar with their products. Your car is likely heated or cooled by Denso. Founded in 1949, the company is the world's second-largest supplier to automotive OEMs by revenue (as of 2018). A lesser-known fact is that a Denso employee invented QR codes in 1994. Known initially as Nippon Electrical Equipments Co. Ltd. Denso was founded as a stand-alone company separate from Toyota Motor Company. Later, they changed their name to Nippon Denso, and today they are known as Denso.
The Miracle at Toyota
Hearing the different perspectives and opinions about what I call the Miracle at Toyota is interesting. Many people credit Taiichi Ohno with the success of the Toyota Production System. Toyota, however, was also influenced by Shigeo Shingo. Ohno implemented Just In Time (JIT), the Andon Chord, and his infamous seven wastes. Shingo was responsible for several innovations, the least of which was the Single-Minute Exchange of Die (SMED).
Dr. Deming played an essential role in Toyota's success as well. Several people have disputed Deming's influence, which is odd because Toyota was obsessed with Total Quality Control (TQC) as far back as the late 1950s.
Deming and Toyota
There seems to be a school of "Lean" that denies that Dr. Deming had any influence on Toyota. Aside from the fact that Dr. Deming has had a documented role in Japan's economic recovery starting in 1950. Not to mention the Deming Prize Toyota won in 1965. As well as Shoichiro Toyoda's quote, "There is not a day that goes by that I do not think about what Dr. Deming means to our management."
Enumerated and Analytical Statistics
Deming often spoke about the need for management to understand the difference between enumerated and analytical statistics. Statistics based on enumeration produce information. It tells us what we have, how much, or how many. Surveys of customers or employees are enumerated studies. Censuses are based on enumerated statistics. An analytical study aims to improve the process that produced the material studied based on historical information. Using analytical statistics, we can learn something that will help us improve future products or services.
A Tale of Two Cities (Profound)
n the IT world, they sometimes refer to the Red Queen’s Race from when Alice went back to Wonderland. The Red Queen and Alice ran like the wind. When they stopped, to the little girl’s astonishment they were exactly where they’d started.
Great Deming’s Ghost
It has often crossed my mind how angry Dr. Deming would be if he were to come back in 2022 and see that the Red Bead Experiment hasn't changed for over 40 years.
The Best-Laid Improvements of Mice and Men Often Go Awry
In the 1980s, you could say that the notorious Charles Koch was obsessed with Edwards Deming. Charles Koch joined his father's business, Rock Island Oil & Refining Company (now Koch Industries), in 1961. Koch became president of the company in 1967. In a legal battle with his brothers, Frederick and Bill sold their stakes for $1.1 billion, and Charles and David gained majority ownership. In his 2007 book, "The Science of Success: How Market-Based Management Built the World's Largest Private Company," Charles Koch cites Dr. Deming as an important influence. Charles Koch started applying Deming's methods to Koch Industries in the early 1980s. Koch said that Deming was more than a business consultant; he was a Guru.
The Myth of Measurement
According to Peter Drucker, you can't manage what you can't measure. Dr. Deming is also often credited with this quote. Deming clarified his point in his last book, written in 1993 at 93. According to him, it is a costly myth to assume that if you can't measure it, you can't manage it. He said, "It is wrong to suppose that if you can't measure it, you can't manage it."
ED - Rediscovering a WWII Statistician& Why We Need His Ideas to Survive the Digital Age
Ten years ago, I decided to write a book about William Edwards Deming. There were already 25 books about him at the time, but all of them were biographies. While researching Dr. Deming, I found some interesting stories that weren't directly about him. The stories are mostly based on his experiences and those around him. But most of the information about these stories is only in a few of the books about Dr. Deming. Those books focus on his linear biography and management methods and ideas. To understand Dr. Deming's ideas about management, you need to know about the experiences that led him to develop these ideas. His innovations have helped many organizations, including Apple, Amazon, the Obama election team, and US Homeland Security Operation Warp Speed. To write a complete biography of Dr. Deming, you need to cover his life's experiences in detail. Even today, many Americans do not know who Dr. Deming was, even though his work has had a significant impact on everyone in America.
What Would Deming Do - Incident Management?
What would Dr. Deming do if he walked into a bank in 2022 and was asked to assess the handling of incidents? He might have recalled what Dr. Shewart did in 1924 when he conceived of Statistical Process Control (SPC). He would assert that quality problems should be solved using mathematics. Defects were inspected manually and categorized into go/nogo groups before Shewhart's SPC. Based on the specifics of the part and the acceptable tolerance levels, there could be over two categories.
Origins of Elastic Cloud Compute (EC2)
Amazon's cloud services have been the subject of many articles. The book Working Backwards explains how Amazon Web Services came to be. Only two of the initial half-dozen services were successful, Simple Storage Service (S3) and Elastic Cloud Computing (EC2). EC2 is at the core of what we consider Amazon's cloud computing service. Without EC2, Amazon's "cloud" would not be a cloud. Previously, developers had to request a physical or virtual server if they needed a computer. Virtual servers were much easier to obtain than physical servers; however, getting a virtual computer still required installing and maintaining a physical set of servers. The virtual server is a physical server that appears as one or more virtual servers.
Joe’s Adventures
I had a software developer named Joe who worked for me at one of my software startups. Joe was one of the best developers I have ever worked with. However, Joe had one annoying habit; he arrived late to work every day and missed the first 10 to 15 minutes of our daily 30-minute call. And to make matters worse, he explained why he was always late. 'You wouldn't believe what happened to me today,' he would say. With Joe's lateness and his regaling of the experience, we would lose, on average, 20 minutes out of every 30-minute morning meeting. For him, every morning was a special event that he couldn't control. Lecturing Joe didn't help. Joe's firing was out of the question; he was too valuable to the team.
Schmear Apocalypse
It was impossible to find cream cheese at the grocery store near the end of 2021. What appeared to be a mild inconvenience could be a symptom of a much larger problem. Not having cream cheese schmear on your bagel is one of the thousands of unseen combinatorial secondary effects of the pandemic. Abraham Maslow published a paper titled "A Theory of Human Motivation" in 1943. Maslow expanded the concept to include observations on human needs, referred to as Maslow's hierarchy of needs. Physiological needs such as water, warmth, and food are at the bottom of the pyramid. There have been recent cyberattacks on water treatment facilities, US power grids, and the food supply. In May 2021, the world's largest meat processing company, JBS, paid the equivalent of $11m for a ransomware attack.
Deming Point #6 and the Flaw of Averages
Assumptions based on averages are incorrect on average. In a famous cartoon by Jeff Danziger, titled the Flaw of Averages, an incident is portrayed regarding a statistician who drowned while crossing a river that was, on average, only three feet deep. Although the average depth of the water was three feet, the man who drowned was seven feet underwater.