{"id":4965,"date":"2020-08-06T06:00:33","date_gmt":"2020-08-06T12:00:33","guid":{"rendered":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/?p=4965"},"modified":"2022-08-23T15:31:35","modified_gmt":"2022-08-23T21:31:35","slug":"weather-you-can-have-too-much-data","status":"publish","type":"post","link":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/weather-you-can-have-too-much-data\/","title":{"rendered":"&#8220;Weather&#8221; you can have too much data&#8230;"},"content":{"rendered":"<p><!--\u2013\u2013 BEGIN MAIN ARTICLE \u2013\u2013--><br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"templateImage\" style=\"text-align: -webkit-center; background-color: #ffffff; border-width: 0px; border-style: solid;\" src=\"https:\/\/secure.campaigner.com\/media\/43\/439070\/QI%20Macros%20newsletter\/winter-1992027_640%20560x392.jpg?g=1596680564294\" alt=\"winter-1992027_640 560x392.jpg\" width=\"560\" height=\"392\" align=\"top\" \/><br \/>\nI think it was Will Rogers who once said, &#8220;A half truth is like a half brick &#8211; it carries better.&#8221; Being a Freelance Quality Improvement Specialist, I&#8217;ve had to overcome more than my share of half truths in my career. An example of one of the most frequent half truths I encounter happened just this month.<\/p>\n<p>While consulting with a plant that produced industrial cardboard, I asked them to send over their data.\u00a0They submitted the data they were tracking: each tab in the spreadsheet had almost a dozen metrics, and each metric had almost 6,000 data points\u2026 some dating back over 4 years ago. I contacted the client on a video call and and asked about the size of the data set.<\/p>\n<p>&#8220;Charlie, I just got the data file,&#8221; I opened.<\/p>\n<p>&#8220;Yeah? Impressive, isn&#8217;t it?&#8221; asked Charlie, the foreman. He looked proud. &#8220;I bet none of your other clients have as much data as we do, do they? I told you: We&#8217;re serious about improvement. That&#8217;s why we keep so much data.&#8221;<\/p>\n<p>&#8220;Okay, that&#8217;s fine,&#8221; I offered. &#8220;However, I&#8217;m not going to need to use much of this in order to move forward. We need to get a plan in place to limit the amount of data you&#8217;re using to track your processes.&#8221;<\/p>\n<p>&#8220;What do you mean?&#8221; asked Charlie.\u00a0\u201cWe need to track all of this data. We have this data; why wouldn\u2019t we track it all?\u201d<\/p>\n<p>&#8220;Because you have too much data.&#8221; I replied.<\/p>\n<p>&#8220;How can you possibly have too much data?&#8221; was the response.<\/p>\n<p>Charlie had fallen into one of the classic half-truths: &#8220;You can never have too much of a good thing.&#8221; Everybody knows this isn&#8217;t true. If the recipe calls for a tablespoon of salt and you put in 2 cups of salt, it won&#8217;t taste better. Still, it&#8217;s tough for people to know when the &#8220;rule of thumb&#8221; they learned doesn&#8217;t apply any longer. I thought quickly and looked up some figures while I had Charlie on the video call.<\/p>\n<p>&#8220;Charlie, I&#8217;ve seen you wearing your Green Bay Packers jersey around at Pareto&#8217;s Big Bar watching the games, right?&#8221; I asked.<\/p>\n<p>&#8220;You sure have. I was born and raised there in Green Bay, Wisconsin. It&#8217;s in my blood.&#8221; he replied.<\/p>\n<p>&#8220;So you know Green Bay weather, right?&#8221; I asked.<\/p>\n<p>&#8220;Of course! It&#8217;s a beautiful place. The summers are pleasant, and the winters drive away everyone but the die-hards,&#8221; he chuckled.<\/p>\n<p>&#8220;Charlie, I&#8217;m going to share my screen,&#8221; I said. When I clicked the button, this appeared on his screen:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"templateImage\" style=\"color: #333333; font-family: Arial, Helvetica, sans-serif; font-size: 13px; background-color: #ffffff;\" src=\"https:\/\/secure.campaigner.com\/media\/43\/439070\/Test%20images\/Green%20Bay%20Max%20Temps%202017.png?g=1596673665681\" alt=\"Green Bay Max Temps 2017.png\" width=\"560\" height=\"246\" \/><\/p>\n<p>&#8220;Charlie, I found a listing of a year&#8217;s worth of daily high temperature data online. This is from a couple years back, but would you say that this is accurate?&#8221; I asked.<\/p>\n<p>&#8220;Sure&#8230; that looks about right. What about it?&#8221; Charlie asked.<\/p>\n<p>&#8220;Well, if we used yearly data,\u00a0the average daily high temperature is 54.8 degrees, right?<\/p>\n<p>&#8220;That&#8217;s about right,&#8221; replied Charlie.<\/p>\n<p>&#8220;And if I used the 3-sigma control limits calculated from this yearly data to make my decisions, I should be comfortable every day of the year as long as I dress for weather that&#8217;s between about 40 degrees and 69 degrees&#8230; is that right?&#8221; I asked.<\/p>\n<p>&#8220;Well, some of the time, sure&#8230; but you&#8217;re gonna be awful cold in the winter, and you&#8217;re gonna be awful sweaty for most of the summer if you do that!&#8221; Charlie chuckled.<\/p>\n<p>&#8220;Why is that?&#8221; I asked.<\/p>\n<p>&#8220;Well, you can&#8217;t just use yearly temperature averages! You&#8217;ve got to&#8230;&#8221; Charlie&#8217;s voice trailed off as he realized my point.<\/p>\n<p>&#8220;You&#8217;ve got to&#8230; what?&#8221; I pressed.<\/p>\n<p>&#8220;You&#8217;ve got to only take the current month into consideration,&#8221; he finished, his voice dropping low.<\/p>\n<p>&#8220;Exactly. When you&#8217;re preparing for this week&#8217;s temperatures, it&#8217;s more useful to know what happened last week and the week before than knowing what happened six months ago, right?&#8221; I prodded.<\/p>\n<p>&#8220;Yeah, that&#8217;s right.&#8221;<\/p>\n<p>I continued. &#8220;And so you see why taking into account data that happened on a production run four years ago isn&#8217;t exactly as useful as data that happened more recently?&#8221;<\/p>\n<p>I could see Charlie nodding, and I switched by screen to a focus on a single month.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"templateImage\" style=\"color: #333333; font-family: Arial, Helvetica, sans-serif; font-size: 13px; background-color: #ffffff;\" src=\"https:\/\/secure.campaigner.com\/media\/43\/439070\/Test%20images\/January%202017%20Max%20Temps.png?g=1596673712311\" alt=\"January 2017 Max Temps.png\" width=\"560\" height=\"246\" \/><\/p>\n<p>&#8220;So let&#8217;s say I was visiting Green Bay in January. Would I be better prepared than the previous example if I instead dressed for a day that&#8217;s between 14 degrees and 40 degrees?&#8221;<\/p>\n<p>Charlie kept nodding. &#8220;Yep. Gotcha.&#8221;<\/p>\n<p>&#8220;Now,&#8221; I said, moving forward. &#8220;Fortunately, QI Macros has rolling templates where you can continue to have all that data, but it only takes the most recent X days into account when determining your average and control limits. You can set that to track 30 days, 80 days&#8230; whatever makes sense for you. It&#8217;ll update automatically when you add new data.&#8221;<\/p>\n<p>&#8220;Really?&#8221; Charlie replied. &#8220;That sounds great.&#8221;<\/p>\n<p>&#8220;You bet. I&#8217;ll set it up for you and show you how to continue to use it. It&#8217;ll be as easy as&#8230;&#8221;<\/p>\n<p>&#8220;&#8230;as easy as beating the Bears at Lambeau Field?&#8221; he asked.<\/p>\n<p>I laughed. &#8220;Well, considering the current streak between those two teams, I&#8217;m not sure it will be quite <em>that <\/em>easy&#8230; but it&#8217;ll be close.&#8221;<\/p>\n<p>&#8220;That&#8217;s good enough for me,&#8221; Charlie said. &#8220;Thanks a lot!&#8221;<\/p>\n<p><em>If you&#8217;re interested in learning more about QI Macros Rolling chart templates, click\u00a0<a id=\"auto_assign_link_num_32\" href=\"https:\/\/www.qimacros.com\/control-chart\/control-chart-rolling-templates\/\" name=\"Pareto Chart text link 1\">HERE<\/a>\u00a0and\u00a0<a id=\"auto_assign_link_num_45\" href=\"https:\/\/www.qimacros.com\/control-chart\/moving-average-chart-template\/\" name=\"Pareto Chart text link 3\">HERE<\/a> to learn more. <\/em><\/p>\n<p><!--\u2013\u2013 END MAIN ARTICLE \u2013\u2013--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I think it was Will Rogers who once said, &ldquo;A half truth is like a half brick &ndash; it carries better.&rdquo; Being a Freelance Quality Improvement Specialist, I&rsquo;ve had to overcome more than my share of half truths in my career. An example of one of the most frequent half truths I encounter happened just [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[407],"tags":[],"class_list":["post-4965","post","type-post","status-publish","format-standard","hentry","category-qi-macros-monthly-newsletters"],"_links":{"self":[{"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/posts\/4965","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/comments?post=4965"}],"version-history":[{"count":7,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/posts\/4965\/revisions"}],"predecessor-version":[{"id":5991,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/posts\/4965\/revisions\/5991"}],"wp:attachment":[{"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/media?parent=4965"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/categories?post=4965"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.qimacros.com\/lean-six-sigma-blog\/wp-json\/wp\/v2\/tags?post=4965"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}