{"id":8759,"date":"2010-01-08T09:28:43","date_gmt":"2010-01-08T15:28:43","guid":{"rendered":"http:\/\/rankexploits.com\/musings\/?p=8759"},"modified":"2010-01-08T22:06:22","modified_gmt":"2010-01-09T04:06:22","slug":"multi-run-mean-ar4-projections-statistically-significant-from-observations-from-50-6070-00-and-01","status":"publish","type":"post","link":"https:\/\/rankexploits.com\/musings\/2010\/multi-run-mean-ar4-projections-statistically-significant-from-observations-from-50-6070-00-and-01\/","title":{"rendered":"Multi-Run Mean AR4 Projections: Statistically Significant from Observations from &#8217;50, &#8217;60, &#8217;70, &#8217;00 and &#8217;01."},"content":{"rendered":"<p>It has come to my attention that a certain blog-climate warrior has now decided to get back to work adjusting analysis to include factors that will widen error bars while doing things in ways that do a poor job of incorporating explanatory factors that would narrow the error bars.   So, I decided I might as well go ahead and extend my own uncertainty analysis.    In an unprecedented move, The Blackboard will now present final results first and explain the method afterwards.  <\/p>\n<p>The graph below shows uncertainty in the trend computed based on the <i>difference<\/i> between the multi-run mean computed from a series of AR4 models used for projections and the observations from Hadley.   If the multi-model run consisted of the average over runs that perfectly captured the earth&#8217;s climate response to externally applied forcings, we would expect the mean trend to be equal to zero, or at least the value of zero would lie within the uncertainty intervals.  <\/p>\n<figure id=\"attachment_8761\" aria-describedby=\"caption-attachment-8761\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/NewUncertaintyIntervals.jpg\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/NewUncertaintyIntervals-500x341.jpg\" alt=\"Figure 1: Least Squares Trends in difference between observations and multi-run mean projection.\" title=\"NewUncertaintyIntervals\" width=\"500\" height=\"341\" class=\"size-medium wp-image-8761\" srcset=\"https:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/NewUncertaintyIntervals-500x341.jpg 500w, https:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/NewUncertaintyIntervals-300x205.jpg 300w, https:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/NewUncertaintyIntervals-1024x700.jpg 1024w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/a><figcaption id=\"caption-attachment-8761\" class=\"wp-caption-text\">Figure 1: Least Squares Trends in difference between observations and multi-run mean projectoin.<\/figcaption><\/figure>\n<p>Inspection of the graph indicates that, when analyzed this way, the difference between observations and a multi-run mean from an ensemble of runs used in the AR4  is negative (suggesting the  models over-project warming) and moreover, the difference is statistically significant if we happen to start our analysis in &#8217;50, &#8217;60, &#8217;70, &#8217;00, or &#8217;01. However, the difference is not statistically significant if we begin analysis in &#8217;80 or &#8217;90.  <\/p>\n<p>The result are such that currently, the data permit cherry pickers to decide certain &#8220;key&#8221; years are the &#8216;right&#8217; ones to begin analysis. It is worth nothing however, that analyses beginning prior to 2001 include comparison of &#8220;predictions\/projections&#8221; to &#8220;observations&#8221; that were not only available prior to making the &#8220;predictions&#8221;, but also available prior to freezing of the Scenarios used to create projections into the future.  So, the projection period after 2001 has a special status relative to the period prior to 2001.   For this reason, I favor 2001 as a start year&#8211; though of course others are permitted to have their own favorite start year for reasons of their own.<\/p>\n<p>I&#8217;m will be deferring full discussion of analytical choices to later (fairly long) blog posts. However, the synopsis is that :<\/p>\n<ol>\n<li>The analysis uses monthly values for observations and projections in surface temperature. This is because it can be shown that when both monthly and anual average data are available, analysis using monthly data almost always has lower Type II error at a given choice of Type I error. <\/li>\n<li>The multi-run mean is based on an ensemble of runs used in the IPCC AR4, downloaded from the Climate Explorer. The selected runs were forced using modelers choice for the 20th century and extended into the 20th century using the A1B scenarios.<\/li>\n<li>The analysis accounts for the effects of volcanic forcing on the temperature excursions in a <i>more phenomenologically realistic way<\/i> than the rather unphysical linear regression of volcanic aerosols with time.<\/li>\n<li>The analysis accounts for the correction due to ENSO using the <a href=\"http:\/\/www.esrl.noaa.gov\/psd\/people\/klaus.wolter\/MEI\/table.html\">MEI.<\/a> I don&#8217;t know if this choice minimize the uncertainty intervals&#8211; I selected it because&#8230;well&#8230; someone else did. \ud83d\ude42 <\/li>\n<li>The analysis assumes the autocorrelation of temperature with time varies as it would if the residuals can be described using an ARMA(1,1) process.<\/li>\n<li>Analysis uses all data from the &#8216;start year&#8217; indicated through Nov. 2009.  Most start years are January for decades beginning with &#8216;0&#8217;; this choice is modified for 1950, because the method for correcting for MEI does not permit starting in January.<\/li>\n<\/ol>\n<p>For those who are curious about the rankings of annual average temperatures basd on the same analysis, after adjusting for MEI and any nonlinear response due to exogenous forcings, I&#8217;ve reconstituted and plotted them below.  <\/p>\n<figure id=\"attachment_8766\" aria-describedby=\"caption-attachment-8766\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/AnnualAveTempeartures.jpg\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/rankexploits.com\/musings\/wp-content\/uploads\/2010\/01\/AnnualAveTempeartures-500x341.jpg\" alt=\"Figure 2: Corrected Annual Average Surface Temperatures\" title=\"AnnualAveTempeartures\" width=\"500\" height=\"341\" class=\"size-medium wp-image-8766\" \/><\/a><figcaption id=\"caption-attachment-8766\" class=\"wp-caption-text\">Figure 2: Corrected Annual Average Surface Temperatures<\/figcaption><\/figure>\n<p>After adjusting for MEI &#038; etc. I find 2009 had the third warmest temperature on record&#8211; whatever that means. (I don&#8217;t like to compare adjusted years since the result varies according to the adjustment method. We should really include uncertainty intervals in any sort of comparison of this type; if we did, we could conclude that the MEI adjusted temperature has been quite flat this century.)<\/p>\n<p>Over the course of the next two weeks, I&#8217;ll be posting discussion of each important analytical choice to let you critique them. But, I thought I&#8217;d let all &#8216;a y&#8217;all see the almost-end-year results first.  When GISS and Hadley post their December data, I&#8217;ll update the final results for the year.  <\/p>\n","protected":false},"excerpt":{"rendered":"<p>It has come to my attention that a certain blog-climate warrior has now decided to get back to work adjusting analysis to include factors that will widen error bars while doing things in ways that do a poor job of incorporating explanatory factors that would narrow the error bars. So, I decided I might as &hellip; <a href=\"https:\/\/rankexploits.com\/musings\/2010\/multi-run-mean-ar4-projections-statistically-significant-from-observations-from-50-6070-00-and-01\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Multi-Run Mean AR4 Projections: Statistically Significant from Observations from &#8217;50, &#8217;60, &#8217;70, &#8217;00 and &#8217;01.<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[15],"tags":[312,451],"class_list":["post-8759","post","type-post","status-publish","format-standard","hentry","category-data-comparisons","tag-aogcm","tag-statistics"],"_links":{"self":[{"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/posts\/8759","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/comments?post=8759"}],"version-history":[{"count":0,"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/posts\/8759\/revisions"}],"wp:attachment":[{"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/media?parent=8759"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/categories?post=8759"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rankexploits.com\/musings\/wp-json\/wp\/v2\/tags?post=8759"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}