Today, once again, I will show that Dr. Pielke Sr. is correct:
Why am I writing my third post on this?
Because, in response to my second post, a vistor in comments suggested that mine analysis had been refuted by Horatio Algernon’s attempted to estimate the size of the effect. Horatio concluded the effect is minuscule: this is incorrect. The incorrect answer was then disseminated in comments at a variety of places, and I think I need to illustrate the correct result here. (Horatio found his error and posted while I was writing this.)
For those who are fascinated by the entire “Series Expansion Kerfuffle”, this third analysis will have a side benefit: I will show that the terms I identified in the previous blog post on this subject, give a rather decent estimate of the effect of spatial variations on the anomalous forcing for the earth’s climate’s anomalous energy balance.
In today’s post, before embarking on “the boring proof”, I will discuss the the precise way in which this issue is important, so as to put it in context.
In what sense is this important? Empirical Estimates of Climate Sensitivity.
Recall the issue is dispute is a very precise one. The question is whether it is possible to obtain accurate estimates of climate sensitivity λ using this approximate equation and data for T’ alone.
where H is the heat content of the earth’s climate system, f is the anomalous radiation forcing the climate and is defined relative to a reference baseline, and T’ is the global means surface temperature anomaly, also defined relative to a reerence baseline.
How is the anomalous energy budget used?
This equation is referred to as th anomalous radiation budget from the earth, which was labeled equation (1) in both Dr. Pielke’s article, and Eli Rabett’s article. In this equation
This equation has been used by a variety of scientist to estimate climate sensitivity, λ, from empirical data, including for example James Hansen, (2003) who, using the quasi-steady assumption, estimated λ= 3/4 ± 1/4 °C per W/m2. Dr. Hansen, of NASA GISS, considered this empirical estimate sufficiently important to highlight with the attractive graphic shown to the left; he also took the time to compare the accuracy of estimates based on climate models to empirically based methods using these words:
Although climate models yield a similar climate sensitivity, the empirical result is more precise and reliable because it includes all the processes operating in the real world, even those we have not yet been smart enough to include in the models.
Others who have published estimates of λ based on empirical data for T’ include: Gregory et al. (2002) and Schwartz (2007). An alternative way equation (1) can be used is shown in, Raper et al. (2002) where a form of equation (1), with the approximation discussed here, was used to estimate the heat uptake of the ocean.
Note that, in the case of Raper et al. (2002), the estimate of climate sensitivity λ comes from GCM’s which do not use (1) in their radiation balance model. However, the approximate equation (1) was subsequently used outside the context of a GCM to estimate the current magnitude of dH/dt. When (1) is used to post-process output of GCM data in this way, treating it as “data”, then uncertainty is introduced in the subsequent estimate.
Why?
Because, even if λ is perfectly estimated by GCMs, the approximation Qrad~T’/λ remains somewhat inaccurate in equation (1). Consequently, if (1) is used to estimate any other quantity during post processing, uncertainty is introduced during the post processing. In the case of Raper et al. (2002) the uncertainty would be introduced into the estimate of the uptake of heat in the ocean.
In that particular case, the uncertainty in equation (1) would in turn, affect climate scientists ability to estimate how much heat is “in the pipeline”.
So, we can see that equation (1) not only appears in the IPCC TAR, it is also used in various ways by climate scientists when they are trying to gain understanding of the earth’s climate response, and when they try to make projections of future behavior.
On to the boring equations!
The boring equation part will explore this question only: How much error is introduced in the anomalous radiation emitted from the earth’s surface by using the approximation Qrad= T’/λ where T’ is the anomaly in the global mean surface temperature (GMST) and λ is the climate sensitivity? Those familiar with the physics of radiation know that for a surface with a spatially invariant emissivity, the full expression for the radiative anomaly Qrad is
where σ is the Stefan-Boltzman constant, ε is the emissivity of the earth’s surface and A is the surface area of the earth, T is the spatially varying temperature of the earth and and To is the spatially varying temperature in a baseline case .
Some will recall that in my previous post, I suggested that, mathematically, this approximation holds to leading order in temperature differences, (indicated with primes),
I immediately suggested that <δTo2>/<To>2<<1. So, as a practical matter, the following approximation was suitable for the earth's climate:
where the terms in bold are additional terms that I believe should be included in the anomalous budget for the earth’s climate system when it is used to obtain estimates of items of interest to climate scientists, for example, climate sensitivity, λ.
I then performed a back of the envelop calculation to illustrate the magnitude of the terms in bold is roughly 15%-25% that of the T’ /λ term. When (1) is used to estimate λ, the error introduced by the approximation introduced an uncertainty of ±0.7K in the estimate for the climate sensitivity to doubled CO2; this is one half the full uncertainty in the estimate for climate sensitivity to doubled CO2, which the IPCC report estimates to fall between 1.5K and 4.5K.
However, my argument, based on a series expansion, and a back of the envelop estimate, did not convince all. In particular, Horatio Algernon, suggested that my math could be dis-proven using a simple thought experiment.
Horatio’s Thought Experiment
Horatio Algernon proposed that we could test whether or not spatial variations of the earth’s temperature contribute significantly to anomalous forcing by comparing three cases to the following baseline case:
Baseline case:
Let us assume the earth’s surface temperature temperature varies only with latitude and obeys this functional relationship:
where Tr is a reference temperature, required to specify the problem, ΔT is the half the temperature difference from pole to equator and φ is the polar angle. Horatio suggested that we use Tr=275K, and ΔT = 25K as the base-case. (I will henceforth add subscripts ‘o’ to all quantities corresponding to the basecase.
For this baseline, we can find the average temperature by integrating over area. Because temperature varies only with latitude, the integral formulation for the average is:
From now on, I will often express the area integral using <>, which is more compact. This symbol is commonly used as an averaging operator. So, by definition:
for any quantity ‘Y’.
To obtain the average temperature, (5) can be integrated however you wish. Because additional more complicated integrals are coming up, I did so numerically. Using the reference values Tro= 275K, and ΔTo = 25K, the area average of the surface temperature is <To>= 288.3 K.
Next, using the previously described based case, Horatio suggested we compare the anomalous radiation balance for three cases; which I will modify slightly to match values I consider more applicable to the earth’s surface temperature:
- Case 1: The temperature profile of the earth’s surface temperature shifts such that the average temperature remains <T>= 288.3 K but the temperature of the pole warms 1 K relative to the mean and the temperature of the equator decreases 1K relative to the mean. For this case T’=0K, and ΔT = 23K. (Note, from a computation point of view, when ΔT changes, the this case the reference temperature of Tr must be adjusted to maintain <T>= 288.3 K.)
- Case 2: The temperature of the earth’s surface increases +0.6 K everywhere. That is, T’=+0.6K; ΔT = 25K. 1
- Case 3: The earth’s GMST temperature rises +1K, and the poles warm 1K relative to the equator. So, T’=1K; ΔT = 23K
Horatio suggested that we compare the anomalous forcing estimated in Case 2 is approximately equation to Case 3. If it is, then the extra terms I propose in equation (2) don’t matter. However, the two don’t match, then the extra terms, which correspond to the temperature shift in Case 1, do matter.
Let’s just do it with no approximation!
Calculate the total radiation loss and anomalous forcing.
Returning to explicit integral formulation for averaging, for a surface with constant emissivity of 1, the total energy emitted per unit area is:
This can be integrated a number of ways. I did so numerically and obtained Fo= 3.7E+02 W/m^2 ; this is included in table 1 below and represents the base case. The results for cases 1-3, using appropriate values for Tr and ΔT are also included.
Note when examining total forcing, Fo, the differences between all cases are less 1%.
To obtain the anomalous forcing of interest in equation (1) and to this whole discussion, we subtract the total forcing in the base case from that found in any other case. The values for f=F-Fo are shown in table 1.
| Case | <T> K |
ΔT K |
F Watt/m2 |
T’ =<T>-<To> K |
f = F-Fo Watt/m2 |
% |
| Base Case | 283.33 | 25 | 3.71E+02 | 0 | 0 | — |
| Case 1 | 283.33 | 23 | 3.72E+02 | 0 | 0.5 | 13% |
| Case 2 | 283.93 | 25 | 3.74E+02 | 0.6 | 3.1 | 87% |
| Case 3 | 283.93 | 23 | 3.75E+02 | 0.6 | 3.6 | 100% |
Now, let us compare the error introduced by neglecting spatial variation in the earth’s surface temperature when estimating the anomalous forcing. This can be done by comparing the anomalous forcing for case 2 to case 3. Examining the table, we see that case 2 captures only 87% of the total forcing in case 3.
This means that if we fail to account for the spatial variations in temperature in this case, we will introduce an error of 13% in any estimate of the climate sensitivity obtained using equation (1).
How does this compare to the estimate based on Lucia’s Series Expansion?
I know anyone who plowed through this far now wishes to discover how the today’s 13% error compares to the estimate based on my series expansion. It’s easy enough to compute for any particular profile.
Recall, in my earlier post, I said the ratio of the effect of the temperature shift alone to that of a uniform increase in the earth’s surface temperature could be estimated using the equation:
So, for this profile, I computed the covariance <δToδT’>= 8.9K^2numerically for case 3 Inserting, I find f1/f2 ~ 16.2%; this corresponds rather well with f1/f2 =15.3% found using the exact computation. ( The difference, which results in an error of roughly 1% when computed the desired value f2, is easily attributed to the <δTo2> terms whose contribution I advised neglecting as small.)
So, this exercise confirms that
- The spatial variations in temperature do matter when one uses IPCC equation (1) to study the anomaly in the earth’s energy balance. (That is: Dr. Pielke Sr. is correct.)
- The terms I suggested result in a reasonable approximation of this effect.
So, why did Horatio get the wrong answer.
On the one hand, I’d like to simply say “Mistakes were made.” and leave it at that. (While i was typing this, Horatio himself appeared and admitted he had made a mistake.)
However, I think it’s worthwhile to explain the error, as it appears that several bloggers want desperately to do prove things using series expansions of functions inside averaging operators. So, it is useful to explain the main error I think Horatio made. (I may be mistaken though. He is explaining what he considers to be his main mistake in comments, and I may be misunderstanding what he did in his original post. .
I think that in Horatio’s original post, he assumed he could estimate a term that looked like this
where the subscript ‘local’ indicates a spatially varying quantity
using
}
Unfortunately, this doesn’t work because the quantities he had defined, Tlocal,o and T’local vary with polar angle φ.
In fact most statisticians and engineers familiar with statistical notation will recognize my <> notation as an averaging operator. Translating the integrals to the more compact notation, and substituting more abstract variables X and Y, I think Horatio did this: <X3 Y>=<X3><Y> where both X and Y vary locally, and can be thought of as a randomly varying quantity. (I suspect the difficulty was not conceptual, but was the result of failing to use explicit notation to distinguish already averaged quantities and locally varying quantities.)
Interestingly, it is possible to relate the “error” Horatio due to neglecting spatial gradients reported in first post was proportional to the 3 <δTo2>/<To>2 terms in (3a), which are, indeed, quite small.
Conclusions
Just to end this post on something other than math, the conclusions are:
- Dr. Pielke Sr. correctly identified that effect of spatial variations in earth’s surface temperature should be considered when using the IPCC equation for the anomalous energy balance of the earth’s climate.
- The terms I derived to estimate this effect give good results when compared to a full solution of a simplifed analytical temperature profile suggested by Horatio Algernon.
- Horatio Algernon found his own error before I posted. He communicated the error to me immediately. (I once discovered to my horror that a result posted on a blog was incorrect becaused I’d used log() instead of ln(). So, I can hardly say I don’t make similar errors!)
- I hope to heaven I don’t have to reprove this again!
End Notes:
1. I modified case 2 to reflect the earth’s current temperature anomalie which is approximately 0.6K. temperature shift from pole to equator has been 1K or greater, based on monthly average values. The full analysis requires instantaneous values, which suggests even greater shifts. So, my numbers bring Algernon’s value into better alignment with the changes in the earth’s climate system, while still tending to underestimate the effect of spatial variations.
Update
Update: Feb. 21, 3:30 pm CST: I updated some text to reflect that Horatio did not write his post in response to mine. He was commenting on Dr. Pielke’s post. The post came to my attention when a visitor alerted me to it– and I am under the impression the visitors intention was to tell me my analysis had been refuted.
With all due respect, I am very puzzled by this claim that you make above:
First I didn’t do my analysis in response to your post. I did it because I was interested in seeing for myself what the fuss was about.
Second I don’t believe the second part of your claim is warranted.
I can’t be sure precisely what you are referring to with the word “effect” but i fyou are refrringto some error in my analysis (eithe method or integral), I think it is important to understand precisely what I did. Sorry if that is not clear from my blog, as you indicated.
Perhaps i was not clear above. I did not say I found an error in my method or in my surface integrals or any such thing. In fact, I am quite confident that those are correct, at least in so far as what i was attempting to do (which is laid out on my blog in some detail)
What i said was that the 2-sigma error in the temperature vs latitude function that i used to do the surface integral led to an uncertainty in the answer for my integral of order 12.5%. The actual difference I got for the global surface integral of the radiative emission increase for a 1K change in temperature using 1) the global mean temp and 2) a temperature vs latitude function came out to be about 4%. I have made no correction to that.
But since the 2-sigma uncertainty for the surface integral of radiative emission for the varying temperature case) actually turns out to be about 12.5% (for the temperature function I used), I can’t say one way or the other whether my 4% result is correct or not. It might be 4% or it could be 16.5% (or perhaps even a little bigger). As i indicated, the only way to know that is to do the surface integrals with actual temperature data (rather than approximated temperature functions or bands or whatever) so that the uncertainty is reduced to a low enough level that one can confidently say that the difference is 4%, 10% or whatever (to within a few percent, say)
Unless you are claiming significantly less uncertainty associated with your surface integrals (which I don’t believe you can, given the way that you have estimated temperature variation with the bands), I don’t believe that you can say definitively that my answer is “wrong”, as you have above. It is simply not warranted.
This is actually precisely what I referred to above when I asked
Hi Algernon,
I shifted the comment here to place it incontext of the post you are commenting on.
Sorry, yes, you were commenting on Roger’s post. It came to my attention when someone posted here,and on the day Roger ran my post. I should have proof read that and will correct.
However, as I see it, your post got an entirely incorrect numerical answer using the precise values you picked. You concluded uncertainty in the estimate of the anomalous radiation from the earth’s surface due to the effect of the changes in the spatial variation in surface temperature is miniscule– less than 1% even for the central tendency with the number in your example.
The reason you got the incorrect answer is that you tried calculate an global average emmisivity, using T^3 type integrals and them multiply by a change in the average of T. This is mathematically incorrect.
This is a classic error. Once you do this, you can integrate T^3 as correctly as you like, you can’t get the correct answer. In particular, for this problem you can’t capture the dominant effect of spatial variations in temperature.
If you re-do your calculations problem, forgetting about the series expansion entirely, and just use T^4 (which is no more difficult to do that using T^4, you will see that your conclusions change.
FWIW, it is entirely possible to demonstrate that if one does the particular faulty substitution you made, your analysis will capture the tiny terms I advised neglecting, but fail to capture the dominant term.
That’s just the way it is.
I guess I now better understand what you mean here:
First: Correctly done, the computation indicate the central tendency is that the terms likely contribute an error of ±15% or more.
Second, if these are neglected, this introduced both bias and uncertainty. (Which depends on how the estimated parmeter is later used.).
Third: This means people should systematically do the computation when possible, or add this uncertainty into their uncertainty interval. That is: the issue cannot simply be ignored out of hand, or waved away.
Also, on the issue of your error: It appears that what consider your error and what I consider your error may be different things. In order for me to understand precisely what you mean, you will need to document that. While you are not required to do so, I can’t completely understand what you are trying to say here in comments.
I brought it to your attention because I understood the straightforward presentation Horatio used. Now he apparently thinks his example left out something important. This is apparently the 2 sigma variation of 10 deg C on RR’s graph for a particular latitude for T as a function of latitude. This he left out and now thinks important. Personally I still doubt it. Integrating T to the third around the globe at a given latitude can’t give an answer much different than that obtained by using the average T for that latitude for the same reasons that it didn’t matter much for integrating over latitude. That is the highs and lows can still be paired. I am however a bit rusty on the bras and kets dee rs dee thetas and dee phis.
I will try harder to understand your post and might well have to retract my comment if I can get there.
Don,
In the bit before the “Update” in yellow, here I think Algernon
* a) integrated something that resembled ( 1+ cT)^3* sin (phi) around the globe to get what he thought to be an average emissivity. He then normalized by area. (Normalizing requires dividing by a factor of to account for integrating sin(phi) around the globe). (This is expressed in SURFACE INTEGRAL of delta_E_phi R^2 sin(phi) dPhi dTheta , which he writes in his blog post.)
* b) then (maybe) he integrated (T’)sin(phi) around the globe, to get what he thought was an average temperature anomaly. He normalize for area. (He may not have done this.)
* c) He then (maybe) multiplied the result from (a) and (b). (He may not have done this though. But this gets you your 1K increase in the mean.)
* d) He then seemed to conclude the difference between accounting for pole to pole temperature variations 4%. (I’m not sure if he’s comparing the (1+cT)^3 integral obtained in ‘a’ or the product he may, or may not, have obtained in ‘c’.
Whatever the Horations 4% difference is supposed to pertain too, it is not the issue, or effect, Dr. Pielke was talking about.
That 4%, difference, though masked, is already accounted for in the λ used by everyone, everywhere. So, the bit Algernon is considering is, believe it or not, not an uncertainty at all. (It isn’t even the uncertainty if he accounts for his 2-sigma!)
That comes out in the wash. Whatever the reference is, it is, and it’s simply part of the normal λ obtained empirically if people like Hansen, Schwartz etc cited above use the IPCC equation. (Which they do.)
The difference Pielke Sr. is considering is what happens if, given a reference temperature profile, the temperature of the poles warm relative to the equator as the earth also warms. So, it’s the difference between (c) and (d) above.
What happens to the equation when the ΔT shifts? That’s the effect Pielke is trying to say needs to be captured in empirical analysis using equation (1). The new terms I derived capture that effect.
Lucia, I’d like to invite you to participate in our discussion of derivations of Climate Sensitivity Here:
http://www.climateaudit.org/phpBB3/viewtopic.php?f=4&t=128
Your input would be greatly appreciated!