by Michelle L'Heureux
Washington DC (SPX) Jul 01, 2014
The Signal and the Noise is often mentioned in reference to ENSO forecasting and not just in reference to Nate Silver's bestselling book. In fact, understanding what is signal and what is noise is critical to interpreting predictions from models and climate science in general. Very generally:
(1) Signal: Signal is the part of the forecast that can be predicted if one were to build a perfect climate model (for example, physical relationships between and within the ocean and atmosphere are perfectly understood and coded into the model). In seasonal climate prediction, signal can arise from the surface conditions, such as sea surface temperatures, land cover, or sea ice, which vary more slowly than faster atmospheric motions.
(2) Noise: Noise is the part of the forecast that cannot be predicted. Despite having a perfect model and understanding of the physical system, there will always be some uncertainty associated with the forecast because imprecise observations made at the time of the forecast (also known as errors in initial conditions) will grow into the future. Think of the noise as akin to the famous "butterfly flaps its wings" example - a butterfly flaps its wings in Brazil and the ripple effect contributes to a tornado in Texas (Lorenz, 1963, 1972).
Now how does this help us understand ENSO predictions? Obviously, we do not have perfect models at our fingertips. However, the concepts of signal and noise are still helpful to interpreting model forecasts and the expected uncertainty around them.
The forecast model is started using recent observations (started at slightly different moments in time) that are measured by satellites, buoys, etc. and then the model is run forward out to 8 seasons (here, any 3-month average is a season).
Each individual, grey line in the figure is referred to as a model member and represents one possible outcome, based on just one initial condition at one time. All of the members averaged together is called the ensemble mean and is shown by the dashed, red line. In the figure above, the start dates range from June 12 through 21 (10 days), run from 4 different start times each day, so 10 x 4 = 40 members.
The ensemble mean is the model's estimate of the signal, which is one predictable part of the forecast (1). However, clearly, the individual members show a wide variety, or spread, of possible outcomes.
One can expect the actual reality will have the same characteristics as any one of those members. In theory, each member has the same probability of occurring. We ENSO forecasters bet that the future has a higher chance of being closer to where the members cluster together near the ensemble average (red dashed line), but the fact is, the future conditions could be closest to any one of the model members (grey lines).
Many folks will consider the forecast to be a failure when it does not match the expected signal (the ensemble mean), but the observed reality will always be some combination of signal + noise.
This is why ENSO and climate outlooks are expressed in terms of probability (i.e. what is the chance of El Nino?). This is also why making forecasts for the strength of El Nino or La Nina is always fraught with uncertainty: the spread of possible outcomes is clearly larger than the width of any one strength category (see definitions).
In part because we don't have a perfect model, we often examine the ensemble means from many different types of models (see IRI/CPC plume and North American Multi-Model Ensemble), hoping that the average of those will cancel out individual model errors. This strategy is called using multi-model ensembles (MME).
So, this is why on June 5th 2014, we slightly favored a moderate strength El Nino. The observed reality will ultimately be some factor we cannot know in advance due to the noise.
(1) Forecast predictability can be reflected by changes in the spread of the forecast as well. Knowing whether the future could encompass a larger range of outcomes versus a smaller range of outcomes can provide useful information (e.g. Kumar et al. 2000)
Water News - Science, Technology and Politics
|The content herein, unless otherwise known to be public domain, are Copyright 1995-2014 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. Privacy Statement All images and articles appearing on Space Media Network have been edited or digitally altered in some way. Any requests to remove copyright material will be acted upon in a timely and appropriate manner. Any attempt to extort money from Space Media Network will be ignored and reported to Australian Law Enforcement Agencies as a potential case of financial fraud involving the use of a telephonic carriage device or postal service.|