Subscribe to our free daily newsletters
. Earth Science News .




Subscribe to our free daily newsletters



DISASTER MANAGEMENT
Evaluating forecasts of extreme events
by Staff Writers
Heidelberg, Germany (SPX) Apr 13, 2017


This photo shows the researchers Dr. Sebastian Lerch and Prof. Tilmann Gneiting. Image courtesy HITS.

When it comes to extreme events, public discussion of forecasts often focuses on predictive performance. After the international financial crisis of 2007, for example, the public paid a great deal of attention to economists who had correctly predicted the crisis, attributing it to their superior predictive ability. However, restricting forecast evaluation to subsets of extreme observations has unexpected and undesired effects, and is bound to discredit even the most expert forecasts.

In a recent article, statisticians Dr. Sebastian Lerch and Prof. Tilmann Gneiting (both affiliated with HITS and the Karlsruhe Institute of Technology), together with their coauthors from Norway and Italy, analyzed and explained this phenomenon and suggested potential remedies.

The research team used theoretical arguments, simulation experiments and a real data study on economic variables. The article has just been published in the peer-reviewed journal Statistical Science. It is based on research funded by the Volkswagen Foundation.

Predicting calamities every time - a worthwhile strategy?
Forecast evaluation is often only conducted in the public arena if an extreme event has been observed; in particular, if forecasters have failed to predict an event with high economic or societal impact. An example of what this can mean for forecasters is the devastating L'Aquila earthquake in 2009 that caused 309 deaths.

In the aftermath, six Italian seismologists were put on trial for not predicting the earthquake. They were found guilty of involuntary manslaughter and sentenced to six years in prison until the Supreme Court in Rome acquitted them of the charges.

But how can scientists and outsiders, such as the media, evaluate the accuracy of forecasts predicting extreme events? At first sight, the practice of selecting extreme observations while discarding non-extreme ones and proceeding on the basis of standard evaluation tools seems quite logical. Intuitively, accurate predictions on the subset of extreme observations may suggest superior predictive abilities. But limiting the analyzed data to selected subsets can be problematic.

"In a nutshell, if forecast evaluation is conditional on observing a catastrophic event, predicting a disaster every time becomes a worthwhile strategy," says Sebastian Lerch, member of the "Computational Statistics" group at HITS. G

iven that media attention tends to focus on extreme events, expert forecasts are bound to fail in the public eye, and it becomes tempting to base decision making on misguided inferential procedures.

"We refer to this critical issue as the 'forecaster's dilemma,'" adds Tilmann Gneiting.

Avoiding the forecaster's dilemma: Method is everything.
This predicament can be avoided if forecasts take the form of probability distributions, for which standard evaluation methods can be generalized to allow for specifically emphasizing extreme events. The paper uses economic forecasts of GDP growth and inflation rates in the United States between 1985 and 2011 to illustrate the forecaster's dilemma and how these tools can be used to address it.

The results of the study are especially relevant for scientists seeking to evaluate the forecasts of their own methods and models, and for external third parties who need to choose between competing forecast providers, for example to produce hazard warnings or make financial decisions.

Although the research paper focused on an economic data set, the conclusions are important for many other applications: The forecast evaluation tools are currently being tested for use by national and international weather services.

Lerch, S., Thorarinsdottir, T. L., Ravazzolo, F. and Gneiting, T. (2017). Forecaster's dilemma: Extreme events and forecast evaluation. Statistical Science, in press.

DISASTER MANAGEMENT
As the richer get richer, carbon emissions rise, new research shows
Washington (UPI) Apr 7, 2017
Inequality is positively correlated with carbon emissions, new research shows. According to analysis by Boston College researchers, states in which wealth is more concentrated at the top burned more carbon between 1997 and 2012. Scientists calculated the additional carbon burned as the top 10 percent of each state's wealthiest citizens accrue another 1 percent of the economic pie ... read more

Related Links
Heidelberg Institute for Theoretical Studies
Bringing Order To A World Of Disasters
A world of storm and tempest
When the Earth Quakes


Thanks for being here;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.

SpaceDaily Contributor
$5 Billed Once


credit card or paypal
SpaceDaily Monthly Supporter
$5 Billed Monthly


paypal only

Comment using your Disqus, Facebook, Google or Twitter login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

DISASTER MANAGEMENT
Glowing bacteria detect buried landmines

Mosul zoo lion and bear flown out of Iraq

World's oldest dental fillings found in Italy

US says ending UN mission in Haiti is a 'strong example'

DISASTER MANAGEMENT
Despite EU fines, Greece struggling to promote recycling

New method for 3-D printing extraterrestrial materials

Ultra-thin multilayer film for next-generation data storage and processing

USC Viterbi researchers develop new class of optoelectronic materials

DISASTER MANAGEMENT
Into the DNA of a coral reef predator

Guinea seizes shark fins from Chinese ships

New England's glacial upland soils provide major groundwater storage reservoir

Catch shares slow the 'race to fish'

DISASTER MANAGEMENT
Researchers unravel the drivers of large iceberg movement

Polar glaciers may be home to previously undiscovered carbon cycle

Warm Atlantic waters contribute to sea ice decline

Permafrost more vulnerable than thought: scientists

DISASTER MANAGEMENT
To save honey bees, human behavior must change

So sheep may safely graze

Fungus uses light to invade, attack wheat plants

Colombia forces struggle to root out coca

DISASTER MANAGEMENT
Houses damaged as strong quake hits south Philippines

Antarctic penguin colony repeatedly decimated by volcanic eruptions

At least 35 dead in Iran floods; Quake rattles northern Chile

Developing a microinsurance plan for California earthquakes

DISASTER MANAGEMENT
Four dead in army, police clashes in Nigeria: source

Three killed in Mogadishu army camp attack: military

El Nino can warn on cholera outbreaks in Africa: study

Five dead in jihadist attack in Mali

DISASTER MANAGEMENT
Putting social science modeling through its paces

Study reveals 10,000 years of genetic continuity in northwest North America

Married couples with shared ancestry tend to have similar genes

Researchers uncover prehistoric art and ornaments from Indonesian 'Ice Age'




Memory Foam Mattress Review
Newsletters :: SpaceDaily :: SpaceWar :: TerraDaily :: Energy Daily
XML Feeds :: Space News :: Earth News :: War News :: Solar Energy News






The content herein, unless otherwise known to be public domain, are Copyright 1995-2017 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. Privacy Statement