Method comparing risks

Over-indebtedness, damaged luggage or accidents at work - What is more likely to happen?

The challenge of risk literacy

Improving consumers' risk assessments.


Why is it relevant to improve consumers' risk assessments?

The aim is for the consumer to be able to make better decisions. Particularly when these decisions affect certain life risks, it is important not only to have contextual knowledge about the risk, but also to understand how likely the risk is going to occur.

However, many people tend to overestimate certain risks, such as catastrophic events like plane crashes. False conclusions can be drawn from this, which in turn increase risk: If you substitute the flight with driving the distance by car, the risk of a fatal accident increases.

In the case of risks that develop very slowly but occur more frequently, their occurrence is often underestimated, e.g. type 2 diabetes. In this case, the correct conclusions are often not drawn in order to reduce risk factors, e.g. to exercise more.


Why is it problematic to improve consumers' risk assessments?

If you want to improve consumers' risk assessments, you face a number of challenges:

  • How can probabilities of occurrence be conveyed in a way that leads to a more realistic perception of risks, and thus an assessment of their occurrence?
  • How can overestimated and underestimated events be conveyed in a way that leads to a more realistic assessment of their occurrence?
  • How can interest in engaging with risk statistics be sparked?
     
What is a suitable scientific approach?

The interest in dealing with statistics can be sparked by the personal involvement of learners through letting them test their own risk assessments. Through paired comparison tasks, learners can rely on their gut feelings without having to estimate a specific number. The feedback they receive helps them to learn when they are right. Paired comparisons of facts can also stimulate conclusions that can be transferred to other situations (Alfieri et al., 2013): e.g. when learners think about what two risks have in common and what distinguishes them. The meaning of explicitly stated characteristics of two decision options is better comprehended when presented as pairs than individually (Pachur & Olsson, 2012). Whether the mechanism shown for comparing characteristics works just as well if the characteristics are only to be imagined (for example, thinking that one risk is man-made, but the other one is natural) remains unclear.

Interactivity can be used to nurture interest. It should be used in an economical, targeted and coherent way with the necessary controls and content. Since this is a playful transfer of knowledge from the adult world (Barth, 2018), this interest can be reinforced among certain consumers by addressing the motive of power (competition, status) (Sailer et al., 2014) by comparing their own risk assessment abilities with those of others. The reduced design refrains from presenting further details that motivate interest. These could contradict the actual goal, particularly if they do not fit harmoniously into the content, or even distract or simply lead to confusion (Eitel & Kühl, 2019).

For risk comparisons, probabilities of occurrence are communicated using simple frequencies with the reference group of 100,000. Particularly probabilities of occurrence of rare events can be communicated more understandably than percentages in this way. Visual approaches such as icon arrays can further facilitate these comparisons, but the probability of occurrence for many risks is too low to be recognizable on a small display.

Proof of effectiveness

Comparisons of uncertain events with regard to their occurrence can improve understanding. Our studies show that this is also true for the playful approach of personal assessment with social feedback ("How often did others give a correct answer?") compared to tables.

Recommended literature on methodological basics
  • Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87–113.
  • Barth, R. (2018). Möglichkeiten der Nutzung von Game Design Prinzipien in der Erwachsenenbildung. digital. innovativ|# digiPH, 109–118. 
  • Eitel, A., & Kühl, T. (2019). Harmful or helpful to learning? The impact of seductive details on learning and instruction. Applied Cognitive Psychology, 33(1), 3–8.
  • Pachur, T., & Olsson, H. (2012). Type of learning task impacts performance and strategy selection in decision making. Cognitive Psychology, 65(2), 207–240.
  • Sailer, M., Hense, J., Mandl, J., & Klevers, M. (2014). Psychological perspectives on motivation through gamification. Interaction Design and Architecture Journal, (19), 28–37.
How can you implement the method?

Option 1: You can embed the given visualisation
It is possible to embed the visualisation from our website including the frame text via iframe. To do this, use the following html-code for your website: <iframe frameborder="0" height="650px" src="https://static.risikoatlas.de/modules/comparing-risks/index.html" width="1024px"></iframe>

It is also optimized for mobile devices, so you can integrate it into a mobile website.

Option 2: You can adapt the given visualisation
If you use your own data as a multiplier, your web developers can enter it into your own consumer fact box with experience-based learning.

We will provide the person responsible for your website with the documented code for download via github. You can then edit the material. The link to the repository is available on request. Contact details can be found here.

Option 3: You can apply the scientific principle independently
If you require assistance, please consult the final report on the RiskAtlas project from July 2020 or contact us. Contact details can be found here.

When using the instruments, please mention the funding agency, which is the German Federal Ministry of Justice and Consumer Protection, and the Harding Centre for Risk Literacy as the responsible developers.

Logos can be downladed here.

Links to other methods
Visualisation with frame text

Over-indebtedness, damaged luggage or accidents at work - how likely are these things going to happen to you during the next year?

The newsstand around the corner advertises that 12 million euros are in the lottery jackpot. Even if you have heard somewhere that a lottery win is less likely than a plane crash, you make your check marks and wait expectantly for the next draw. And of course: you do not win anything. You are not the only one, by the way: on average, 9 out of 10 people who invest in gambling have the same experience as you. And even if you win something, the amount is usually negligibly small.

At the same time, we tend to underestimate and overestimate events that actually occur - e.g. because the media attention they receive or the serious effects that they have make us forget how rarely they occur. To avoid this and to obtain a realistic overview of consumer risks, try our risk comparison.

When do I need this visualisation?

The risk comparison influences your perception of risks and is supposed to improve your risk assessment. Improved risk assessment enables you to make future decisions on a more realistic basis. It is not intended to support concrete decisions.

What does the visualisation show?

The visualisation compares randomly selected risks with regard to the probability of their occurrence within one year. It guides you from comparison to comparison. Two risks are presented at the same time. You then decide what is more likely. The risk that is more likely to occur is coloured green. In addition, you receive ongoing feedback on how many of all comparisons you and others have made correctly. The frequency format with 100,000 each as reference group and the absolute numbers are to avoid the use of smaller percentages, since percentages of probabilities of occurrence of rare events (<1%) are estimated incorrectly by the majority of people.

Sources and quality of the data
  • Bach et al, 2014. DIW.
  • BKA Bundeslagebild 2017.
  • http://appsso.eurostat.ec.europa.eu/
  • http://comms.sita.aero/rs/089-zse-857/images/baggage-report-2017.pdf
  • http://now.symassets.com/content/dam/norton/global/pdfs/norton_cybersecurity_insights/DE_NCSIR_2017.pdf
  • https://de.reuters.com/article/deutschland-hacker-umfrage-idDEKCN1P3123
  • https://de.statista.com/statistik/daten/studie/150565/umfrage/privatinsolvenzen-in-deutschland-seit-2000/
  • https://lssh.de/wp-content/uploads/2018/07/Zusammenfassung-der-BZgA-Studie-Gl%C3%BCcksspielverhalten-und-Gl%C3%BCcksspielsucht-in-Deutschland.-Ergebnisse-des-Surveys-2017-und-Trends.pdf 
  • https://reklamation.com/statistik/
  • https://rp-online.de/politik/deutschland/7-6-millionen-menschen-erhalten-mindestsicherung_aid-33912859
  • https://wiwi.hs-duesseldorf.de/personen/nikola.ziehe/Documents/Kraemer%20Kalka%20Ziehe%20-%20Personalisiertes%20und%20dynamisches%20Pricing%20aus%20Einzelhandels-%20und%20Verbrauchersicht%20261110F.pdf
  • https://www.ages.at/fileadmin/AGES2015/Themen/Lebensmittel_Dateien/Lebensmittelsicherheit_und_Hygiene_im_Privathaushalt_13_12_2013.pdf
  • https://www.berlin-suchtpraevention.de/wp-content/uploads/2016/10/2015_BZgA_Ergebnisbericht_Glcksspielsucht.pdf 
  • https://www.bfach.de/media/file/24871.Marktstudie_2018_Konsum-Kfz-Finanzierung_BFACH.pdf
  • https://www.bfr.bund.de/cm/350/verbrauchertipps_schutz_vor_lebensmittelinfektionen_im_privathaushalt.pdf
  • https://www.bitkom.org/Presse/Presseinformation/Jeder-zweite-Internetnutzer-von-Cyberkriminalitaet-betroffen
  • https://www.bundesnetzagentur.de/SharedDocs/Pressemitteilungen/DE/2017/28122017_Telekommunikation.html
  • https://www.creditreform.de/fileadmin/user_upload/crefo/download_de/news_termine/wirtschaftsforschung/schuldneratlas/Analyse_SchuldnerAtlas_2018.pdf
  • https://www.destatis.de/DE/PresseService/Presse/Pressemitteilungen/2016/07/PD16_243_122.html
  • https://www.destatis.de/DE/Publikationen/Thematisch/EinkommenKonsumLebensbedingungen/Ueberschuldung/EVS_GeldImmobilienvermoegenSchulden2152602139004.pdf?__blob=publicationFile 
  • https://www.destatis.de/DE/ZahlenFakten/GesellschaftStaat/EinkommenKonsumLebensbedingungen/LebensbedingungenArmutsgefaehrdung/Tabellen/Eurostat_MaterielleEntbehrung_SILC.html
  • https://www.focus.de/finanzen/news/2-2-millionen-euro-schaden-wieder-mehr-betrug-mit-bankkarten-branche-ohne-sorge_id_8294582.html
  • https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=2ahUKEwj59o6a3pffAhUQp4sKHTghB0AQFjABegQICBAC&url=https%3A%2F%2Fwww.presseportal.de%2Fdownload%2Fdocument%2F312756-umfrageergebnisse-dispo-nutzung-2015.pdf&usg=AOvVaw29t51ca1TN77Eh8-BRGgkP
  • https://www.marktwaechter.de/sites/default/files/downloads/schadensfaelle-auf-dem-grauen-kapitalmarkt.pdf
  • https://www.pwc.de/de/handel-und-konsumguter/assets/cyber-security-identitaetsdiebstahl-2016.pdf
  • https://www.reisereporter.de/artikel/1947-flugausfaelle-flugverspaetung-taeglich-69-faelle-probleme-mit-fluegen
  • https://www.schlichtungsstelle-energie.de/presse/presseartikel/taetigkeitsbericht-der-schlichtungsstelle-energie-39.html;  Bericht der Bundesnetzagentur 2017
  • https://www.uni-trier.de/fileadmin/fb4/prof/VWL/OAR/Hornuf_Schmitt_-_Success_and_Failure_in_Equity_Crowdfunding.pdf
  • https://www.zugreiseblog.de/bahn-puenktlichkeit-statistik/
  • Schufa-Report 2018.
  • Schufa-Report 2018.
  • Statistisches Jahrbuch der Versicherungswirtschaft.
  • VATM_TK-Marktstudie-2018_091018_f
  • Zusammenfassung-der-BZgA-Studie-Glücksspielverhalten-und-Glücksspielsucht-in-Deutschland.-Ergebnisse-des-Surveys-2017-und-Trends

What is the quality of the data?

The numbers and data included in the risk comparison come from various sources, e.g. frequency observations of public registers, surveys, population studies or models. Most of these risk estimates are characterised by a relatively low quality of evidence. This means that future assessments are likely to lead to different results.

There are several reasons for this:
1) There is a lack of randomised controlled trials that compare consumer actions and inactions, and thus demonstrate that certain events are caused by these actions.
2) The registration of the occurrence of consumer events in Germany is based too little on qualitative systematic population studies, but rather primarily on the number of people affected.
3) The registration of consumer risks is also always subject to conflicts of interest or self-interests, which can weaken the informative value of data.

Empirical evaluation with consumers

All research results on the fundamentals and on the effectiveness of the RiskoAtlas tools in terms of competence enhancement, information search and risk communication will be published together with the project research report on 30 June 2020. If you are interested beforehand, please contact us directly (Felix Rebitschek, rebitschek@mpib-berlin.mpg.de).

Last update: 27 November 2019.

Links to other topics