<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "https://jats.nlm.nih.gov/nlm-dtd/publishing/3.0/journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" xml:lang="en" dtd-version="3.0" article-type="research-article">
  <front>
    <journal-meta><journal-id journal-id-type="publisher">NHESS</journal-id><journal-title-group>
    <journal-title>Natural Hazards and Earth System Sciences</journal-title>
    <abbrev-journal-title abbrev-type="publisher">NHESS</abbrev-journal-title><abbrev-journal-title abbrev-type="nlm-ta">Nat. Hazards Earth Syst. Sci.</abbrev-journal-title>
  </journal-title-group><issn pub-type="epub">1684-9981</issn><publisher>
    <publisher-name>Copernicus Publications</publisher-name>
    <publisher-loc>Göttingen, Germany</publisher-loc>
  </publisher></journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.5194/nhess-23-2505-2023</article-id><title-group><article-title>Criteria-based visualization design for hazard maps</article-title><alt-title>Criteria-based visualization design for hazard maps</alt-title>
      </title-group><?xmltex \runningtitle{Criteria-based visualization design for hazard maps}?><?xmltex \runningauthor{M. Schneider et al.}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes" rid="aff1">
          <name><surname>Schneider</surname><given-names>Max</given-names></name>
          <email>mschneider@usgs.gov</email>
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1 aff2">
          <name><surname>Cotton</surname><given-names>Fabrice</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff3">
          <name><surname>Schweizer</surname><given-names>Pia-Johanna</given-names></name>
          
        </contrib>
        <aff id="aff1"><label>1</label><institution>Section 2.6: Seismic Hazard and Risk Dynamics, German Research Centre for Geosciences, Potsdam, Germany</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>University of Potsdam, Potsdam, Germany</institution>
        </aff>
        <aff id="aff3"><label>3</label><institution>Research Institute for Sustainability, Helmholtz Centre Potsdam, Potsdam, Germany</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">Max Schneider (mschneider@usgs.gov)</corresp></author-notes><pub-date><day>14</day><month>July</month><year>2023</year></pub-date>
      
      <volume>23</volume>
      <issue>7</issue>
      <fpage>2505</fpage><lpage>2521</lpage>
      <history>
        <date date-type="received"><day>11</day><month>October</month><year>2022</year></date>
           <date date-type="rev-request"><day>15</day><month>November</month><year>2022</year></date>
           <date date-type="rev-recd"><day>10</day><month>May</month><year>2023</year></date>
           <date date-type="accepted"><day>25</day><month>May</month><year>2023</year></date>
      </history>
      <permissions>
        <copyright-statement>Copyright: © 2023 Max Schneider et al.</copyright-statement>
        <copyright-year>2023</copyright-year>
      <license license-type="open-access"><license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p></license></permissions><self-uri xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023.html">This article is available from https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023.html</self-uri><self-uri xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023.pdf">The full text article is available as a PDF file from https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023.pdf</self-uri>
      <abstract><title>Abstract</title>

      <p id="d1e112">Probabilistic seismic hazard estimates are a key ingredient of earthquake risk mitigation strategies and are often communicated through seismic hazard maps. Though the literature suggests that visual design properties are key for effective communication using such maps, guidelines on how to optimally design hazard maps are missing from the literature. Current maps use color palettes and data classification schemes which have well-documented limitations that may inadvertently miscommunicate seismic hazard. We surveyed the literature on color and classification schemes to identify design criteria that have empirical support for communicating hazard information. These criteria were then applied to redesign the seismic hazard map for Germany. We established several communication goals for this map, including essential properties about moderate-hazard seismic regions and a critical hazard threshold related to the German seismic building codes. We elucidate our redesign process and the selection of new colors and classification schemes that satisfy the evidence-based criteria. In a mixed-methods survey, we evaluate the original and redesigned seismic hazard maps, finding that the redesign satisfies all the communication goals and improves users’ awareness about the spatial spread of seismic hazard relative to the original. We consider practical implications for the design of hazard maps across the natural hazards.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

<sec id="Ch1.S1" sec-type="intro">
  <label>1</label><title>Introduction</title>
<sec id="Ch1.S1.SS1">
  <label>1.1</label><title>Probabilistic seismic hazard analysis and maps</title>
      <p id="d1e131">Earthquakes are social problems because they cause ground shaking that can destroy buildings and injure or kill people. Ground shaking due to earthquakes is referred to as seismic hazard, and physical models can assess the amount of ground shaking that can be expected at any given location in a seismic region. These models are functions of parameters that describe both how frequently various earthquakes occur in the region and the full range of ground shaking that each earthquake may cause.</p>
      <p id="d1e134">In a modern probabilistic seismic hazard assessment (PSHA) aiming to capture epistemic uncertainties, parameters for these models are varied systematically to create a hazard ensemble over many model runs. The probabilistic distribution of seismic hazard values across a region is highly skewed right, owing to the low probability of high shaking; this is because larger-magnitude earthquakes (which generate higher levels of shaking) have a correspondingly lower probability of occurring. In moderate-seismicity regions, the majority of the region has hazard that is mapped as low, with few zones of higher hazard and fewer zones still of the largest possible hazard. These unlikely but highest hazard levels have a strong impact on the expected losses, in particular in urban areas. Still, damaging shaking from earthquakes may also occur (of course, with a low probability) where hazard is mapped as low.</p>
      <p id="d1e137">Probabilistic hazard assessments commonly show the horizontal ground acceleration (peak ground acceleration, PGA) which is exceeded, “on average”, every 475 years (e.g., <xref ref-type="bibr" rid="bib1.bibx2" id="altparen.1"/>). This so-called “475-year return period” means that, due to the assumption that earthquakes follow a Poisson distribution, this acceleration has a 10 % probability of being exceeded in 50 years. Because earthquakes are generally clustered into certain zones in a region (e.g., around fault lines), hazard varies over space and PSHA ensembles are produced over fine-scale grids across a region. The resulting<?pagebreak page2506?> seismic hazard maps depict the spatial variation of a summary, e.g., the mean, of the ensemble of hazard outcomes. These hazard maps are used by a variety of user groups, from political or economic decision-makers assessing a seismic region’s land use to civil engineers and officials responsible for creating seismic-resistant buildings. Urban seismic risk is of particular importance, as highly developed urban areas have greater exposure to earthquake damage.</p>
</sec>
<sec id="Ch1.S1.SS2">
  <label>1.2</label><title>German seismic hazard map</title>
      <p id="d1e151">In our study, we consider seismic hazard mapping for the country of Germany. The seismicity of Germany is elevated in certain regions of the country, when compared to other parts of central Europe, particularly in the southwest and along the Rhine River. In general, the seismicity is indeed low compared to the plate-boundary regions of the Mediterranean <xref ref-type="bibr" rid="bib1.bibx27" id="paren.2"/>. Still, “no part can be regarded as aseismic” <xref ref-type="bibr" rid="bib1.bibx74" id="paren.3"/>, i.e., damaging seismic events can be expected, in principle, everywhere, over a long time window. The national German seismic hazard map is shown in Fig. 1 (reproduced from Fig. 28 (middle) in <xref ref-type="bibr" rid="bib1.bibx27" id="altparen.4"/>). This shows the mean PGA value that has a 10 % probability of exceedance in 50 years, with the mean taken over 4040 model runs in the probabilistic ensemble. The PSHA described herein was accomplished on behalf of the Deutsches Institut für Bautechnik (German Institute for Civil Engineering) and was launched by the respective national committee on standardization of the Deutsches Institut für Normung (German Institute for Standardization).</p>

      <fig id="Ch1.F1" specific-use="star"><?xmltex \currentcnt{1}?><?xmltex \def\figurename{Figure}?><label>Figure 1</label><caption><p id="d1e164">National seismic hazard map for Germany, reproduced from Fig. 28 (middle) in <xref ref-type="bibr" rid="bib1.bibx27" id="text.5"/>. It shows the peak ground acceleration (PGA, in  m s<inline-formula><mml:math id="M1" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>) expected at each location for a return period of 475 years, taking the mean over the probabilistic ensemble.</p></caption>
          <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023-f01.png"/>

        </fig>

      <p id="d1e188">The map in Fig. 1 was produced following consultations with users of PSHA products (Gottfried Grünthal, several personal communications,  2021), but, as discussed in the subsequent sections, this map has some disadvantages. It uses a rainbow color palette, which is known to be suboptimal for visual perception, with reported psychological associations that are not appropriate for seismic hazard, and less accessible to users with color vision deficiency. The legend associates these colors with hazard levels in a way that neither groups together hazard levels that are closer together nor spotlights meaningful hazard values. The legend further extends to a much higher value than what is shown in this map likely because the same legend is used to map other (higher) parts of the PSHA ensemble (see Sect. 2.2). In this paper, we solely consider single-map representations of hazard and what the research evidence supports in the design of such maps.</p>
      <p id="d1e191">Visualization of seismic hazard can be challenging due to its spatial variation and highly skewed distributions, but these issues are ubiquitous across earthquake data <xref ref-type="bibr" rid="bib1.bibx63 bib1.bibx6" id="paren.6"/>. As a starting point for our framework for hazard map design, we specified what the viewer should ideally understand after reading the German seismic hazard map. We argue that these properties are fundamental to the understanding of how seismic hazard changes across a region, for the largest variety of users. The communication goals for the map include the following four properties about the seismic hazard phenomenon:
<list list-type="custom"><list-item><label>G1</label>
      <p id="d1e199">Probabilistic seismic hazard (shaking) is not spotty but rather  changes continuously in space because of the progressive decay of seismic waves generated by earthquakes and the fact that earthquakes may occur over large areas outside well-known faults.</p></list-item><list-item><label>G2</label>
      <p id="d1e203">Earthquakes and associated damaging shaking may occur even in areas where no earthquakes have historically been observed and where (probabilistic) seismic hazard is mapped as low. As such, there is no zero-hazard area on the map.</p></list-item><list-item><label>G3</label>
      <p id="d1e207">The highest end of the hazard distribution has a large impact on expected losses, and the highest hazards thus differ from the preceding levels of high hazard.</p></list-item><list-item><label>G4</label>
      <p id="d1e211">Spatial patterns of hazard may be more important (e.g., for situational awareness) than the specific magnitude of the hazard.</p></list-item></list></p>
</sec>
<sec id="Ch1.S1.SS3">
  <label>1.3</label><title>Visual communication for hazard maps</title>
      <p id="d1e222">Beyond identifying communication goals, mapping seismic hazard requires many practical choices on how to best represent the hazard values on a map. Though the amount of literature on the visual communication of seismic hazard is far smaller than on the models thereof, previous scholars have investigated how to best map seismic hazard.</p>
      <p id="d1e225"><xref ref-type="bibr" rid="bib1.bibx23" id="text.7"/> provide a series of general guidelines they call “experience-based” regarding which hazard parameters to map and how to select colors and graphical elements for seismic hazard maps. These issues are also highlighted in <xref ref-type="bibr" rid="bib1.bibx22" id="text.8"/>, who investigate candidate seismic hazard maps for the Vancouver, Canada, metro area with a stakeholder workshop and survey. The authors identify three key factors for effective visual communication: (1) choosing the right colors and graphical properties, (2) choosing appropriate hazard metrics and classifying them into discrete intervals for the map, and (3) using accessible data formats. Similar studies on flood and volcano hazard communication have designed hazard maps and evaluated them with focus groups and interviews <xref ref-type="bibr" rid="bib1.bibx28 bib1.bibx48 bib1.bibx30" id="paren.9"/>.</p>
      <p id="d1e236">Complementary to these studies, <xref ref-type="bibr" rid="bib1.bibx45" id="text.10"/> use a large-sample online survey to study users' preferences and ability to read information off maps that present different seismic hazard information for Switzerland. They find that maps showing hazard via maximum expected earthquake magnitudes or intensities are less successful than traditional hazard maps showing, e.g., PGA. They conclude that this is<?pagebreak page2507?> because those alternate maps fail to follow best practices related to color and data classification but do not explain precisely what would improve them. <xref ref-type="bibr" rid="bib1.bibx68" id="text.11"/> use both semi-structured interviews and a survey with stakeholders to test different designs for volcanic hazard maps in New Zealand. They find that participants both prefer and have higher map-reading accuracy with maps where data are classified into discrete intervals and that changing the color palette can change the hazard level perceived for a given location, as also found for tornado hazard maps by <xref ref-type="bibr" rid="bib1.bibx50" id="text.12"/>.</p>
      <p id="d1e248">A common finding across previous research is the importance of colors and data classification in how hazard maps are used and interpreted. But authors omit specifics of how and why to make particular design choices, typically citing so-called “best practices” used in their hazard maps without evidence <xref ref-type="bibr" rid="bib1.bibx28 bib1.bibx48 bib1.bibx22 bib1.bibx45" id="paren.13"/>. Indeed, <xref ref-type="bibr" rid="bib1.bibx68" id="text.14"/> summarize the state-of-the-art for hazard map design: “fundamental choices for color scheme … and data classification are largely driven by subjective preference.” The problem is that suboptimal choices for either aspect may lead to distortions in how hazard is understood, especially by non-scientific users <xref ref-type="bibr" rid="bib1.bibx20 bib1.bibx75 bib1.bibx15" id="paren.15"/>. There is a research gap in identifying which criteria should guide these essential decisions in designing a hazard map.</p>
</sec>
<sec id="Ch1.S1.SS4">
  <label>1.4</label><title>Criteria-based hazard mapping</title>
      <p id="d1e268">A vast body of literature exists on color palettes and data classification schemes, both for general uses and specifically for natural hazards. Theoretical work has provided frameworks for considering both map elements. For example, color models can parametrize all colors into distinct dimensions, which can help determine which aspects of color may be most critical for a hazard map. Similarly, scholars in cartography have proposed various methods of optimizing how data can be classified into groups for maps.</p>
      <?pagebreak page2508?><p id="d1e271">Research in these fields has further studied what effects different design decisions have on how well users can read and use the corresponding maps <xref ref-type="bibr" rid="bib1.bibx6 bib1.bibx38" id="paren.16"/>. In controlled experiments, users perform tasks that elucidate whether or not a design choice can produce maps that are not merely properly read but also properly understood. Such empirical evaluations can estimate the effects that a given design choice has on map-reading and perception. We use this literature to isolate which criteria can facilitate effective colors and data classification for seismic hazard maps.</p>
      <p id="d1e277">We then apply these criteria to redesign the German seismic hazard map in Fig. 1. Since several candidate maps are consistent with the color and classification criteria, we decide between them using the four target properties of hazard we seek to communicate (see Sect. 1.2). We thus heed the call of previous authors to design maps that satisfy clearly specified communication goals <xref ref-type="bibr" rid="bib1.bibx18 bib1.bibx69" id="paren.17"/>. We then rigorously evaluate our redesigned map against the baseline map to investigate how well users can read and understand seismic hazard from the two maps. In detailing our design and evaluation process, we attempt to provide a blueprint for future hazard map designers.</p>
</sec>
<sec id="Ch1.S1.SS5">
  <label>1.5</label><title>Research aims and contributions</title>
      <p id="d1e292">This work seeks to fill the research gap in systematizing how to select colors and classification schemes for hazard maps. We collect evidence-based practices from the color, visualization and cartographical literature, identifying criteria that are supported by empirical experiments. Our proposed method for hazard mapping is centered around not only following research-backed design criteria but also meeting communication targets about the hazard phenomenon.</p>
      <p id="d1e295">We showcase this method with a case study for the German seismic hazard map. We redesign the original hazard map following the specified criteria and making design choices to highlight the key properties of seismic shaking we wish to communicate. We then evaluate the redesigned map with a controlled mixed-methods survey, using questions for not only map-reading but also hazard perception, which should be a primary objective of visual communication <xref ref-type="bibr" rid="bib1.bibx18 bib1.bibx44" id="paren.18"/>. The perception questions in our evaluation survey are directly linked to the key properties we wish to communicate.</p>
      <p id="d1e301">The research questions we seek to address are as follows:
<list list-type="order"><list-item>
      <p id="d1e306">How can the design of seismic hazard maps be improved both to follow evidence-based practices and to aid the visual communication of key points about seismic hazard?</p></list-item><list-item>
      <p id="d1e310">How well can a hazard map, redesigned for better visual communication, be read and interpreted by a technical audience? How does this compare to the previous (baseline) map?</p></list-item></list></p><?xmltex \hack{\newpage}?>
</sec>
</sec>
<sec id="Ch1.S2">
  <label>2</label><title>Methods for selecting colors and classification schemes</title>
<sec id="Ch1.S2.SS1">
  <label>2.1</label><title>Color: literature review and best practices</title>
      <p id="d1e330">Color is a critical visualization variable because “it is considered pre-attentive, meaning that information is extracted by the eye intuitively and rapidly” <xref ref-type="bibr" rid="bib1.bibx64" id="paren.19"/>. It is also an expressive and associative variable, with different colors producing different connotations <xref ref-type="bibr" rid="bib1.bibx32" id="paren.20"/>. As such, care must be taken to select color palettes in hazard maps. There are well-evidenced criteria for selecting optimal colors for a palette and avoiding those colors that can lead to misinterpretations or unintended perceptions. For each criterion, we review the empirical literature that shows how ignoring it may endanger user understanding of data visualizations, including hazard maps.</p>
      <p id="d1e339">To introduce key color issues, we use a color model, which expresses every possible color with a set of distinct variables (usually three). In the Hue–Saturation–Lightness (HSL) model, any color can be specified using values for hue (0–360, representing the color's position on the color wheel), saturation (0–100, where increasing values correspond to more intense and deep versions of the color) and lightness (0–100, where increasing values correspond to lighter versions of the color, with 0 yielding pure black and 100 pure white). Many other color models exist that separate the color’s luminance from the color’s hue and its intensity, e.g., the HSL model and the CIE-LUV model <xref ref-type="bibr" rid="bib1.bibx77" id="paren.21"/>. Although more sophisticated color models have certain benefits (e.g., the CIE-LUV model transforms the color space such that lightness increases in nonlinear ways, which is closer to how the human eye perceives it), we use the simpler HSL model throughout this paper, as it is sufficient to describe the key color criteria we propose for hazard maps.</p>
      <p id="d1e345">In a typology for color palettes, <xref ref-type="bibr" rid="bib1.bibx9" id="text.22"/> posit that the perceptual order of the colors is a fundamental requirement when colors are to be compared (as in hazard maps), echoing earlier authors (e.g., <xref ref-type="bibr" rid="bib1.bibx67 bib1.bibx73" id="altparen.23"/>). Colors may be ordered by their value on variables within the color model (for example, hue, lightness and saturation); it is desired for a palette’s perceptual order based on any color variable to be the same as its order based on data value. It has been shown in user experiments that changes in color lightness are the primary driver of human perception of color differences, with hue being a secondary driver <xref ref-type="bibr" rid="bib1.bibx65 bib1.bibx37" id="paren.24"/>. Previous authors (e.g., <xref ref-type="bibr" rid="bib1.bibx70 bib1.bibx40" id="altparen.25"/>) have argued that a monotonic increase in the lightness of the colors is required for a perceptually ordered color palette. Empirical experiments have found that unordered palettes in maps can lead to inaccurate map-reading <xref ref-type="bibr" rid="bib1.bibx15" id="paren.26"/> and more difficulty in selecting between real map features <xref ref-type="bibr" rid="bib1.bibx61" id="paren.27"/>.</p>
      <?pagebreak page2509?><p id="d1e367"><?xmltex \hack{\newpage}?>Another key aspect of a successful color palette is perceptual uniformity, in which unit increases in data value correspond to unit increases in the perception of change between colors, consistently across the entire color palette <xref ref-type="bibr" rid="bib1.bibx9 bib1.bibx14" id="paren.28"/>. To achieve such a uniform perception of color differences throughout a map, authors have argued for not simply monotonic but linear progressions in color lightness across the entire palette <xref ref-type="bibr" rid="bib1.bibx60 bib1.bibx67" id="paren.29"/>. A palette that is not perceptually uniform can lead to perceptual distortions, with small data differences at one end of the palette being perceived differently than corresponding data differences at the other end (see Fig. 4 of <xref ref-type="bibr" rid="bib1.bibx14" id="altparen.30"/>). Such a non-uniform reading of data was found in <xref ref-type="bibr" rid="bib1.bibx75" id="text.31"/>; in an experiment, participants had to detect background patterns in maps with different color palettes. When using palettes where lightness changed nonlinearly (not perceptually uniform), participants were worse at detecting the background patterns for colors in the center of the palette. The problem was particularly bad for the rainbow color palette, which is known to not be perceptually uniform (see Sect. 3.3).</p>
      <p id="d1e384">A third critical aspect spotlighted by numerous authors is color discriminability <xref ref-type="bibr" rid="bib1.bibx9 bib1.bibx59" id="paren.32"/>. For users to correctly interpret a color map, colors indicating important differences in data value should be distinguishable from one another, both in the map and its legend <xref ref-type="bibr" rid="bib1.bibx73" id="paren.33"/>. Definitions for color discriminability have been proposed based on perceptual difference (i.e., difference in lightness or other color variables) <xref ref-type="bibr" rid="bib1.bibx46 bib1.bibx42" id="paren.34"/> or how colors are identified by color names <xref ref-type="bibr" rid="bib1.bibx25" id="paren.35"/>. Discriminable palettes have been associated with unit increases in both the hue and lightness profiles of a color palette <xref ref-type="bibr" rid="bib1.bibx73" id="paren.36"/>. <xref ref-type="bibr" rid="bib1.bibx25" id="text.37"/> found that palettes with optimized discriminability were superior to default palettes from oft-used software, as they often led participants in their experiment to more accurately identify which half of a map contained a reference color; participants also consistently preferred the palettes optimized for discriminability.</p>
      <p id="d1e406">Colors should also be chosen that have psychological associations that befit the phenomenon being mapped. A body of empirical literature suggests that colors have consistent associations across individuals, which may be culture-specific <xref ref-type="bibr" rid="bib1.bibx71" id="paren.38"/>. Typically, these studies ask participants to link a list of emotions or experiences with a set of colors. In many western cultures, blue is “often associated with openness, peace, and tranquility” <xref ref-type="bibr" rid="bib1.bibx47" id="paren.39"/> and blue and green have been found to have “the qualities of being comfortable and soothing” <xref ref-type="bibr" rid="bib1.bibx12" id="paren.40"/>. On the other hand, red hues have been found to be associated with dangers and risks within western cultures, while yellows are associated with caution and warning <xref ref-type="bibr" rid="bib1.bibx26" id="paren.41"/>, which has been found to persist across both western and Asian cultures <xref ref-type="bibr" rid="bib1.bibx53 bib1.bibx11" id="paren.42"/>. In a user experiment, <xref ref-type="bibr" rid="bib1.bibx41" id="text.43"/> found quicker responses on a chart-reading task when charts were colored using “semantically resonant” colors that respected common western associations rather than colors that did not, especially when the data being presented were more “colorable”, i.e., had a larger degree of color associations.</p>
      <p id="d1e428">Finally, colors should be chosen based on principles of accessibility and inclusion, including for those audience members with color vision deficiency (CVD) or the inability to differentiate between certain colors. About 8 % of males of European Caucasian ancestry suffer from some CVD; in other populations, the prevalence is lower but still non-trivial <xref ref-type="bibr" rid="bib1.bibx3" id="paren.44"/>. The most common forms of CVD are deuteranomaly and protanomaly (red–green blindness) in which reds and greens of equal lightness are both seen as an identical shade of dark yellow (see Fig. S1 in the Supplement). People with this CVD can misread maps using color palettes that combine red and green. In <xref ref-type="bibr" rid="bib1.bibx52" id="text.45"/>, participants with red–green blindness could read off colors and features in maps significantly better when using color palettes that were CVD-friendly (monotonically varying in lightness and avoiding red–green combinations) vs. CVD-unfriendly (varying in hues and lightness with red and green together).</p>
<sec id="Ch1.S2.SS1.SSS1">
  <label>2.1.1</label><title>Criteria for selecting color palettes</title>
      <p id="d1e444">The literature on which color aspects are critical for effective visual communication has not been ignored by other geoscientific communities. <xref ref-type="bibr" rid="bib1.bibx66" id="text.46"/> discuss color concepts for heat maps common in meteorology, pinpointing the importance of differences in lightness across the palette and appropriate color conventions. <xref ref-type="bibr" rid="bib1.bibx70" id="text.47"/> provide color guidelines and palettes for oceanography, spotlighting perceptual uniformity, cultural implications and colorblind-friendliness as key criteria. <xref ref-type="bibr" rid="bib1.bibx31" id="text.48"/> proposes a “perception-informed color palette” for heat maps for avalanche science, optimizing it to be accessible for various CVDs. Expanding on this literature, we propose the following five critical criteria for consideration when choosing colors for hazard maps. While we do not claim these criteria are either sufficient or minimal for hazard map design, they align with lists and typologies published elsewhere; see, e.g., <xref ref-type="bibr" rid="bib1.bibx70" id="text.49"/>, <xref ref-type="bibr" rid="bib1.bibx9" id="text.50"/>, and  <xref ref-type="bibr" rid="bib1.bibx62" id="text.51"/>.
<list list-type="custom"><list-item><label>C1</label>
      <p id="d1e468"><italic>Perceptual order</italic>. Colors in the color scale should follow a natural, intuitive progression.</p></list-item><list-item><label>C2</label>
      <p id="d1e474"><italic>Perceptual uniformity</italic>. The perception of difference between adjacent color levels should be uniform across each adjacent pair of colors.</p></list-item><list-item><label>C3</label>
      <p id="d1e480"><italic>Discriminability</italic>. Colors in the color palette should be distinct and immediately discernible by most users, in both the map and legend.</p></list-item><list-item><label>C4</label>
      <?pagebreak page2510?><p id="d1e486"><italic>Appropriate associations</italic>. Color associations should be relevant to the data being mapped, based on culturally specific associations reported in the literature.</p></list-item><list-item><label>C5</label>
      <p id="d1e492"><italic>Accessibility</italic>. Colors should be readable and discriminable across the population, e.g., for users with CVD.</p></list-item></list></p>
</sec>
</sec>
<sec id="Ch1.S2.SS2">
  <label>2.2</label><title>Classification schemes: literature review and best practices</title>
      <p id="d1e506">The seismic hazard values plotted on any hazard map generally take a continuous distribution. In order to map them using a discrete color palette, we need to select a classification scheme or a procedure for classifying the continuous distribution into a set of distinct intervals that get assigned to a color. There are numerous approaches for this problem, and we review the statistical and cartographic solutions in the literature.</p>
      <p id="d1e509">Earlier work in cartography has largely advocated for mapping continuous variables with a discrete set of colors rather than a continuous color palette spanning the data range. Many authors have argued that it is more difficult for users to accurately discriminate colors and read values off continuous maps <xref ref-type="bibr" rid="bib1.bibx16 bib1.bibx36" id="paren.52"/>, though this has been debated in the literature <xref ref-type="bibr" rid="bib1.bibx72 bib1.bibx51" id="paren.53"/>. Still, discrete maps are ubiquitous for depicting natural hazards, especially for public communication <xref ref-type="bibr" rid="bib1.bibx57" id="paren.54"/>. The utility of discrete maps has been studied with perception tasks in user experiments. In <xref ref-type="bibr" rid="bib1.bibx55" id="text.55"/>, participants saw elevation maps using either continuous or discrete classification schemes and were more error-prone with the continuous map compared to the discrete maps, particularly for tasks requiring a steepness judgment. <xref ref-type="bibr" rid="bib1.bibx45" id="text.56"/> also found that participants had complaints about the continuous color scale the authors used in their seismic hazard maps and suggested that a discrete map would be more effective, as was echoed by <xref ref-type="bibr" rid="bib1.bibx22" id="text.57"/>.</p>
      <p id="d1e531">Classification schemes can thus lead to better reading and interpretation of hazard maps. The first step for many classification schemes is to consider the number of categories, and thus colors, that will be used in the map. Some authors have suggested that between five and seven categories can be well-distinguished, with their meanings remembered <xref ref-type="bibr" rid="bib1.bibx43 bib1.bibx49" id="paren.58"/>, based on principles of level-of-detail management and cartographic generalization <xref ref-type="bibr" rid="bib1.bibx13" id="paren.59"/>. Still, the effects of the number of categories in discrete maps on, e.g., hazard or risk perception has yet to be empirically studied. We thus posit that the optimal number of categories is determined by the distribution and patterns of the data being mapped, as well as other map-specific features. Because it is difficult for map users to discern an overabundance of categories, as described above, it is critical that discrete maps use only so many categories as can completely convey the important patterns in the data.</p>
      <p id="d1e540">The map designer must also select between numerous available classification methods. The most basic approaches evenly split the data distribution into either equal intervals or equal quantiles (that is, equal probability mass). While such approaches may have the advantage of appearing conceptually straightforward, they ignore the characteristics of the data being plotted, e.g., skewness, multimodality or spatial clustering. In particular, these schemes group together data into classes based on an arguably arbitrary criterion (equal class width and equal number of data points for the equal intervals and quantile-based schemes, respectively). This may distort the map, creating patterns that do not exist in the data rather than highlighting those that do <xref ref-type="bibr" rid="bib1.bibx20" id="paren.60"/>.</p>
      <p id="d1e547">Authors have proposed other solutions that split a dataset into classes based on more rigorous quantitative criteria, such that values assigned to a class are more alike than those between separate classes. The most common classification approach used today was proposed independently in the statistical <xref ref-type="bibr" rid="bib1.bibx21" id="paren.61"/> and geographical literature <xref ref-type="bibr" rid="bib1.bibx33" id="paren.62"/> and has become widely adopted. Given a fixed number of classes, the Fisher scheme attempts to find the split of the data that minimizes the variance of points within each class. The resulting breaks (also referred to as natural breaks and common across geographic information systems) have optimally (1) grouped data points together and (2) split data points apart that are sufficiently dissimilar. Other classification approaches attempt to, e.g., fit statistical parameters onto the dataset or prioritize spatial contiguity in the resulting map; see typologies of classification methodology in <xref ref-type="bibr" rid="bib1.bibx20" id="text.63"/> and <xref ref-type="bibr" rid="bib1.bibx1" id="text.64"/>. Techniques also exist for right-skewed data, such as the Head–Tails scheme <xref ref-type="bibr" rid="bib1.bibx34" id="paren.65"/>, where the dataset is first split at its mean into its “head” and its “tail”, which contains the data’s long skew. The tail is again split at its mean, and this procedure continues iteratively, until some stopping point is reached (see examples in <xref ref-type="bibr" rid="bib1.bibx34" id="altparen.66"/>, and <xref ref-type="bibr" rid="bib1.bibx35" id="altparen.67"/>); the split points from each step of the procedure (mean of that step’s tail) comprise the class breaks.</p>
      <p id="d1e572">The algorithmic classification schemes discussed above do not consider whether some data values may carry particular meaning, as they depend solely on the distribution rather than the context of the data. However, authors have discussed forming class breaks around meaningful values, e.g., using 50 % as a class break when mapping voting results between two parties to symbolize the winning party, regardless of the distribution of voting results <xref ref-type="bibr" rid="bib1.bibx7" id="paren.68"/>. <xref ref-type="bibr" rid="bib1.bibx20" id="text.69"/> advocates that such “class limits will be used in the few instances where they are available.” Though no literature exists to compare such pre-selected meaningful class breaks against algorithmic alternatives, we posit that including breaks known to carry particular meaning can be beneficial to hazard communication.</p>
<?pagebreak page2511?><sec id="Ch1.S2.SS2.SSS1">
  <label>2.2.1</label><title>Criteria for selecting classification schemes</title>
      <p id="d1e588">Some previous studies in the natural hazards have compared different schemes by studying their misclassification errors (e.g., <xref ref-type="bibr" rid="bib1.bibx10" id="altparen.70"/>, compares the Fisher, Head–Tails and several other schemes for landslide susceptibility maps). To our knowledge, there is no previous literature on how classification schemes affect risk or hazard perception in users, neither for natural hazards nor for other topics. This research gap means that, unlike colors, factors beyond experimental evidence must be used to select between classification schemes. Based on the literature surveyed, we propose the following three criteria as critical for selecting a classification scheme for hazard maps.
<list list-type="custom"><list-item><label>L1</label>
      <p id="d1e596"><italic>Likeness</italic>. The classes in the classification scheme should contain all data that are alike, based on a quantitative measure, and should break apart data that are not alike.</p></list-item><list-item><label>L2</label>
      <p id="d1e602"><italic>Sufficiency and completeness</italic>. There should be enough (but not too many) scale breaks in order to be able to immediately see the primary patterns in the data.</p></list-item><list-item><label>L3</label>
      <p id="d1e608"><italic>Signification</italic>. Scale breaks should ideally signify meaningful values or changes in the distribution rather than arbitrarily selected values.</p></list-item></list></p>
</sec>
</sec>
</sec>
<sec id="Ch1.S3">
  <label>3</label><title>Application to German seismic hazard</title>
      <p id="d1e623">In this section, we apply the criteria and concepts introduced in Sect. 2.1 and 2.2 to redesign the German seismic hazard map presented in Fig. 1.</p>
<sec id="Ch1.S3.SS1">
  <label>3.1</label><title>Hazard analysis and issues for Germany</title>
      <p id="d1e633">Seismic hazard in Germany is spread across several regions, particularly the Hohenzollerngraben region (near Albstadt), the Rhine valley (near Aachen), and in contours surrounding these regions across central-western and southwestern Germany. There is also an elevated hazard zone in eastern Germany, east of Chemnitz. Basics of the tectonic and structural geological rationale behind the development of the PSHA model are provided in <xref ref-type="bibr" rid="bib1.bibx27" id="text.71"/>. Seismic building standards for Germany are required for ordinary structures but only where seismic hazard is sufficiently high, i.e., above a PGA threshold of 0.4 m s<inline-formula><mml:math id="M2" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> (for essential infrastructure, e.g., dams or nuclear power plants, stricter standards apply). This value thus became a critical threshold in our hazard map redesign (see Sect. 3.2). Although it stems from a specialist user group, we posit it will be useful for all users to distinguish “non-significant” hazard (PGA <inline-formula><mml:math id="M3" display="inline"><mml:mo>&lt;</mml:mo></mml:math></inline-formula> 0.4 m s<inline-formula><mml:math id="M4" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>) from the rest of the hazard distribution.</p>

      <fig id="Ch1.F2" specific-use="star"><?xmltex \currentcnt{2}?><?xmltex \def\figurename{Figure}?><label>Figure 2</label><caption><p id="d1e671">Classification schemes (left) and color palettes (right) for the baseline German seismic hazard map (<bold>a</bold>; see Fig. 1) and the redesigned version (<bold>b</bold>; see Fig. 4), following the criteria described in Sect. 2. Lightness and hue profiles indicate the extent to which the color palettes follow several criteria given in Sect. 2.1.</p></caption>
          <?xmltex \igopts{width=369.885827pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023-f02.png"/>

        </fig>

</sec>
<sec id="Ch1.S3.SS2">
  <label>3.2</label><title>Choosing the classification scheme</title>
      <p id="d1e694">We first chose a classification scheme to represent the continuous distribution of mean PGA in a discrete map. The baseline classification scheme (see Fig. 1) covers a larger range than the values plotted in the map, likely because the legend is intended to cover a wider span of the PSHA ensemble than just its mean (see Fig. 25 in <xref ref-type="bibr" rid="bib1.bibx27" id="altparen.72"/>, that uses the same legend to represent a larger range of values). It is furthermore the legend used for an interactive web portal which shows extreme percentiles from the German seismic hazard assessment <xref ref-type="bibr" rid="bib1.bibx24" id="paren.73"/>. As we are solely interested in a static single-map representation of seismic hazard (i.e., one that may be used in news media or reports for decision-makers), we limit our scale to only those values in the mean PGA map.</p>
      <p id="d1e703">The baseline map uses a modified equal-interval scheme with round decimals, where the interval increases with increasing PGA. While this may seem a straightforward approach, the breaks chosen do not meet the criteria listed in Sect. 2.2. In particular, they do not carve out similar hazard levels into separate classes using the underlying data (criterion L1); they are moreover chosen based on other data not shown in this plot (lower and upper percentiles of the PGA distribution) rather than the data being mapped (mean PGA; see Sect. 1.1). The baseline scheme also has 16 categories, which is far above the literature-backed rules of thumb detailed in Sect. 2.2. Failing to consider sufficiency (criterion L2) in favor of including extra detail comes with the additional need to assign the excess of classes to colors, many of which are difficult to distinguish from one another (color criterion C3). Finally, these breaks fail to communicate meaningful hazard values (criterion L3) as they are arbitrarily chosen round intervals, which are not  necessarily related to the key thresholds of seismic hazard in Germany.</p>
      <p id="d1e706">We developed a new classification scheme that meets our three pre-specified criteria for classification. We first split the distribution of hazard values into “lower” and “higher” classes based on the critical value of 0.4 m s<inline-formula><mml:math id="M5" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>, the hazard level at which seismic building standards must be applied in Germany. The hazard values below 0.4 m s<inline-formula><mml:math id="M6" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> (the “lower” part) were split into three classes, and the values above 0.4 m s<inline-formula><mml:math id="M7" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> (the “higher” part) were split into five classes, for a total of eight classes. In each part, we used the Fisher classification scheme (satisfying criterion L1), as implemented in the classIntervals function in the classint package in R <xref ref-type="bibr" rid="bib1.bibx4" id="paren.74"/>. Our classification thus communicates a critical value that splits seismic hazard for Germany, satisfying criterion L3. Unlike in the baseline map, the redesigned classification scheme was capped at the maximal value for the mean PGA data being mapped (criterion L1).</p>
      <p id="d1e748">We also experimented with several other classification schemes. We first considered different numbers of classes and created maps with five to nine total classes, split in several ways between the “lower” and “higher” parts of the<?pagebreak page2512?> distribution. We settled on the split shown in Fig. 2, as this was the smallest number of classes in each part that sufficiently represented the spatial patterns of hazard across Germany (criterion L2). This also aligns with property G4 of our communication goals regarding keeping spatial patterns salient (see Sect. 1.2).</p>
      <p id="d1e752">Since seismic hazard follows a long-tailed distribution, we also considered the Head–Tails scheme on the “higher” part, stopping the algorithm at the step when its tail did not contain at least 40 % of the full set (see Fig. S2). This broke the high-hazard values into eight classes. Only southwestern Germany had a noticeable difference in the depiction of hazard, as this is where the highest hazard is located. Figure 3 shows that the Head–Tails scheme used four more classes to depict this steep increase in hazard, relative to the Fisher scheme. As one of our communication goals is to avoid hazard differences appearing concentrated in space (properties G1 and G2 of our communication goals), we opted against the Head–Tails scheme. We also experimented with an equal-quantile classification scheme (see Fig. S3), as this was preferred by a single empirical study we found <xref ref-type="bibr" rid="bib1.bibx7" id="paren.75"/>, but opted against this as it flattened the visual distinction between hazard values at the top of the distribution, opposing property G3.</p>

      <fig id="Ch1.F3" specific-use="star"><?xmltex \currentcnt{3}?><?xmltex \def\figurename{Figure}?><label>Figure 3</label><caption><p id="d1e759">A closeup of southwestern Germany for the seismic hazard maps made using the Fisher class breaks (<bold>a</bold>; see Fig. 4 for the full map) and the Head–Tails class breaks (<bold>b</bold>; see Fig. S2 for the full map).</p></caption>
          <?xmltex \igopts{width=369.885827pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023-f03.png"/>

        </fig>

</sec>
<sec id="Ch1.S3.SS3">
  <label>3.3</label><title>Choosing the color palette</title>
      <p id="d1e782">We attempted to improve on the rainbow color palette, which is commonly used for seismic hazard (Fig. S4 in the Supplement shows several other published seismic hazard maps, most employing a similar color palette). Despite the ubiquity of the rainbow palette <xref ref-type="bibr" rid="bib1.bibx5 bib1.bibx76" id="paren.76"/>, scholars have described why it is in fact “unscientific” <xref ref-type="bibr" rid="bib1.bibx14" id="paren.77"/>, particularly for hazard maps. The hue and lightness profiles of Fig. 1's rainbow palette are given in Fig. 2 and this sheds light on why it fails to meet the five criteria isolated in Sect. 2.1:
<list list-type="bullet"><list-item>
      <p id="d1e793">Neither the lightness nor hue profiles are monotonic, meaning that it is not perceptually ordered (criterion C1).</p></list-item><list-item>
      <p id="d1e797">The lightness profile is nonlinear, meaning that it is not perceptually uniform (criterion C2).</p></list-item><list-item>
      <p id="d1e801">Many of the colors, especially at the upper end of the scale, are non-discriminable, possibly because they cover a limited range of hues (criterion C3).</p></list-item><list-item>
      <p id="d1e805">The palette uses blue and green shades that are commonly connoted with peaceful, tranquil and soothing associations in western cultures, which are not appropriate for a hazard map (criterion C4).</p></list-item><list-item>
      <p id="d1e809">The palette combines reds and greens, making it not CVD-accessible (criterion C5).</p></list-item></list>
The rainbow palette’s lightness profile (see Fig. 2) leads to further problems, as pinpointed by previous authors. When used in maps, this palette can cause the appearance of “false gradients introduced by a non-monotonic lightness profile, which accelerates at a different rate than the data it represents” <xref ref-type="bibr" rid="bib1.bibx70" id="paren.78"/>. The result is that map subregions may appear to be of nearly identical color and then sharply transition to another color. This can falsely be interpreted by viewers as a real gradient in the data, which “actively misleads the viewer by introducing artifacts to the visualization” <xref ref-type="bibr" rid="bib1.bibx5" id="paren.79"/>.</p>
      <p id="d1e819">To address these issues, we designed a new color palette following the five criteria given in Sect. 2.1. We began with a yellow–orange–red color scheme with eight colors (Yl-Or-Rd-8) from RColorBrewer, an evidence-based palette tool <xref ref-type="bibr" rid="bib1.bibx29" id="paren.80"/>. This color palette is known to be accessible to people with the most common forms of CVD, as it does not combine red and green (criterion C5). Yl-Or-Rd-8 also has a monotonic progression of both lightness and hue, thus allowing a single intuitive perceptual order (criterion C1); it can also be modified to optimize discriminability (criterion C3) and for linear jumps in lightness and hue, creating perceptual uniformity (criterion C2). Furthermore, Yl-Or-Rd-8 has clear cultural connotations in western cultures that begin with caution and preparation (yellows) and rise to danger and risk (reds) (criterion C4). This palette has furthermore been supported to depict different degrees of hazard by literature reviews <xref ref-type="bibr" rid="bib1.bibx6" id="paren.81"/>, focus groups <xref ref-type="bibr" rid="bib1.bibx22" id="paren.82"/>, user experiments <xref ref-type="bibr" rid="bib1.bibx50 bib1.bibx68" id="paren.83"/> and guidelines for science communication <xref ref-type="bibr" rid="bib1.bibx17 bib1.bibx30" id="paren.84"/>.</p>
      <p id="d1e837">We chose three shades of yellow for the first three colors (see Fig. 2). Lightness and hue progressed in even jumps from the lightest shade of yellow that was visible on a white background (as in the legend) to the darkest shade of yellow produced by the Yl-Or-Rd-8 color scheme. This was to associate the first three scale breaks with caution, as these correspond to the “lower” part of the distribution. For the next five colors (the “higher” part of the distribution), we made exactly even jumps in both lightness and hue (criterion C2) between the final yellow color and a dark red color produced by the Yl-Or-Rd-8 scheme. We found that this led to several shades of red that were difficult to differentiate, and we manually adjusted the color lightness and saturation until the colors were judged to be discriminable (criterion C3) while maintaining the same color order in both hue and lightness (criterion C1). We then modified the final color's hue to diverge slightly from the Yl-Or-Rd-8 palette, in order to highlight how the highest end of the hazard distribution differs from the high hazard preceding it (property G3 of our communication goals; see Sect. 1.2). We chose a shade of dark brown that preserves perceptual order, uniformity and discriminability of the overall color scheme while maintaining relevant color connotations and colorblind-friendliness.</p>
</sec>
<?pagebreak page2513?><sec id="Ch1.S3.SS4">
  <label>3.4</label><title>Choosing the legend and annotations</title>
      <p id="d1e849">Finally, we also experimented with different legend types and map annotations, which also have a (limited) base of empirical literature. The baseline map positioned its legend under the map, possibly because it was part of a set of three maps. In our redesign, we follow traditional cartographic style and position the legend on the right side of the map, which <xref ref-type="bibr" rid="bib1.bibx19" id="text.85"/> has shown can lead to faster processing of the map. We follow <xref ref-type="bibr" rid="bib1.bibx39" id="text.86"/> in aligning the position of the color patches and labels and having a larger spacing between the label and its color patch than between adjacent color patches.</p>
      <p id="d1e858">We further added several layers of annotation to the redesigned hazard map. We marked key cities in Germany, either with a land area above 65 km<inline-formula><mml:math id="M8" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:math></inline-formula> or that were in important hazard zones. We marked each city with a polygon showing its boundaries rather than a single point positioned at its geographical center. This followed internal evaluation (see Sect. 4 and Supplement Sect. S6) and spotlights how urban seismic hazard can span multiple hazard levels in many German cities. We added labels for each city, printed in black where the background color was sufficiently light and white where the background color was too dark (Albstadt), following recommendations from <xref ref-type="bibr" rid="bib1.bibx8" id="text.87"/>. We considered labeling contours corresponding to important<?pagebreak page2514?> hazard values but ultimately omitted these (see Supplement Sect. S6).</p>

      <fig id="Ch1.F4" specific-use="star"><?xmltex \currentcnt{4}?><?xmltex \def\figurename{Figure}?><label>Figure 4</label><caption><p id="d1e874">Redesigned German seismic hazard map fulfilling evidence-based criteria for color (see Sect. 2.1) and data classification (see Sect. 2.2).</p></caption>
          <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023-f04.png"/>

        </fig>

</sec>
</sec>
<sec id="Ch1.S4">
  <label>4</label><title>Evaluating redesigned seismic hazard maps</title>
      <p id="d1e892">We tested the redesigned German seismic hazard map in a two-phase evaluation. We first created multiple prototypes that differed on certain features (e.g., the classification scheme or how cities were marked on the maps) and solicited structured feedback from seismic hazard experts. This is described in Supplement Sect. S6. The expert feedback helped us finalize a single redesigned map (see Fig. 4) which, in the second phase, we compared to the baseline map with a controlled user survey focusing on the users' awareness of the four seismic hazard properties and one critical threshold.</p>
<sec id="Ch1.S4.SS1">
  <label>4.1</label><title>Participants and design</title>
      <p id="d1e902">For the user survey, we recruited early career researchers in the natural and engineering sciences from universities in Germany where the authors are affiliated. The participants had some expertise in geosciences or engineering but not necessarily in seismic hazard, which is similar to many of the technical users of hazard maps. We developed the survey in the survey platform Qualtrics and then invited these researchers to evaluation workshops, in which they completed the survey, and we then presented the research behind the redesigned map. Invited researchers were also able to take the online survey at a later time during a fixed period. A total of 43 individuals began the survey, and 5 did not complete questions for both maps, meaning they were excluded from analysis. Another participant did not provide responses to the open-ended and demographics questions but was still included in the other analyses. The final sample included 38 participants (42.1 % female, median age of 30).</p>

      <fig id="Ch1.F5" specific-use="star"><?xmltex \currentcnt{5}?><?xmltex \def\figurename{Figure}?><label>Figure 5</label><caption><p id="d1e906">Participant responses for hazard perception questions, under each map. Questions related to each hazard property (see Sect. 1.2) and the seismic building code threshold. Agreement responses (colored with greens) indicate awareness of the hazard property/threshold. See Supplement Sect. S7 for the set of hazard perception questions.</p></caption>
          <?xmltex \igopts{width=426.791339pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/23/2505/2023/nhess-23-2505-2023-f05.png"/>

        </fig>

      <p id="d1e915">We pre-registered the survey and analysis plan in the Open Science Framework (<uri>https://osf.io/puerc/?view_only=2b747decfbfb4093a9e925e5fe09cd48</uri>, last access: 10 October 2022). The study was approved by the Institute for Advanced Sustainability Studies (IASS) ethics ombudsperson following the IASS procedure for ethics approval.</p>
      <p id="d1e921">Participants began by reading a basic explanation of PSHA and what seismic hazard maps show. They were asked to use only the given map to answer the question rather than any other maps or background knowledge. After providing informed consent, they answered map-reading and hazard perception questions first with one map and then with the other (within-participant design), with the map order randomly assigned. We developed two equivalent versions of each map-reading and hazard perception question, and the question version was assigned randomly and such that no question would be repeated on both maps.</p>
      <p id="d1e925">Map-reading questions asked participants to read off the maximum hazard level for a given city. Participants answered three of these questions for each map, and their responses were scored for accuracy. Hazard perception questions were designed around the four hazard properties (see Sect. 1.2). For each property, we posed a statement about a city or pair of cities on the map and asked for the participant’s level of agreement on a seven-point scale with the following labels: “strongly disagree”, “disagree”, “slightly disagree”, “neither agree nor disagree”, “slightly agree”, “agree” and “strongly agree”. Cities were chosen such that agreement with the statement indicated an awareness of that hazard property. For example, for property G1 (seismic hazard is not spotty, it changes continuously over space), participants marked their agreement with the statement: “Damaging shaking may be expected in Düsseldorf, according to the map” (Düsseldorf is in a zone of moderate hazard for Germany, contouring off a high-hazard zone near Aachen, and thus could expect damaging shaking). The full set of evaluation questions is provided in Supplement Sect. S7.</p>
      <p id="d1e928">We also asked for participants’ perception on whether particular cities needed seismic-resistant design for ordinary buildings. The aim was to see whether our redesign could sufficiently communicate the critical threshold of 0.4 m s<inline-formula><mml:math id="M9" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> without needing to provide this explicitly. We asked about two sets of cities: those we expected to be simple (at extreme ends of the scale) or difficult (in the middle of the scale).</p>
      <p id="d1e943">While these perception questions have no “correct answers,” we associated awareness of the hazard property with agreement with the statement.
We then simply analyzed the within-participant differences in response between the two maps to see if either map improved hazard awareness. Our inferential analysis for both map-reading and hazard perception compared these map differences (within-participant) to zero, using the Wilcoxon signed rank test, a non-parametric extension of the paired-sample <inline-formula><mml:math id="M10" display="inline"><mml:mi>t</mml:mi></mml:math></inline-formula> test. Given the discrete nature of these data, we used the Pratt correction for ties <xref ref-type="bibr" rid="bib1.bibx56" id="paren.88"/>. We set the significance threshold to 5 % and accounted for multiple testing with the Bonferroni correction.</p>
      <p id="d1e956">After completing the map-reading and hazard perception questions for both maps, the participants answered three open-response questions. We asked for participants' preference between the two maps and reasoning behind this, what they would change about either map to make it more useful, and which evaluation questions they found difficult. We used a systematic and intersubjectively verifiable approach to qualitatively analyze participant responses. After individually reading through all responses, we identified a set of distinct themes that could characterize the content in each response. We allowed each response to be categorized by one or more themes and studied the frequency and meaning of the theme categories. Finally, we asked for participants’ demographics (age, gender, nationality) and academic background (university, discipline of study) to explore potential relationships between these and map effects.</p>
</sec>
<?pagebreak page2515?><sec id="Ch1.S4.SS2">
  <label>4.2</label><title>Evaluation results</title>
      <p id="d1e967">The first set of questions targeted how accurately participants could read values off the two maps. The majority of participants could accurately read most cities off both maps (see Fig. S5), with participants averaging 71.9 % correct with the baseline and 77.2 % with the redesigned maps. The maps were statistically indistinguishable in how accurately participants read them (<inline-formula><mml:math id="M11" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.4835</mml:mn></mml:mrow></mml:math></inline-formula>).</p>
      <p id="d1e982">We then estimated how each map affected the perception of the hazard properties (see Fig. 5). The first property was that seismic hazard is not spotty but rather changes continuously in space. There was greater agreement with the statements related to this property for the redesigned map (81.6 % “in agreement”, or selecting one of the three “agree” options) than for the baseline map (36.8 % in agreement). The 95 % confidence interval (CI) for the difference in response between the redesigned and baseline map was entirely positive, meaning that the redesigned map significantly improved awareness of this hazard property (<inline-formula><mml:math id="M12" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.000019</mml:mn></mml:mrow></mml:math></inline-formula>). The second property was about seismic hazard being possible even in areas where hazard is not mapped as high. We again found that participants agreed with the corresponding statements more for the redesigned map (89.5 % in agreement), than for the baseline map (60.5 % in agreement). The 95 % CI for the participant-specific difference between maps was entirely positive, so participants showed significantly (<inline-formula><mml:math id="M13" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.0013</mml:mn></mml:mrow></mml:math></inline-formula>) more awareness of this property using the redesigned map.</p>
      <p id="d1e1009">The differences between the maps were smaller regarding perception of the other hazard properties. Both maps facilitated understanding of the third property (highest hazard differs from high hazard), with the vast majority responding “agree” or “strongly agree” across both maps. The 95 % CI for this difference contained zero, meaning the difference was not statistically significant (<inline-formula><mml:math id="M14" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.014</mml:mn></mml:mrow></mml:math></inline-formula>), when accounting for multiple testing. Both maps also equivalently conveyed the fourth property (spatial patterns of hazard are more meaningful than the hazard values), meaning that the difference in response for these questions was not statistically significant (<inline-formula><mml:math id="M15" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.53</mml:mn></mml:mrow></mml:math></inline-formula>).</p>
      <?pagebreak page2516?><p id="d1e1036">We also asked several questions about whether certain cities were perceived to need seismic building codes due to their hazard level. The difference between maps was negligible for cities where this question was more straightforward (Albstadt and Leipzig, both at extreme ends of the scale). Both maps led participants to correctly perceive that Albstadt requires building codes and Leipzig does not (78.9 % of participants in agreement for the baseline map and 81.6 % for the redesigned map), so the 95 % CI for this map difference crossed zero (<inline-formula><mml:math id="M16" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.76</mml:mn></mml:mrow></mml:math></inline-formula>). For cities where this distinction was less clear (Freiburg, which requires building codes; Frankfurt, which does not), there was a slight difference between maps. The redesigned map led participants to more often make interpretations consistent with the actual building code (65.8 % consistent with the building code), compared to the baseline map (34.2 % consistent), though the within-participant difference was marginally insignificant when accounting for multiple testing (<inline-formula><mml:math id="M17" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.046</mml:mn></mml:mrow></mml:math></inline-formula>), with its 95 % CI containing zero.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T1" specific-use="star"><?xmltex \currentcnt{1}?><label>Table 1</label><caption><p id="d1e1067">Themes referred to by participants when describing their preference between the baseline and redesigned maps and the proportion of times the theme was mentioned across responses.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="3">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Theme</oasis:entry>
         <oasis:entry colname="col2">Baseline</oasis:entry>
         <oasis:entry colname="col3">Redesign</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Color features (discriminability, perceptual uniformity, etc.)</oasis:entry>
         <oasis:entry colname="col2">50.00</oasis:entry>
         <oasis:entry colname="col3">37.04</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Communication of hazard and risk (e.g., critical hazard values)</oasis:entry>
         <oasis:entry colname="col2">3.85</oasis:entry>
         <oasis:entry colname="col3">18.52</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Communication of high hazard levels</oasis:entry>
         <oasis:entry colname="col2">0.00</oasis:entry>
         <oasis:entry colname="col3">11.11</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Color associations/conventions</oasis:entry>
         <oasis:entry colname="col2">23.08</oasis:entry>
         <oasis:entry colname="col3">7.41</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Issues with data classification</oasis:entry>
         <oasis:entry colname="col2">7.69</oasis:entry>
         <oasis:entry colname="col3">11.11</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Issues with upper end of data scale</oasis:entry>
         <oasis:entry colname="col2">11.54</oasis:entry>
         <oasis:entry colname="col3">7.41</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Other</oasis:entry>
         <oasis:entry colname="col2">3.85</oasis:entry>
         <oasis:entry colname="col3">7.41</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Total</oasis:entry>
         <oasis:entry colname="col2">100</oasis:entry>
         <oasis:entry colname="col3">100</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table><?xmltex \gdef\@currentlabel{1}?></table-wrap>

      <p id="d1e1196">We then qualitatively analyzed feedback questions, seeking to identify the recurring themes across responses. The first feedback question asked participants for their preferred map and the reasons why. While 52.6 % of the participants preferred the redesign map, 31.6 % preferred the baseline and 15.8 % did not indicate a single preference. Despite different preferences, color features (discriminability, perceptual uniformity, etc.) were most commonly mentioned by both groups (see Table 1). For example, a participant who preferred the baseline map found it “easier to discriminate between different colors than different tones of red”, and a different participant who preferred the redesigned map said “it more clearly implies a continuous increase in danger”. Participants who preferred the redesign also reported a greater range of reasons, e.g., commonly addressing either critical or particularly high hazard levels. For example, one participant found that with the redesign, “it is easier to identify where the most exposed areas are located”.</p>
      <p id="d1e1199">Responses to the other feedback questions were more similar between participants that preferred one map over the other. Regarding which aspects of the map could be improved, participants commonly brought up classification breaks needing to be meaningful or interpretable; for example, a participant asked “which PGA could really affects constructions [sic] or be of potential threat to anyone/anything?”. Participants also mentioned that the double legend labels were difficult to interpret. Nearly half of the participants (47.4 %) reported having no issue with the survey, and the issues that were reported were evenly spread across participants. Problems that were mentioned by multiple participants included not understanding thresholds corresponding to the building code questions or the wording in some questions, such as what “damaging shaking” means.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T2" specific-use="star"><?xmltex \currentcnt{2}?><label>Table 2</label><caption><p id="d1e1205">Preferences between the baseline and redesigned maps, split by subgroups on the person-specific variables. Some participants responded that they liked both maps, without a clear preference between them. Note: two participants did not specify their gender, and five participants did not identify as a geoscience or engineering student.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Baseline</oasis:entry>
         <oasis:entry colname="col3">Both</oasis:entry>
         <oasis:entry colname="col4">Redesign</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Female <inline-formula><mml:math id="M18" display="inline"><mml:mrow><mml:mo>(</mml:mo><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">16</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">37.50</oasis:entry>
         <oasis:entry colname="col3">6.25</oasis:entry>
         <oasis:entry colname="col4">56.25</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Male <inline-formula><mml:math id="M19" display="inline"><mml:mrow><mml:mo>(</mml:mo><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">20</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">25.00</oasis:entry>
         <oasis:entry colname="col3">25.00</oasis:entry>
         <oasis:entry colname="col4">50.00</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Younger (Age <inline-formula><mml:math id="M20" display="inline"><mml:mo>&lt;</mml:mo></mml:math></inline-formula> 30, <inline-formula><mml:math id="M21" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">17</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">35.00</oasis:entry>
         <oasis:entry colname="col3">25.00</oasis:entry>
         <oasis:entry colname="col4">40.00</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Older (Age <inline-formula><mml:math id="M22" display="inline"><mml:mo>≥</mml:mo></mml:math></inline-formula> 30, <inline-formula><mml:math id="M23" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">20</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">29.41</oasis:entry>
         <oasis:entry colname="col3">5.88</oasis:entry>
         <oasis:entry colname="col4">64.71</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">German (<inline-formula><mml:math id="M24" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">9</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">22.22</oasis:entry>
         <oasis:entry colname="col3">22.22</oasis:entry>
         <oasis:entry colname="col4">55.56</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Non-German (<inline-formula><mml:math id="M25" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">27</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">37.04</oasis:entry>
         <oasis:entry colname="col3">14.81</oasis:entry>
         <oasis:entry colname="col4">48.15</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">University of Potsdam (<inline-formula><mml:math id="M26" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">19</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">26.32</oasis:entry>
         <oasis:entry colname="col3">26.32</oasis:entry>
         <oasis:entry colname="col4">47.37</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Not at University of Potsdam (<inline-formula><mml:math id="M27" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">19</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">36.84</oasis:entry>
         <oasis:entry colname="col3">5.26</oasis:entry>
         <oasis:entry colname="col4">57.89</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Geosciences students (<inline-formula><mml:math id="M28" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">12</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">50.00</oasis:entry>
         <oasis:entry colname="col3">16.67</oasis:entry>
         <oasis:entry colname="col4">33.33</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Engineering students (<inline-formula><mml:math id="M29" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">21</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">23.81</oasis:entry>
         <oasis:entry colname="col3">14.29</oasis:entry>
         <oasis:entry colname="col4">61.90</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">All (<inline-formula><mml:math id="M30" display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">38</mml:mn></mml:mrow></mml:math></inline-formula>)</oasis:entry>
         <oasis:entry colname="col2">31.58</oasis:entry>
         <oasis:entry colname="col3">15.79</oasis:entry>
         <oasis:entry colname="col4">52.63</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table><?xmltex \gdef\@currentlabel{2}?></table-wrap>

      <p id="d1e1560">We found that demographic and academic characteristics largely did not influence any of the reported map effects. Due to the small sample size, we examined these characteristics as binary variables, splitting participants by gender (male or female), age (younger or older than the median age of 30 years), modal nationality (German or non-German), modal university (attending University of Potsdam or not) and the two modal academic disciplines (geosciences or engineering). Map-reading accuracy and tendency to agree with the hazard perception questions were not qualitatively<?pagebreak page2517?> different in any of these groups, though sample sizes were too small to detect small differences. There was a  slight difference in map preference between some subgroups (see Table 2) in particular for academic discipline, where geoscientists tended to prefer the baseline map and engineers the redesigned map.</p>
</sec>
</sec>
<sec id="Ch1.S5" sec-type="conclusions">
  <label>5</label><title>Discussions and conclusions</title>
<sec id="Ch1.S5.SS1">
  <label>5.1</label><title>Systematizing the design of hazard maps</title>
      <p id="d1e1580">Previous work on risk communication for seismic hazard maps has largely focused on collecting user feedback on different map designs while citing non-specific “best practices” in describing how design choices were made. We sought to disentangle what graphical criteria actually constitute best practices in hazard map design, particularly focusing on color palettes and data classification, which have been prioritized by previous authors <xref ref-type="bibr" rid="bib1.bibx45 bib1.bibx22 bib1.bibx68" id="paren.89"/>. The aim was not to provide a recipe for how to design hazard maps but rather a criteria-based framework around which to make design decisions. We surveyed the color and visualization literature, using the Hue–Saturation–Lightness color model to elucidate three central criteria (perceptual order, perceptual uniformity and discriminative power) found to be key to correct map interpretation, based on decades of empirical experiments. We also summarized a body of empirical literature supporting choosing colors with psychological associations relevant to the map interpretation as well as those that are colorblind-accessible.</p>
      <p id="d1e1586">We then surveyed the cartographical literature to identify data classification methods that could be relevant for hazard maps. Traditional approaches such as equal-interval or quantile classification can obscure or even distort the true features of the data being mapped. We reviewed classical and modern approaches designed to find class breaks that fit the data. We also identified the research that advocates for using a sufficient but not excessive number of class breaks and making them meaningful when possible. As empirical evaluations to<?pagebreak page2518?> compare classification schemes are scant, we propose three general criteria that have support from the literature.</p>
      <p id="d1e1589">We implemented these criteria to design a new color palette and classification scheme for the German seismic hazard map. The classification scheme was split at the PGA of 0.4 m s<inline-formula><mml:math id="M31" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>, the critical threshold at which Germany requires seismic building codes for ordinary buildings. The lower part of the distribution was split into three classes, and the higher part was split into five classes, using the Fisher classification scheme, which well-represented the key features of the data, grouping data into classes that were quantitatively similar. The map used a carefully designed and colorblind-friendly yellow–orange–red–brown color palette. The lower part of the scale used shades of yellow associated with caution, whereas the higher part used red colors associated with risk and danger to appropriately convey the meaning of each part of the scale. Colors were optimized to be perceptually uniform and discriminable, with a single intuitive and identical ordering by both lightness and hue.</p>
</sec>
<sec id="Ch1.S5.SS2">
  <label>5.2</label><title>Assessing the redesigned German seismic hazard map</title>
      <p id="d1e1612">We tested the two German seismic hazard maps on a sample of early career researchers using a survey with map-reading and hazard perception questions. Participants could read both maps equally well, contrary to the suggestions of <xref ref-type="bibr" rid="bib1.bibx23" id="text.90"/> that classification schemes with unequal intervals come at a cost to map-reading. While participants were only around 74 % correct across the two maps, open-ended responses indicated that multiple participants struggled to understand the double legend labels. Indeed, most of the map-reading mistakes (85.3 % for the baseline map and 84.6 % for the redesigned map) came from selecting the adjacent value above or below the correct one. Mistakes were also more common when cities spanned multiple colors, with participants often incorrectly choosing the lower hazard level, potentially indicating that they failed to notice that part of the city was in a higher hazard level; this appeared to affect both maps equally. Contrary to the suggestions of the expert evaluation (see Supplement Sect. S6), double legend labels and cities marked with polygons may be difficult to read precisely, even for a technical audience.</p>
      <p id="d1e1618">The redesigned map was successful in generating awareness of each key property of seismic hazard, as well as the critical threshold. Across the six question types, participants were 60.5 %–89.5 % in agreement with the statement (selected either slightly agree, agree or strongly agree, and 47.3 %–73.7 % of participants selected agree or strongly agree), indicating a sufficient awareness of the hazard property. Relative to the baseline map, the redesign improved perception of two closely related properties of seismic hazard: (1) that it spreads continuously over space and (2) that hazard can occur in areas even if they are not marked high on the map. On the other hand, both maps equally communicated the two other framing properties, which are that the highest hazard differs from high hazard and that spatial patterns are of primary importance. Both maps communicated which cities required seismic building codes roughly equally, both for cities at the far ends of the scale (that would arguably be easier to answer for) and in the middle of the scale. These results held across the sample, regardless of demographics or academic background, indicating they may be robust to these user characteristics for similar technical audiences.</p>
      <p id="d1e1621">There are several aspects of the redesigned colors and classification schemes that may explain these evaluation results. The two properties where the redesign outperformed the baseline both have to do with the spatial diffusion and continuity in the regional patterns of seismic hazard. Users had  more awareness with the redesigned map rather than the baseline, that damaging shaking could be expected in cities that were close to, but not directly within, zones of higher hazard (e.g., Karlsruhe, Koblenz and Düsseldorf; see Supplement Sect. S7). The redesign’s classification scheme groups hazard values more objectively and into fewer classes than the baseline, thus avoiding transmitting too much information <xref ref-type="bibr" rid="bib1.bibx45" id="paren.91"/>. This may have made it easier to identify these cities as having a medium (and sufficiently important) hazard level. Furthermore, these classes were orange in the redesign and blue or green in the baseline; as found in multiple studies <xref ref-type="bibr" rid="bib1.bibx22 bib1.bibx50 bib1.bibx68" id="paren.92"/>, orange may be better associated in western cultures with damaging hazard than blue/green.</p>
      <p id="d1e1630">Responses to the open-ended questions indicated that there was a slight preference towards the redesigned map but that participants used many of the same explanations to describe preferences for either map. In particular, participants referred to the ability to discriminate colors and order them uniformly for both maps. Participants mentioned psychological aspects of the color to describe their preferences both for the baseline and redesigned map, in contrast to the suggestion of <xref ref-type="bibr" rid="bib1.bibx22" id="text.93"/> that evocative colors may not be preferred by map users. Participants also expressed the importance of classification breaks that signify a particular meaning. It is clear that the visualization elements (color, classification breaks) around which our redesign was structured were pertinent to these map users, both for their preferences and hazard perception between the maps. While these results were consistent across demographic subgroups, there was a preference for the baseline map only for geoscience researchers (see Table 2), potentially due to the greater ubiquity of the rainbow color scale in this field <xref ref-type="bibr" rid="bib1.bibx76" id="paren.94"/>.</p>
</sec>
<sec id="Ch1.S5.SS3">
  <label>5.3</label><title>Practical implications and limitations</title>
      <p id="d1e1647">Our criteria-based design method and application to German seismic hazard maps suggest several practical implications for designers of future hazard maps. First, it is possible to isolate empirically evidenced criteria for color and classification in order to systematize hazard map design. We<?pagebreak page2519?> recommend future hazard map designers follow these criteria to generate candidate maps that are supported by the visualization and cartography literature. To decide between candidate maps, it is helpful to pre-specify a list of communication goals or properties of the hazard process that are essential to communicate. Finally, it is critical to evaluate the redesigned map with formal user testing in order to measure whether the map’s goals were effectively communicated.</p>
      <p id="d1e1650">Our evaluation suggested that the specific design choices we made (the Fisher classification scheme together with our customized yellow–orange–red–brown color palette) produced a map that was read sufficiently accurately and succeeded in users perceiving all communication goals. In two of these goals regarding the regional spatial spread of seismic hazard, the redesigned map outperformed the initial map, which used a suboptimal color palette and classification scheme; the redesigned map was also slightly more preferred over the initial map. Hazard maps adhering to evidence-based criteria for colors and classification schemes and designed with key communication targets in mind can reach these targets better than maps designed without such a framework. Our specific design choices may not be appropriate for other hazard types (i.e., where the hazard values’ skewness is a priority to communicate, the Head–Tails classification scheme may be advantageous over the Fisher scheme); however, the criteria we outline for designing a hazard map still provide a framework for making these decisions.</p>
      <p id="d1e1653">Our study has some limitations that can be addressed in future work. The criteria we isolated are not necessarily comprehensive, and other considerations may be important in effective hazard map design. Visualization research suggests that the spatial frequency of patterns in a map may guide which color palette is optimal for it <xref ref-type="bibr" rid="bib1.bibx58" id="paren.95"/>; that is, high-frequency hazards (e.g., landslides, which are concentrated in space along sharp slopes) may require different color palettes than lower-frequency hazards (e.g., seismic hazard, which spreads over larger areas). Furthermore, it may be desirable to compare hazard areas across different regions or return periods, which would affect the selection of the classification scheme. Future redesigns can address these additional constraints and build further bridges between the natural hazards and visualization research communities. Furthermore, our evaluation study was limited in both its sampled population (early career researchers in Germany), number of questions (just one per communication goal, per map) and number of maps tested (a single redesign combining both color and classification improvements). Future work should disentangle the effects of color and classification changes through multiple maps, using a sample from a more general population and with an evaluation instrument containing more questions per communication goal.</p>
</sec>
</sec>

      
      </body>
    <back><notes notes-type="codedataavailability"><title>Code and data availability</title>

      <p id="d1e1664">All code and seismic hazard data needed to produce the different hazard maps are available at <uri>https://osf.io/puerc/?view_only=2b747decfbfb4093a9e925e5fe09cd48</uri> <xref ref-type="bibr" rid="bib1.bibx54" id="paren.96"/>.</p>
  </notes><app-group>
        <supplementary-material position="anchor"><p id="d1e1673">The supplement related to this article is available online at: <inline-supplementary-material xlink:href="https://doi.org/10.5194/nhess-23-2505-2023-supplement" xlink:title="pdf">https://doi.org/10.5194/nhess-23-2505-2023-supplement</inline-supplementary-material>.</p></supplementary-material>
        </app-group><notes notes-type="authorcontribution"><title>Author contributions</title>

      <p id="d1e1682">We use the CASRAI Contributor Roles Taxonomy to categorize author contributions.
Conceptualization: MS, FC. Resources (developing hazard maps): MS, FC. Methodology (method development and evaluation): MS, FC, PJS. Investigation (evaluation data collection): MS, PJS. Formal (evaluation data analysis): MS, PJS. Writing – original draft: MS. Writing – review and editing: FC, PJS. Supervision: FC, PJS.</p>
  </notes><notes notes-type="competinginterests"><title>Competing interests</title>

      <p id="d1e1688">The contact author has declared that none of the authors has any competing interests.</p>
  </notes><notes notes-type="disclaimer"><title>Disclaimer</title>

      <p id="d1e1694">Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p>
  </notes><ack><title>Acknowledgements</title><p id="d1e1700">We gratefully acknowledge Christian Bosse, Gottfried Grünthal, and the other colleagues and staff of the German Research Centre for Geosciences that supported this work. This research benefited from the contribution of early career researchers from the ITN Marie Skłodowska-Curie Action New Challenges for Urban Engineering Seismology Urbasis-EU project (grant agreement 813137) and from the DFG Research Training Group <?xmltex \hack{\mbox\bgroup}?>“NatRiskChange”<?xmltex \hack{\egroup}?>. We also thank two anonymous referees and the editor for suggestions that improved the manuscript.</p></ack><notes notes-type="financialsupport"><title>Financial support</title>

      <p id="d1e1709">The article processing charges for this open-access publication were covered by the Helmholtz Centre Potsdam – GFZ German Research Centre for Geosciences.</p>
  </notes><notes notes-type="reviewstatement"><title>Review statement</title>

      <p id="d1e1715">This paper was edited by Andreas Günther and reviewed by two anonymous referees.</p>
  </notes><ref-list>
    <title>References</title>

      <ref id="bib1.bibx1"><?xmltex \def\ref@label{Armstrong et~al.(2003)}?><label>Armstrong et al.(2003)</label><?label armstrong2003using?><mixed-citation>
Armstrong, M. P., Xiao, N., and Bennett, D. A.:
Using genetic algorithms to create multicriteria class intervals for   choropleth maps, Annals of the Association of American Geographers, 93, 595–623, 2003.</mixed-citation></ref>
      <ref id="bib1.bibx2"><?xmltex \def\ref@label{Baker et~al.(2021)}?><label>Baker et al.(2021)</label><?label baker2021seismic?><mixed-citation>Baker, J., Bradley, B., and Stafford, P.: Seismic hazard and risk analysis,
Cambridge University Press, <ext-link xlink:href="https://doi.org/10.1017/9781108425056" ext-link-type="DOI">10.1017/9781108425056</ext-link>, 2021.</mixed-citation></ref>
      <ref id="bib1.bibx3"><?xmltex \def\ref@label{Birch(2012)}?><label>Birch(2012)</label><?label birch2012worldwide?><mixed-citation>
Birch, J.:
Worldwide prevalence of red-green color deficiency, JOSA A, 29, 313–320, 2012.</mixed-citation></ref>
      <?pagebreak page2520?><ref id="bib1.bibx4"><?xmltex \def\ref@label{Bivand et~al.(2020)}?><label>Bivand et al.(2020)</label><?label bivand2020package?><mixed-citation>
Bivand, R., Ono, H., Dunlap, R., and Stigler, M.:
Package “classint”,  2020.</mixed-citation></ref>
      <ref id="bib1.bibx5"><?xmltex \def\ref@label{Borland and Taylor(2007)}?><label>Borland and Taylor(2007)</label><?label borland2007rainbow?><mixed-citation>
Borland, D. and Taylor, R. M.:
Rainbow color map (still) considered harmful, IEEE Comput. Graph., 27, 14–17, 2007.</mixed-citation></ref>
      <ref id="bib1.bibx6"><?xmltex \def\ref@label{Bostrom et~al.(2008)}?><label>Bostrom et al.(2008)</label><?label bostrom2008visualizing?><mixed-citation>
Bostrom, A., Anselin, L., and Farris, J.:
Visualizing seismic risk and uncertainty: A review of related
research, Annals of the New York Academy of Sciences, 1128, 29–40, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx7"><?xmltex \def\ref@label{Brewer and Pickle(2002)}?><label>Brewer and Pickle(2002)</label><?label brewer2002evaluation?><mixed-citation>
Brewer, C. A. and Pickle, L.:
Evaluation of methods for classifying epidemiological data on
choropleth maps in series, Ann. Assoc. Am. Geogr., 92, 662–681, 2002.</mixed-citation></ref>
      <ref id="bib1.bibx8"><?xmltex \def\ref@label{Brychtova and {\c{C}}{\"{o}}ltekin(2016)}?><label>Brychtova and Çöltekin(2016)</label><?label brychtova2016empirical?><mixed-citation>
Brychtovam, A. and Çöltekin, A.:
An empirical user study for measuring the influence of colour
distance and font size in map reading using eye tracking, The Carto. J., 53, 202–212,
2016.</mixed-citation></ref>
      <ref id="bib1.bibx9"><?xmltex \def\ref@label{Bujack et~al.(2017)}?><label>Bujack et al.(2017)</label><?label bujack2017good?><mixed-citation>
Bujack, R., Turton, T. L., Samsel, F., Ware, C., Rogers, D. H.,
and Ahrens, J.:
The good, the bad, and the ugly: A theoretical framework for the
assessment of continuous colormaps, IEEE T. Vis. Comput. Gr.,
24, 923–933, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx10"><?xmltex \def\ref@label{Cantarino et~al.(2019)}?><label>Cantarino et al.(2019)</label><?label cantarino2019roc?><mixed-citation>
Cantarino, I., Carrion, M. A., Goerlich, F., and Martinez Ibañez, V.:
A ROC analysis-based classification method for landslide
susceptibility maps, Landslides, 16, 265–282, 2019.</mixed-citation></ref>
      <ref id="bib1.bibx11"><?xmltex \def\ref@label{Chan et~al.(2003)}?><label>Chan et al.(2003)</label><?label chan2003color?><mixed-citation>
Chan, A. H. S., Han, S. H., and Nanthavanij, S.:
Color associations for Hong Kong Chinese, Korean, and Thai-A
comparison, in: Proceedings of IEA 14th Triennial Congress, Seoul Korea,
2003.</mixed-citation></ref>
      <ref id="bib1.bibx12"><?xmltex \def\ref@label{Clarke and Costall(2008)}?><label>Clarke and Costall(2008)</label><?label clarke2008emotional?><mixed-citation>
Clarke, T. and Costall, A.:
The emotional connotations of color: A qualitative investigation, Color Res. Appli., 33, 406–410, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx13"><?xmltex \def\ref@label{{\c{C}}{\"{o}}ltekin et~al.(2017)}?><label>Çöltekin et al.(2017)</label><?label ccoltekin2017perceptual?><mixed-citation>
Çöltekin, A., Brychtová, A., Griffin, A. L.,
Robinson, A. C., Imhof, M., and Pettit, C.:
Perceptual complexity of soil-landscape maps: a user evaluation of
color organization in legend designs using eye tracking, Int. J. Dig. Earth, 10, 560–581, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx14"><?xmltex \def\ref@label{Crameri et~al.(2020)}?><label>Crameri et al.(2020)</label><?label crameri2020misuse?><mixed-citation>
Crameri, F., Shephard, G. E., and Heron, P. J.:
The misuse of colour in science communication, Nat. Commun., 11, 1–10, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx15"><?xmltex \def\ref@label{Dasgupta et~al.(2018)}?><label>Dasgupta et al.(2018)</label><?label dasgupta2018effect?><mixed-citation>Dasgupta, A., Poco, J., Rogowitz, B., Han, K., Bertini, E.,
and Silva, C. T.:
The effect of color scales on climate scientists' objective and
subjective performance in spatial data analysis tasks, IEEE T. Vis. Comput. Gr., <ext-link xlink:href="https://doi.org/10.1109/TVCG.2018.2876539" ext-link-type="DOI">10.1109/TVCG.2018.2876539</ext-link>,
2018.</mixed-citation></ref>
      <ref id="bib1.bibx16"><?xmltex \def\ref@label{Dobson(1973)}?><label>Dobson(1973)</label><?label dobson1973choropleth?><mixed-citation>
Dobson, M. W.:
Choropleth maps without class intervals?: a comment,
Geograph. Anal., 5, 358–360,
1973.</mixed-citation></ref>
      <ref id="bib1.bibx17"><?xmltex \def\ref@label{Doore et~al.(1993)}?><label>Doore et al.(1993)</label><?label doore1993guidelines?><mixed-citation>
Doore, G. S., Eustis, A. C., Jones, D., Leep, R., Lincoln, J., MacDonald, Al. E., Mandics, P. A., Ryan, R. T., Schiavone, J. A. (chair), and Schiessl, D.:
Guidelines for using color to depict meteorological information, B. Am. Meteor. Soc., 74, 1709–1713, 1993.</mixed-citation></ref>
      <ref id="bib1.bibx18"><?xmltex \def\ref@label{Dransch et~al.(2010)}?><label>Dransch et al.(2010)</label><?label dransch2010contribution?><mixed-citation>
Dransch, D., Rotzoll, H., and Poser, K.:
The contribution of maps to the challenges of risk communication to
the public, Int. J. Dig. Earth, 3, 292–311, 2010.</mixed-citation></ref>
      <ref id="bib1.bibx19"><?xmltex \def\ref@label{Edler et~al.(2020)}?><label>Edler et al.(2020)</label><?label edler2020searching?><mixed-citation>
Edler, D., Keil, J., Tuller, M.-C., Bestgen, A.-K., and
Dickmann, F.:
Searching for the “right” legend: The impact of legend position
on legend decoding in a cartographic memory task, The Carto. J., 57, 6–17,
2020.</mixed-citation></ref>
      <ref id="bib1.bibx20"><?xmltex \def\ref@label{Evans(1977)}?><label>Evans(1977)</label><?label evans1977selection?><mixed-citation>
Evans, I. S.:
The selection of class intervals, T. I. Brit. Geogr., 2,
98–124, 1977.</mixed-citation></ref>
      <ref id="bib1.bibx21"><?xmltex \def\ref@label{Fisher(1958)}?><label>Fisher(1958)</label><?label fisher1958grouping?><mixed-citation>
Fisher, W. D.:
On grouping for maximum homogeneity, J. Am. Stat. Assoc., 53, 789–798, 1958.</mixed-citation></ref>
      <ref id="bib1.bibx22"><?xmltex \def\ref@label{Fyfe and Molnar(2020)}?><label>Fyfe and Molnar(2020)</label><?label fyfe2020evaluating?><mixed-citation>
Fyfe, M. and Molnar, S.:
Evaluating the use and communication of seismic hazard maps: A case
study of Metro Vancouver, British Columbia, Canada,
WIT Trans. Eng. Sci., 129,  157–168, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx23"><?xmltex \def\ref@label{Gaspar-Escribano and Iturrioz(2011)}?><label>Gaspar-Escribano and Iturrioz(2011)</label><?label gaspar2011communicating?><mixed-citation>
Gaspar-Escribano, J. M. and Iturrioz, T.: Communicating earthquake risk: mapped parameters and cartographic representation, Nat. Hazards Earth Syst. Sci., 11, 359–366, https://doi.org/10.5194/nhess-11-359-2011, 2011.</mixed-citation></ref>
      <ref id="bib1.bibx24"><?xmltex \def\ref@label{GFZ(2023)}?><label>GFZ(2023)</label><?label plattform?><mixed-citation>GFZ: Helmholtz-Zentrum Potsdam GFZ,
D-eqhaz16, <uri>https://www-app5.gfz-potsdam.de/d-eqhaz16/index.html</uri> (last access: 1 August 2022),
Plattform zur Abfrage von gefährdungskonsistenten Antwortspektren
(UHS) für beliebige Punkte in Deutschland sowie von nationalen
Erdbebengefährdungskarten nach dem Berechnungsmodell von Grünthal et al.
(2018), 2023.</mixed-citation></ref>
      <ref id="bib1.bibx25"><?xmltex \def\ref@label{Gramazio et~al.(2016)Gramazio, Laidlaw, and
Schloss}?><label>Gramazio et al.(2016)Gramazio, Laidlaw, and
Schloss</label><?label gramazio2016colorgorical?><mixed-citation>
Gramazio, C. C., Laidlaw, D. H., and Schloss, K. B.:
Colorgorical: Creating discriminable and preferable color palettes
for information visualization, IEEE T. Vis. Comput. Gr.,
23, 521–530, 2016.</mixed-citation></ref>
      <ref id="bib1.bibx26"><?xmltex \def\ref@label{Griffith and Leonard(1997)}?><label>Griffith and Leonard(1997)</label><?label griffith1997association?><mixed-citation>
Griffith, L. J. and Leonard, S. D.:
Association of colors with warning signal words,
Int. J. Ind. Ergonom., 20, 317–325, 1997.</mixed-citation></ref>
      <ref id="bib1.bibx27"><?xmltex \def\ref@label{Gr{\"{u}}nthal et~al.(2018)}?><label>Grünthal et al.(2018)</label><?label grunthal2018probabilistic?><mixed-citation>
Grünthal, G., Stromeyer, D., Bosse, C., Cotton, F.,
and Bindi, D.:
The probabilistic seismic hazard assessment of Germany—version
2016, considering the range of epistemic uncertainties and aleatory
variability, B. Earthq. Eng., 16, 4339–4395, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx28"><?xmltex \def\ref@label{Hagemeier-Klose and Wagner(2009)}?><label>Hagemeier-Klose and Wagner(2009)</label><?label hagemeier2009evaluation?><mixed-citation>
Hagemeier-Klose, M. and Wagner, K.: Evaluation of flood hazard maps in print and web mapping services as information tools in flood risk communication, Nat. Hazards Earth Syst. Sci., 9, 563–574, https://doi.org/10.5194/nhess-9-563-2009, 2009.</mixed-citation></ref>
      <ref id="bib1.bibx29"><?xmltex \def\ref@label{Harrower and Brewer(2003)}?><label>Harrower and Brewer(2003)</label><?label harrower2003colorbrewer?><mixed-citation>
Harrower, M. and Brewer, C. A.:
Colorbrewer.org: an online tool for selecting colour schemes for
maps, The Carto. J., 40, 27–37,
2003.</mixed-citation></ref>
      <ref id="bib1.bibx30"><?xmltex \def\ref@label{Haynes et~al.(2007)Haynes, Barclay, and Pidgeon}?><label>Haynes et al.(2007)Haynes, Barclay, and Pidgeon</label><?label haynes2007volcanic?><mixed-citation>
Haynes, K., Barclay, J., and Pidgeon, N.:
Volcanic hazard communication using maps: an evaluation of their
effectiveness, B. Volcanol., 70, 123–138,
2007.</mixed-citation></ref>
      <ref id="bib1.bibx31"><?xmltex \def\ref@label{Horton et~al.(2020)}?><label>Horton et al.(2020)</label><?label horton2020enhancing?><mixed-citation>
Horton, S., Nowak, S., and Haegeli, P.: Enhancing the operational value of snowpack models with visualization design principles, Nat. Hazards Earth Syst. Sci., 20, 1557–1572, https://doi.org/10.5194/nhess-20-1557-2020, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx32"><?xmltex \def\ref@label{Itten(1961)}?><label>Itten(1961)</label><?label itten1961art?><mixed-citation>
Itten, J.:
The art of color the subjective experience and objective rationale of
color, ISBN-13 978-0471289289,
1961.</mixed-citation></ref>
      <ref id="bib1.bibx33"><?xmltex \def\ref@label{Jenks(1967)}?><label>Jenks(1967)</label><?label jenks1967data?><mixed-citation>
Jenks, G. F.:
The data model concept in statistical mapping, Int. Yearbook Carto., 7, 186–190,
1967.</mixed-citation></ref>
      <ref id="bib1.bibx34"><?xmltex \def\ref@label{Jiang(2013)}?><label>Jiang(2013)</label><?label jiang2013head?><mixed-citation>
Jiang, B.:
Head/tail breaks: A new classification scheme for data with a
heavy-tailed distribution, The Profess. Geogr., 65, 482–494, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx35"><?xmltex \def\ref@label{Jiang et~al.(2013)}?><label>Jiang et al.(2013)</label><?label jiang2013scaling?><mixed-citation>
Jiang, B., Liu, X., and Jia, T.:
Scaling of geographic space as a universal rule for map
generalization, Ann. Assoc. Am. Geogr.,
103, 844–855, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx36"><?xmltex \def\ref@label{Kennedy(1994)}?><label>Kennedy(1994)</label><?label kennedy1994unclassed?><mixed-citation>
Kennedy, S.:
Unclassed choropleth maps revisited/some guidelines for the
construction of unclassed and classed choropleth maps, Cartographica: The Int. J. Geogr.
Info. Geovisualiz., 31, 16–25, 1994.</mixed-citation></ref>
      <ref id="bib1.bibx37"><?xmltex \def\ref@label{Kindlmann et~al.(2002)}?><label>Kindlmann et al.(2002)</label><?label kindlmann2002face?><mixed-citation>
Kindlmann, G., Reinhard, E., and Creem, S.:
Face-based luminance matching for perceptual colormap generation, in: IEEE Visualization, 2002, VIS 2002., 299–306, IEEE,
2002.</mixed-citation></ref>
      <ref id="bib1.bibx38"><?xmltex \def\ref@label{Kinkeldey et~al.(2017)}?><label>Kinkeldey et al.(2017)</label><?label kinkeldey2017evaluating?><mixed-citation>
Kinkeldey, C., MacEachren, A. M., Riveiro, M., and Schiewe, J.:
Evaluating the effect of visually represented geodata uncertainty on
decision-making: systematic review, lessons learned, and recommendations, Cartogr. Geogr. Inf. Sci., 44, 1–21, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx39"><?xmltex \def\ref@label{Li and Qin(2014)}?><label>Li and Qin(2014)</label><?label li2014spacing?><mixed-citation>
Li, Z. and Qin, Z.:
Spacing and alignment rules for effective legend design, Cartogr. Geogr. Inf. Sci., 41, 348–362, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx40"><?xmltex \def\ref@label{Light and Bartlein(2004)}?><label>Light and Bartlein(2004)</label><?label light2004end?><mixed-citation>
Light, A. and Bartlein, P. J.:
The end of the rainbow? Color schemes for improved data graphics, Eos, Transactions American Geophysical Union, 85, 385–391, 2004.</mixed-citation></ref>
      <?pagebreak page2521?><ref id="bib1.bibx41"><?xmltex \def\ref@label{Lin et~al.(2013)}?><label>Lin et al.(2013)</label><?label lin2013selecting?><mixed-citation>
Lin, S., Fortuna, J., Kulkarni, C., Stone, M., and Heer, J.:
Selecting semantically-resonant colors for data visualization, in: Computer Graphics Forum, Vol. 32,  401–410, Wiley
Online Library, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx42"><?xmltex \def\ref@label{MacAdam(1942)}?><label>MacAdam(1942)</label><?label macadam1942visual?><mixed-citation>
MacAdam, D. L.:
Visual sensitivities to color differences in daylight, Josa, 32, 247–274, 1942.</mixed-citation></ref>
      <ref id="bib1.bibx43"><?xmltex \def\ref@label{MacDonald(1999)}?><label>MacDonald(1999)</label><?label macdonald1999using?><mixed-citation>
MacDonald, L. W.:
Using color effectively in computer graphics, IEEE Compu. Graph. Appl., 19, 20–35, 1999.</mixed-citation></ref>
      <ref id="bib1.bibx44"><?xmltex \def\ref@label{MacPherson-Krutsky et~al.(2020)}?><label>MacPherson-Krutsky et al.(2020)</label><?label macpherson2020does?><mixed-citation>MacPherson-Krutsky, C. C., Brand, B. D., and Lindell, M. K.:
Does updating natural hazard maps to reflect best practices increase
viewer comprehension of risk?, Int. J. Dis. Risk Reduc., 46, 101487, <ext-link xlink:href="https://doi.org/10.1016/j.ijdrr.2020.101487" ext-link-type="DOI">10.1016/j.ijdrr.2020.101487</ext-link>, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx45"><?xmltex \def\ref@label{Marti et~al.(2019)}?><label>Marti et al.(2019)</label><?label marti2019difficulties?><mixed-citation>
Marti, M., Stauffacher, M., and Wiemer, S.: Difficulties in explaining complex issues with maps: evaluating seismic hazard communication – the Swiss case, Nat. Hazards Earth Syst. Sci., 19, 2677–2700, https://doi.org/10.5194/nhess-19-2677-2019, 2019.</mixed-citation></ref>
      <ref id="bib1.bibx46"><?xmltex \def\ref@label{Maxwell(2000)}?><label>Maxwell(2000)</label><?label maxwell2000visualizing?><mixed-citation>
Maxwell, B. A.:
Visualizing geographic classifications using color, The Carto. J., 37, 93–99,
2000.</mixed-citation></ref>
      <ref id="bib1.bibx47"><?xmltex \def\ref@label{Mehta and Zhu(2009)}?><label>Mehta and Zhu(2009)</label><?label mehta2009blue?><mixed-citation>
Mehta, R. and Zhu, R. J.:
Blue or red? exploring the effect of color on cognitive task
performances, Science, 323, 1226–1229, 2009.</mixed-citation></ref>
      <ref id="bib1.bibx48"><?xmltex \def\ref@label{Meyer et~al.(2012)}?><label>Meyer et al.(2012)</label><?label meyer2012recommendations?><mixed-citation>
Meyer, V., Kuhlicke, C., Luther, J., Fuchs, S., Priest, S., Dorner, W., Serrhini, K., Pardoe, J., McCarthy, S., Seidel, J., Palka, G., Unnerstall, H., Viavattene, C., and Scheuer, S.: Recommendations for the user-specific enhancement of flood maps, Nat. Hazards Earth Syst. Sci., 12, 1701–1716, https://doi.org/10.5194/nhess-12-1701-2012, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx49"><?xmltex \def\ref@label{Miller(1956)}?><label>Miller(1956)</label><?label miller1956magical?><mixed-citation>
Miller, G. A.:
The magical number seven, plus or minus two: Some limits on our
capacity for processing information,
Psychol. Rev., 63, 81, 1956.</mixed-citation></ref>
      <ref id="bib1.bibx50"><?xmltex \def\ref@label{Miran et~al.(2017)Miran, Ling, James, Gerard, and
Rothfusz}?><label>Miran et al.(2017)Miran, Ling, James, Gerard, and
Rothfusz</label><?label miran2017user?><mixed-citation>
Miran, S. M., Ling, C., James, J. J., Gerard, A., and Rothfusz, L.:
User perception and interpretation of tornado probabilistic hazard
information: Comparison of four graphical designs,
Appl. Ergon., 65, 277–285, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx51"><?xmltex \def\ref@label{Muller(1979)}?><label>Muller(1979)</label><?label muller1979perception?><mixed-citation>
Muller, J.-C.:
Perception of continuously shaded maps, Ann. Assoc. Am. Geogr., 69, 240–249, 1979.</mixed-citation></ref>
      <ref id="bib1.bibx52"><?xmltex \def\ref@label{Olson and Brewer(1997)}?><label>Olson and Brewer(1997)</label><?label olson1997evaluation?><mixed-citation>
Olson, J. M. and Brewer, C. A.:
An evaluation of color selections to accommodate map users with
color-vision impairments,
Ann. Assoc. Am. Geogr., 87, 103–134, 1997.</mixed-citation></ref>
      <ref id="bib1.bibx53"><?xmltex \def\ref@label{Or and Wang(2014)}?><label>Or and Wang(2014)</label><?label or2014color?><mixed-citation>
Or, C. K. L. and Wang, H. H. L.:
Color–concept associations: A cross-occupational and-cultural study
and comparison, Color Res. Appl., 39, 630–635, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx54"><?xmltex \def\ref@label{{OSFHome(2020)}}?><label>OSFHome(2020)</label><?label osfhome?><mixed-citation>OSFHome: Seismic hazard mapping, OSFHome [data set, code], <uri>https://osf.io/puerc/?view_only=2b747decfbfb4093a9e925e5fe09cd48</uri> (last access: 1 August 2022), 2020.</mixed-citation></ref>
      <ref id="bib1.bibx55"><?xmltex \def\ref@label{Padilla et~al.(2016)Padilla, Quinan, Meyer, and
Creem-Regehr}?><label>Padilla et al.(2016)Padilla, Quinan, Meyer, and
Creem-Regehr</label><?label padilla2016evaluating?><mixed-citation>
Padilla, L., Quinan, P. S., Meyer, M., and Creem-Regehr, S. H.:
Evaluating the impact of binning 2d scalar fields,  IEEE T. Vis. Comput. Gr.,
23, 431–440, 2016.</mixed-citation></ref>
      <ref id="bib1.bibx56"><?xmltex \def\ref@label{{Pratt(1959)}}?><label>Pratt(1959)</label><?label pratt1959?><mixed-citation>
Pratt, J. W.: Remarks on zeros and ties in the Wilcoxon signed rank procedures, J. Am. Stat. Assoc., 54.287, 655–667, 1959.</mixed-citation></ref>
      <ref id="bib1.bibx57"><?xmltex \def\ref@label{Quinan and Meyer(2015)}?><label>Quinan and Meyer(2015)</label><?label quinan2015visually?><mixed-citation>
Quinan, P. S. and Meyer, M.:
Visually comparing weather features in forecasts, IEEE T. Vis. Comput. Gr.,
22, 389–398, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx58"><?xmltex \def\ref@label{Reda et~al.(2018)}?><label>Reda et al.(2018)</label><?label reda2018graphical?><mixed-citation>Reda, K., Nalawade, P., and Ansah-Koi, K.:
Graphical perception of continuous quantitative maps: the effects of
spatial frequency and colormap design, in: Proceedings of the 2018 CHI Conference on Human Factors in
Computing Systems,  <ext-link xlink:href="https://doi.org/10.1145/3173574.3173846" ext-link-type="DOI">10.1145/3173574.3173846</ext-link>, 1–12, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx59"><?xmltex \def\ref@label{Rheingans(2000)}?><label>Rheingans(2000)</label><?label rheingans2000task?><mixed-citation>Rheingans, P. L.:
Task-based color scale design, in: 28th AIPR Workshop: 3D Visualization for Data Exploration
and Decision Making, Vol. 3905, 35–43, International Society for
Optics and Photonics, <ext-link xlink:href="https://doi.org/10.1117/12.384882" ext-link-type="DOI">10.1117/12.384882</ext-link>, 2000.</mixed-citation></ref>
      <ref id="bib1.bibx60"><?xmltex \def\ref@label{Robertson and O'Callaghan(1986)}?><label>Robertson and O'Callaghan(1986)</label><?label robertson1986generation?><mixed-citation>
Robertson, P. K. and O'Callaghan, J. F.:
The generation of color sequences for univariate and bivariate
mapping IEEE Comput. Gr. Appl., 6, 24–32, 1986.</mixed-citation></ref>
      <ref id="bib1.bibx61"><?xmltex \def\ref@label{Rogowitz et~al.(1999)}?><label>Rogowitz et al.(1999)</label><?label rogowitz1999trajectories?><mixed-citation>Rogowitz, B. E., Kalvin, A. D., Pelah, A., and Cohen, A.:
Which trajectories through which perceptually uniform color spaces
produce appropriate colors scales for interval data?, in: Color and Imaging Conference, Vol. 1999,  321–326,
Society for Imaging Science and Technology, <ext-link xlink:href="https://doi.org/10.2352/CIC.1999.7.1.art00062" ext-link-type="DOI">10.2352/CIC.1999.7.1.art00062</ext-link>,  1999.</mixed-citation></ref>
      <ref id="bib1.bibx62"><?xmltex \def\ref@label{Schloss et~al.(2018)}?><label>Schloss et al.(2018)</label><?label schloss2018mapping?><mixed-citation>
Schloss, K. B., Gramazio, C. C., Silverman, A. T., Parker, M. L., and
Wang, A. S.:
Mapping color to meaning in colormap data visualizations, IEEE T. Vis. Comput. Gr.,
25, 810–819, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx63"><?xmltex \def\ref@label{Schneider et~al.(2022)}?><label>Schneider et al.(2022)</label><?label schneider2022effective?><mixed-citation>
Schneider, M., McDowell, M., Guttorp, P., Steel, E. A., and Fleischhut, N.: Effective uncertainty visualization for aftershock forecast maps, Nat. Hazards Earth Syst. Sci., 22, 1499–1518, https://doi.org/10.5194/nhess-22-1499-2022, 2022.</mixed-citation></ref>
      <ref id="bib1.bibx64"><?xmltex \def\ref@label{Sherman-Morris et~al.(2015)}?><label>Sherman-Morris et al.(2015)</label><?label sherman2015measuring?><mixed-citation>
Sherman-Morris, K., Antonelli, K. B., and Williams, C. C.:
Measuring the effectiveness of the graphical communication of
hurricane storm surge threat,
Weather Clim. Soc., 7,  69–82, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx65"><?xmltex \def\ref@label{Spence et~al.(1999)}?><label>Spence et al.(1999)</label><?label spence1999using?><mixed-citation>
Spence, I., Kutlesa, N., and Rose, D. L.:
Using color to code quantity in spatial displays,
J. Ex. Psychol. Appl., 5, 393, 1999.</mixed-citation></ref>
      <ref id="bib1.bibx66"><?xmltex \def\ref@label{Stauffer et~al.(2015)}?><label>Stauffer et al.(2015)</label><?label stauffer2015somewhere?><mixed-citation>
Stauffer, R., Mayr, G. J., Dabernig, M., and Zeileis, A.:
Somewhere over the rainbow: How to make effective use of colors in
meteorological visualizations, B. Am. Meteorol. Soc., 96, 203–216, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx67"><?xmltex \def\ref@label{Tajima(1983)}?><label>Tajima(1983)</label><?label tajima1983uniform?><mixed-citation>
Tajima, J.:
Uniform color scale applications to computer graphics, Comp. Vis. Graph. Image Process., 21, 305–325, 1983.</mixed-citation></ref>
      <ref id="bib1.bibx68"><?xmltex \def\ref@label{Thompson et~al.(2015)}?><label>Thompson et al.(2015)</label><?label thompson2015influence?><mixed-citation>
Thompson, M. A., Lindsay, J. M., and Gaillard, J. C.:
The influence of probabilistic volcanic hazard map properties on
hazard communication, J. Appl. Volcanol., 4, 1–24, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx69"><?xmltex \def\ref@label{Thompson et~al.(2017)}?><label>Thompson et al.(2017)</label><?label thompson2017more?><mixed-citation>
Thompson, M. A., Lindsay, J. M., and Leonard, G. S.:
More than meets the eye: Volcanic hazard map design and visual
communication, in:  Observing the Volcano World, 621–640, Springer, ISBN 978-3-319-44095-8,   2017.</mixed-citation></ref>
      <ref id="bib1.bibx70"><?xmltex \def\ref@label{Thyng et~al.(2016)}?><label>Thyng et al.(2016)</label><?label thyng2016true?><mixed-citation>
Thyng, K. M., Greene, C. A., Hetland, R. D., Zimmerle, H. M., and
DiMarco, S. F.:
True colors of oceanography: Guidelines for effective and accurate
colormap selection, Oceanography, 29, 9–13, 2016.</mixed-citation></ref>
      <ref id="bib1.bibx71"><?xmltex \def\ref@label{Wang et~al.(2014)}?><label>Wang et al.(2014)</label><?label wang2014blue?><mixed-citation>
Tingting, W., Siyun, S., and Lei, M.:
Blue or red? the effects of colour on the emotions of Chinese
people, Asian J. Soc. Psychol., 17,  152–158, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx72"><?xmltex \def\ref@label{Tobler(1973)}?><label>Tobler(1973)</label><?label tobler1973choropleth?><mixed-citation>
Tobler, W. R.:
Choropleth maps without class intervals?, Geogr. Anal., 5, 262–265,
1973.</mixed-citation></ref>
      <ref id="bib1.bibx73"><?xmltex \def\ref@label{Trumbo(1981)}?><label>Trumbo(1981)</label><?label trumbo1981theory?><mixed-citation>
Trumbo, B. E.:
A theory for coloring bivariate statistical maps,
The Am. Stat., 35, 220–226,
1981.</mixed-citation></ref>
      <ref id="bib1.bibx74"><?xmltex \def\ref@label{Tyagunov et~al.(2006)}?><label>Tyagunov et al.(2006)</label><?label tyagunov2006seismic?><mixed-citation>
Tyagunov, S., Grünthal, G., Wahlström, R., Stempniewski, L., and Zschau, J.: Seismic risk mapping for Germany, Nat. Hazards Earth Syst. Sci., 6, 573–586, https://doi.org/10.5194/nhess-6-573-2006, 2006.</mixed-citation></ref>
      <ref id="bib1.bibx75"><?xmltex \def\ref@label{Ware et~al.(2018)}?><label>Ware et al.(2018)</label><?label ware2018measuring?><mixed-citation>
Ware, C., Turton, T. L., Bujack, R., Samsel, F., Shrivastava, P., and Rogers, D. H.:
Measuring and modeling the feature detection threshold functions of
colormaps, IEEE T. Vis. Comput. Gr.,
25, 2777–2790, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx76"><?xmltex \def\ref@label{Westaway(2022)}?><label>Westaway(2022)</label><?label westaway2022gc?><mixed-citation>
Westaway, R. M.:
Gc insights: Rainbow colour maps remain widely used in the
geosciences, Geosci. Commun., 5, 83–86,
2022.</mixed-citation></ref>
      <ref id="bib1.bibx77"><?xmltex \def\ref@label{Zhou and Hansen(2015)}?><label>Zhou and Hansen(2015)</label><?label zhou2015survey?><mixed-citation>
Zhou, L. and Hansen, C. D.:
A survey of colormaps in visualization, IEEE T. Vis. Comput. Gr.,
22, 2051–2069, 2015.</mixed-citation></ref>

  </ref-list></back>
    <!--<article-title-html>Criteria-based visualization design for hazard maps</article-title-html>
<abstract-html/>
<ref-html id="bib1.bib1"><label>Armstrong et al.(2003)</label><mixed-citation>
      
Armstrong, M. P., Xiao, N., and Bennett, D. A.:
Using genetic algorithms to create multicriteria class intervals for   choropleth maps, Annals of the Association of American Geographers, 93, 595–623, 2003.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>Baker et al.(2021)</label><mixed-citation>
      
Baker, J., Bradley, B., and Stafford, P.: Seismic hazard and risk analysis,
Cambridge University Press, <a href="https://doi.org/10.1017/9781108425056" target="_blank">https://doi.org/10.1017/9781108425056</a>, 2021.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>Birch(2012)</label><mixed-citation>
      
Birch, J.:
Worldwide prevalence of red-green color deficiency, JOSA A, 29, 313–320, 2012.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>Bivand et al.(2020)</label><mixed-citation>
      
Bivand, R., Ono, H., Dunlap, R., and Stigler, M.:
Package “classint”,  2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>Borland and Taylor(2007)</label><mixed-citation>
      
Borland, D. and Taylor, R. M.:
Rainbow color map (still) considered harmful, IEEE Comput. Graph., 27, 14–17, 2007.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>Bostrom et al.(2008)</label><mixed-citation>
      
Bostrom, A., Anselin, L., and Farris, J.:
Visualizing seismic risk and uncertainty: A review of related
research, Annals of the New York Academy of Sciences, 1128, 29–40, 2008.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>Brewer and Pickle(2002)</label><mixed-citation>
      
Brewer, C. A. and Pickle, L.:
Evaluation of methods for classifying epidemiological data on
choropleth maps in series, Ann. Assoc. Am. Geogr., 92, 662–681, 2002.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>Brychtova and Çöltekin(2016)</label><mixed-citation>
      
Brychtovam, A. and Çöltekin, A.:
An empirical user study for measuring the influence of colour
distance and font size in map reading using eye tracking, The Carto. J., 53, 202–212,
2016.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>Bujack et al.(2017)</label><mixed-citation>
      
Bujack, R., Turton, T. L., Samsel, F., Ware, C., Rogers, D. H.,
and Ahrens, J.:
The good, the bad, and the ugly: A theoretical framework for the
assessment of continuous colormaps, IEEE T. Vis. Comput. Gr.,
24, 923–933, 2017.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>Cantarino et al.(2019)</label><mixed-citation>
      
Cantarino, I., Carrion, M. A., Goerlich, F., and Martinez Ibañez, V.:
A ROC analysis-based classification method for landslide
susceptibility maps, Landslides, 16, 265–282, 2019.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>Chan et al.(2003)</label><mixed-citation>
      
Chan, A. H. S., Han, S. H., and Nanthavanij, S.:
Color associations for Hong Kong Chinese, Korean, and Thai-A
comparison, in: Proceedings of IEA 14th Triennial Congress, Seoul Korea,
2003.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>Clarke and Costall(2008)</label><mixed-citation>
      
Clarke, T. and Costall, A.:
The emotional connotations of color: A qualitative investigation, Color Res. Appli., 33, 406–410, 2008.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>Çöltekin et al.(2017)</label><mixed-citation>
      
Çöltekin, A., Brychtová, A., Griffin, A. L.,
Robinson, A. C., Imhof, M., and Pettit, C.:
Perceptual complexity of soil-landscape maps: a user evaluation of
color organization in legend designs using eye tracking, Int. J. Dig. Earth, 10, 560–581, 2017.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>Crameri et al.(2020)</label><mixed-citation>
      
Crameri, F., Shephard, G. E., and Heron, P. J.:
The misuse of colour in science communication, Nat. Commun., 11, 1–10, 2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>Dasgupta et al.(2018)</label><mixed-citation>
      
Dasgupta, A., Poco, J., Rogowitz, B., Han, K., Bertini, E.,
and Silva, C. T.:
The effect of color scales on climate scientists' objective and
subjective performance in spatial data analysis tasks, IEEE T. Vis. Comput. Gr., <a href="https://doi.org/10.1109/TVCG.2018.2876539" target="_blank">https://doi.org/10.1109/TVCG.2018.2876539</a>,
2018.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>Dobson(1973)</label><mixed-citation>
      
Dobson, M. W.:
Choropleth maps without class intervals?: a comment,
Geograph. Anal., 5, 358–360,
1973.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>Doore et al.(1993)</label><mixed-citation>
      
Doore, G. S., Eustis, A. C., Jones, D., Leep, R., Lincoln, J., MacDonald, Al. E., Mandics, P. A., Ryan, R. T., Schiavone, J. A. (chair), and Schiessl, D.:
Guidelines for using color to depict meteorological information, B. Am. Meteor. Soc., 74, 1709–1713, 1993.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>Dransch et al.(2010)</label><mixed-citation>
      
Dransch, D., Rotzoll, H., and Poser, K.:
The contribution of maps to the challenges of risk communication to
the public, Int. J. Dig. Earth, 3, 292–311, 2010.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib19"><label>Edler et al.(2020)</label><mixed-citation>
      
Edler, D., Keil, J., Tuller, M.-C., Bestgen, A.-K., and
Dickmann, F.:
Searching for the “right” legend: The impact of legend position
on legend decoding in a cartographic memory task, The Carto. J., 57, 6–17,
2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib20"><label>Evans(1977)</label><mixed-citation>
      
Evans, I. S.:
The selection of class intervals, T. I. Brit. Geogr., 2,
98–124, 1977.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib21"><label>Fisher(1958)</label><mixed-citation>
      
Fisher, W. D.:
On grouping for maximum homogeneity, J. Am. Stat. Assoc., 53, 789–798, 1958.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib22"><label>Fyfe and Molnar(2020)</label><mixed-citation>
      
Fyfe, M. and Molnar, S.:
Evaluating the use and communication of seismic hazard maps: A case
study of Metro Vancouver, British Columbia, Canada,
WIT Trans. Eng. Sci., 129,  157–168, 2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib23"><label>Gaspar-Escribano and Iturrioz(2011)</label><mixed-citation>
      
Gaspar-Escribano, J. M. and Iturrioz, T.: Communicating earthquake risk: mapped parameters and cartographic representation, Nat. Hazards Earth Syst. Sci., 11, 359–366, https://doi.org/10.5194/nhess-11-359-2011, 2011.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib24"><label>GFZ(2023)</label><mixed-citation>
      
GFZ: Helmholtz-Zentrum Potsdam GFZ,
D-eqhaz16, <a href="https://www-app5.gfz-potsdam.de/d-eqhaz16/index.html" target="_blank"/> (last access: 1 August 2022),
Plattform zur Abfrage von gefährdungskonsistenten Antwortspektren
(UHS) für beliebige Punkte in Deutschland sowie von nationalen
Erdbebengefährdungskarten nach dem Berechnungsmodell von Grünthal et al.
(2018), 2023.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib25"><label>Gramazio et al.(2016)Gramazio, Laidlaw, and
Schloss</label><mixed-citation>
      
Gramazio, C. C., Laidlaw, D. H., and Schloss, K. B.:
Colorgorical: Creating discriminable and preferable color palettes
for information visualization, IEEE T. Vis. Comput. Gr.,
23, 521–530, 2016.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib26"><label>Griffith and Leonard(1997)</label><mixed-citation>
      
Griffith, L. J. and Leonard, S. D.:
Association of colors with warning signal words,
Int. J. Ind. Ergonom., 20, 317–325, 1997.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib27"><label>Grünthal et al.(2018)</label><mixed-citation>
      
Grünthal, G., Stromeyer, D., Bosse, C., Cotton, F.,
and Bindi, D.:
The probabilistic seismic hazard assessment of Germany—version
2016, considering the range of epistemic uncertainties and aleatory
variability, B. Earthq. Eng., 16, 4339–4395, 2018.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib28"><label>Hagemeier-Klose and Wagner(2009)</label><mixed-citation>
      
Hagemeier-Klose, M. and Wagner, K.: Evaluation of flood hazard maps in print and web mapping services as information tools in flood risk communication, Nat. Hazards Earth Syst. Sci., 9, 563–574, https://doi.org/10.5194/nhess-9-563-2009, 2009.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib29"><label>Harrower and Brewer(2003)</label><mixed-citation>
      
Harrower, M. and Brewer, C. A.:
Colorbrewer.org: an online tool for selecting colour schemes for
maps, The Carto. J., 40, 27–37,
2003.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib30"><label>Haynes et al.(2007)Haynes, Barclay, and Pidgeon</label><mixed-citation>
      
Haynes, K., Barclay, J., and Pidgeon, N.:
Volcanic hazard communication using maps: an evaluation of their
effectiveness, B. Volcanol., 70, 123–138,
2007.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib31"><label>Horton et al.(2020)</label><mixed-citation>
      
Horton, S., Nowak, S., and Haegeli, P.: Enhancing the operational value of snowpack models with visualization design principles, Nat. Hazards Earth Syst. Sci., 20, 1557–1572, https://doi.org/10.5194/nhess-20-1557-2020, 2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib32"><label>Itten(1961)</label><mixed-citation>
      
Itten, J.:
The art of color the subjective experience and objective rationale of
color, ISBN-13 978-0471289289,
1961.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib33"><label>Jenks(1967)</label><mixed-citation>
      
Jenks, G. F.:
The data model concept in statistical mapping, Int. Yearbook Carto., 7, 186–190,
1967.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib34"><label>Jiang(2013)</label><mixed-citation>
      
Jiang, B.:
Head/tail breaks: A new classification scheme for data with a
heavy-tailed distribution, The Profess. Geogr., 65, 482–494, 2013.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib35"><label>Jiang et al.(2013)</label><mixed-citation>
      
Jiang, B., Liu, X., and Jia, T.:
Scaling of geographic space as a universal rule for map
generalization, Ann. Assoc. Am. Geogr.,
103, 844–855, 2013.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib36"><label>Kennedy(1994)</label><mixed-citation>
      
Kennedy, S.:
Unclassed choropleth maps revisited/some guidelines for the
construction of unclassed and classed choropleth maps, Cartographica: The Int. J. Geogr.
Info. Geovisualiz., 31, 16–25, 1994.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib37"><label>Kindlmann et al.(2002)</label><mixed-citation>
      
Kindlmann, G., Reinhard, E., and Creem, S.:
Face-based luminance matching for perceptual colormap generation, in: IEEE Visualization, 2002, VIS 2002., 299–306, IEEE,
2002.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib38"><label>Kinkeldey et al.(2017)</label><mixed-citation>
      
Kinkeldey, C., MacEachren, A. M., Riveiro, M., and Schiewe, J.:
Evaluating the effect of visually represented geodata uncertainty on
decision-making: systematic review, lessons learned, and recommendations, Cartogr. Geogr. Inf. Sci., 44, 1–21, 2017.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib39"><label>Li and Qin(2014)</label><mixed-citation>
      
Li, Z. and Qin, Z.:
Spacing and alignment rules for effective legend design, Cartogr. Geogr. Inf. Sci., 41, 348–362, 2014.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib40"><label>Light and Bartlein(2004)</label><mixed-citation>
      
Light, A. and Bartlein, P. J.:
The end of the rainbow? Color schemes for improved data graphics, Eos, Transactions American Geophysical Union, 85, 385–391, 2004.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib41"><label>Lin et al.(2013)</label><mixed-citation>
      
Lin, S., Fortuna, J., Kulkarni, C., Stone, M., and Heer, J.:
Selecting semantically-resonant colors for data visualization, in: Computer Graphics Forum, Vol. 32,  401–410, Wiley
Online Library, 2013.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib42"><label>MacAdam(1942)</label><mixed-citation>
      
MacAdam, D. L.:
Visual sensitivities to color differences in daylight, Josa, 32, 247–274, 1942.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib43"><label>MacDonald(1999)</label><mixed-citation>
      
MacDonald, L. W.:
Using color effectively in computer graphics, IEEE Compu. Graph. Appl., 19, 20–35, 1999.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib44"><label>MacPherson-Krutsky et al.(2020)</label><mixed-citation>
      
MacPherson-Krutsky, C. C., Brand, B. D., and Lindell, M. K.:
Does updating natural hazard maps to reflect best practices increase
viewer comprehension of risk?, Int. J. Dis. Risk Reduc., 46, 101487, <a href="https://doi.org/10.1016/j.ijdrr.2020.101487" target="_blank">https://doi.org/10.1016/j.ijdrr.2020.101487</a>, 2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib45"><label>Marti et al.(2019)</label><mixed-citation>
      
Marti, M., Stauffacher, M., and Wiemer, S.: Difficulties in explaining complex issues with maps: evaluating seismic hazard communication – the Swiss case, Nat. Hazards Earth Syst. Sci., 19, 2677–2700, https://doi.org/10.5194/nhess-19-2677-2019, 2019.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib46"><label>Maxwell(2000)</label><mixed-citation>
      
Maxwell, B. A.:
Visualizing geographic classifications using color, The Carto. J., 37, 93–99,
2000.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib47"><label>Mehta and Zhu(2009)</label><mixed-citation>
      
Mehta, R. and Zhu, R. J.:
Blue or red? exploring the effect of color on cognitive task
performances, Science, 323, 1226–1229, 2009.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib48"><label>Meyer et al.(2012)</label><mixed-citation>
      
Meyer, V., Kuhlicke, C., Luther, J., Fuchs, S., Priest, S., Dorner, W., Serrhini, K., Pardoe, J., McCarthy, S., Seidel, J., Palka, G., Unnerstall, H., Viavattene, C., and Scheuer, S.: Recommendations for the user-specific enhancement of flood maps, Nat. Hazards Earth Syst. Sci., 12, 1701–1716, https://doi.org/10.5194/nhess-12-1701-2012, 2012.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib49"><label>Miller(1956)</label><mixed-citation>
      
Miller, G. A.:
The magical number seven, plus or minus two: Some limits on our
capacity for processing information,
Psychol. Rev., 63, 81, 1956.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib50"><label>Miran et al.(2017)Miran, Ling, James, Gerard, and
Rothfusz</label><mixed-citation>
      
Miran, S. M., Ling, C., James, J. J., Gerard, A., and Rothfusz, L.:
User perception and interpretation of tornado probabilistic hazard
information: Comparison of four graphical designs,
Appl. Ergon., 65, 277–285, 2017.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib51"><label>Muller(1979)</label><mixed-citation>
      
Muller, J.-C.:
Perception of continuously shaded maps, Ann. Assoc. Am. Geogr., 69, 240–249, 1979.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib52"><label>Olson and Brewer(1997)</label><mixed-citation>
      
Olson, J. M. and Brewer, C. A.:
An evaluation of color selections to accommodate map users with
color-vision impairments,
Ann. Assoc. Am. Geogr., 87, 103–134, 1997.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib53"><label>Or and Wang(2014)</label><mixed-citation>
      
Or, C. K. L. and Wang, H. H. L.:
Color–concept associations: A cross-occupational and-cultural study
and comparison, Color Res. Appl., 39, 630–635, 2014.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib54"><label>OSFHome(2020)</label><mixed-citation>
      
OSFHome: Seismic hazard mapping, OSFHome [data set, code], <a href="https://osf.io/puerc/?view_only=2b747decfbfb4093a9e925e5fe09cd48" target="_blank"/> (last access: 1 August 2022), 2020.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib55"><label>Padilla et al.(2016)Padilla, Quinan, Meyer, and
Creem-Regehr</label><mixed-citation>
      
Padilla, L., Quinan, P. S., Meyer, M., and Creem-Regehr, S. H.:
Evaluating the impact of binning 2d scalar fields,  IEEE T. Vis. Comput. Gr.,
23, 431–440, 2016.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib56"><label>Pratt(1959)</label><mixed-citation>
      
Pratt, J. W.: Remarks on zeros and ties in the Wilcoxon signed rank procedures, J. Am. Stat. Assoc., 54.287, 655–667, 1959.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib57"><label>Quinan and Meyer(2015)</label><mixed-citation>
      
Quinan, P. S. and Meyer, M.:
Visually comparing weather features in forecasts, IEEE T. Vis. Comput. Gr.,
22, 389–398, 2015.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib58"><label>Reda et al.(2018)</label><mixed-citation>
      
Reda, K., Nalawade, P., and Ansah-Koi, K.:
Graphical perception of continuous quantitative maps: the effects of
spatial frequency and colormap design, in: Proceedings of the 2018 CHI Conference on Human Factors in
Computing Systems,  <a href="https://doi.org/10.1145/3173574.3173846" target="_blank">https://doi.org/10.1145/3173574.3173846</a>, 1–12, 2018.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib59"><label>Rheingans(2000)</label><mixed-citation>
      
Rheingans, P. L.:
Task-based color scale design, in: 28th AIPR Workshop: 3D Visualization for Data Exploration
and Decision Making, Vol. 3905, 35–43, International Society for
Optics and Photonics, <a href="https://doi.org/10.1117/12.384882" target="_blank">https://doi.org/10.1117/12.384882</a>, 2000.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib60"><label>Robertson and O'Callaghan(1986)</label><mixed-citation>
      
Robertson, P. K. and O'Callaghan, J. F.:
The generation of color sequences for univariate and bivariate
mapping IEEE Comput. Gr. Appl., 6, 24–32, 1986.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib61"><label>Rogowitz et al.(1999)</label><mixed-citation>
      
Rogowitz, B. E., Kalvin, A. D., Pelah, A., and Cohen, A.:
Which trajectories through which perceptually uniform color spaces
produce appropriate colors scales for interval data?, in: Color and Imaging Conference, Vol. 1999,  321–326,
Society for Imaging Science and Technology, <a href="https://doi.org/10.2352/CIC.1999.7.1.art00062" target="_blank">https://doi.org/10.2352/CIC.1999.7.1.art00062</a>,  1999.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib62"><label>Schloss et al.(2018)</label><mixed-citation>
      
Schloss, K. B., Gramazio, C. C., Silverman, A. T., Parker, M. L., and
Wang, A. S.:
Mapping color to meaning in colormap data visualizations, IEEE T. Vis. Comput. Gr.,
25, 810–819, 2018.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib63"><label>Schneider et al.(2022)</label><mixed-citation>
      
Schneider, M., McDowell, M., Guttorp, P., Steel, E. A., and Fleischhut, N.: Effective uncertainty visualization for aftershock forecast maps, Nat. Hazards Earth Syst. Sci., 22, 1499–1518, https://doi.org/10.5194/nhess-22-1499-2022, 2022.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib64"><label>Sherman-Morris et al.(2015)</label><mixed-citation>
      
Sherman-Morris, K., Antonelli, K. B., and Williams, C. C.:
Measuring the effectiveness of the graphical communication of
hurricane storm surge threat,
Weather Clim. Soc., 7,  69–82, 2015.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib65"><label>Spence et al.(1999)</label><mixed-citation>
      
Spence, I., Kutlesa, N., and Rose, D. L.:
Using color to code quantity in spatial displays,
J. Ex. Psychol. Appl., 5, 393, 1999.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib66"><label>Stauffer et al.(2015)</label><mixed-citation>
      
Stauffer, R., Mayr, G. J., Dabernig, M., and Zeileis, A.:
Somewhere over the rainbow: How to make effective use of colors in
meteorological visualizations, B. Am. Meteorol. Soc., 96, 203–216, 2015.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib67"><label>Tajima(1983)</label><mixed-citation>
      
Tajima, J.:
Uniform color scale applications to computer graphics, Comp. Vis. Graph. Image Process., 21, 305–325, 1983.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib68"><label>Thompson et al.(2015)</label><mixed-citation>
      
Thompson, M. A., Lindsay, J. M., and Gaillard, J. C.:
The influence of probabilistic volcanic hazard map properties on
hazard communication, J. Appl. Volcanol., 4, 1–24, 2015.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib69"><label>Thompson et al.(2017)</label><mixed-citation>
      
Thompson, M. A., Lindsay, J. M., and Leonard, G. S.:
More than meets the eye: Volcanic hazard map design and visual
communication, in:  Observing the Volcano World, 621–640, Springer, ISBN 978-3-319-44095-8,   2017.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib70"><label>Thyng et al.(2016)</label><mixed-citation>
      
Thyng, K. M., Greene, C. A., Hetland, R. D., Zimmerle, H. M., and
DiMarco, S. F.:
True colors of oceanography: Guidelines for effective and accurate
colormap selection, Oceanography, 29, 9–13, 2016.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib71"><label>Wang et al.(2014)</label><mixed-citation>
      
Tingting, W., Siyun, S., and Lei, M.:
Blue or red? the effects of colour on the emotions of Chinese
people, Asian J. Soc. Psychol., 17,  152–158, 2014.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib72"><label>Tobler(1973)</label><mixed-citation>
      
Tobler, W. R.:
Choropleth maps without class intervals?, Geogr. Anal., 5, 262–265,
1973.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib73"><label>Trumbo(1981)</label><mixed-citation>
      
Trumbo, B. E.:
A theory for coloring bivariate statistical maps,
The Am. Stat., 35, 220–226,
1981.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib74"><label>Tyagunov et al.(2006)</label><mixed-citation>
      
Tyagunov, S., Grünthal, G., Wahlström, R., Stempniewski, L., and Zschau, J.: Seismic risk mapping for Germany, Nat. Hazards Earth Syst. Sci., 6, 573–586, https://doi.org/10.5194/nhess-6-573-2006, 2006.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib75"><label>Ware et al.(2018)</label><mixed-citation>
      
Ware, C., Turton, T. L., Bujack, R., Samsel, F., Shrivastava, P., and Rogers, D. H.:
Measuring and modeling the feature detection threshold functions of
colormaps, IEEE T. Vis. Comput. Gr.,
25, 2777–2790, 2018.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib76"><label>Westaway(2022)</label><mixed-citation>
      
Westaway, R. M.:
Gc insights: Rainbow colour maps remain widely used in the
geosciences, Geosci. Commun., 5, 83–86,
2022.

    </mixed-citation></ref-html>
<ref-html id="bib1.bib77"><label>Zhou and Hansen(2015)</label><mixed-citation>
      
Zhou, L. and Hansen, C. D.:
A survey of colormaps in visualization, IEEE T. Vis. Comput. Gr.,
22, 2051–2069, 2015.

    </mixed-citation></ref-html>--></article>
