<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" xml:lang="en" dtd-version="3.0" article-type="research-article">
  <front>
    <journal-meta><journal-id journal-id-type="publisher">NHESS</journal-id><journal-title-group>
    <journal-title>Natural Hazards and Earth System Sciences</journal-title>
    <abbrev-journal-title abbrev-type="publisher">NHESS</abbrev-journal-title><abbrev-journal-title abbrev-type="nlm-ta">Nat. Hazards Earth Syst. Sci.</abbrev-journal-title>
  </journal-title-group><issn pub-type="epub">1684-9981</issn><publisher>
    <publisher-name>Copernicus Publications</publisher-name>
    <publisher-loc>Göttingen, Germany</publisher-loc>
  </publisher></journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.5194/nhess-21-3879-2021</article-id><title-group><article-title>How is avalanche danger described in textual descriptions in avalanche forecasts in Switzerland? Consistency between forecasters and avalanche danger</article-title><alt-title>Description of avalanche danger</alt-title>
      </title-group><?xmltex \runningtitle{Description of avalanche danger}?><?xmltex \runningauthor{V.~Hutter et al.}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="no" rid="aff1 aff2">
          <name><surname>Hutter</surname><given-names>Veronika</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="yes" rid="aff2 aff3">
          <name><surname>Techel</surname><given-names>Frank</given-names></name>
          <email>techel@slf.ch</email>
        <ext-link>https://orcid.org/0000-0001-5686-6127</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff3">
          <name><surname>Purves</surname><given-names>Ross S.</given-names></name>
          
        </contrib>
        <aff id="aff1"><label>1</label><institution>School of Life Sciences, Technical University of Munich, Germany</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>WSL Institute for Snow and Avalanche Research (SLF), Davos, Switzerland</institution>
        </aff>
        <aff id="aff3"><label>3</label><institution>Department of Geography, University of Zurich, Zurich, Switzerland</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">Frank Techel (techel@slf.ch)</corresp></author-notes><pub-date><day>23</day><month>December</month><year>2021</year></pub-date>
      
      <volume>21</volume>
      <issue>12</issue>
      <fpage>3879</fpage><lpage>3897</lpage>
      <history>
        <date date-type="received"><day>1</day><month>June</month><year>2021</year></date>
           <date date-type="rev-request"><day>8</day><month>June</month><year>2021</year></date>
           <date date-type="rev-recd"><day>18</day><month>November</month><year>2021</year></date>
           <date date-type="accepted"><day>19</day><month>November</month><year>2021</year></date>
      </history>
      <permissions>
        <copyright-statement>Copyright: © 2021 Veronika Hutter et al.</copyright-statement>
        <copyright-year>2021</copyright-year>
      <license license-type="open-access"><license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p></license></permissions><self-uri xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021.html">This article is available from https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021.html</self-uri><self-uri xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021.pdf">The full text article is available as a PDF file from https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021.pdf</self-uri>
      <abstract><title>Abstract</title>

      <p id="d1e112">Effective and efficient communication of expected avalanche conditions and danger to the public is of great importance, especially where the primary audience of forecasts are recreational, non-expert users. In Europe, avalanche danger is communicated using a pyramid, starting with ordinal levels of avalanche danger and progressing through avalanche-prone locations and avalanche problems to a danger description. In many forecast products, information relating to the trigger required to release an avalanche, the frequency or number of potential triggering spots, and the expected avalanche size is described exclusively in a textual danger description. These danger descriptions are, however, the least standardized part of avalanche forecasts. Taking the perspective of the avalanche forecaster and focusing particularly on terms describing these three characterizing elements of avalanche danger, we investigate first which meaning forecasters assign to the text characterizing these elements and second how these descriptions relate to the forecast danger level. We analyzed almost 6000 danger descriptions in avalanche forecasts published in Switzerland and written using  a structured catalogue of phrases with a limited number of words. Words and phrases representing information describing these three elements were labeled and assigned to ordinal classes by Swiss avalanche forecasters. These classes were then related to avalanche danger. Forecasters were relatively consistent in assigning labels to words and phrases with Cohen's kappa values ranging from 0.64 to 0.87. Avalanche danger levels were also described consistently using words and phrases, with for example avalanche size classes increasing monotonically with avalanche danger. However, especially for danger level 2 (moderate), information about key elements of avalanche danger, for instance the frequency or number of potential triggering spots, was often missing in danger descriptions. In general, the analysis of the danger descriptions showed that extreme conditions are described in more detail than intermediate values, highlighting the difficulty of communicating conditions that are neither rare nor frequent or neither small nor large. Our results provide data-driven insights that could be used to refine the ways in which avalanche danger could be communicated. Furthermore, through the perspective of the semiotic triangle, relating a referent (the avalanche situation) through thought (the processing process) to symbols (the textual danger description), we provide an alternative starting point for future studies of avalanche forecast consistency and communication.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

<sec id="Ch1.S1" sec-type="intro">
  <label>1</label><title>Introduction</title>
      <?pagebreak page3880?><p id="d1e124">Public avalanche  forecasts, as provided in many mountainous regions, inform readers about snow and avalanche conditions at a regional scale.
To effectively communicate different components of the avalanche situation, forecasts often describe expected conditions systematically, using a hierarchical information pyramid communicating the current regional danger level, the most avalanche-prone locations (slope aspects and elevation range, also called the <italic>core zone</italic>), and the dominant avalanche problem as well as narrative text, a danger description <xref ref-type="bibr" rid="bib1.bibx12 bib1.bibx32" id="paren.1"><named-content content-type="pre">Fig. <xref ref-type="fig" rid="Ch1.F1"/>a and b; e.g.,</named-content></xref>, or snowpack and weather summaries.
Although the communication of danger levels, corresponding core zones, and dominant avalanche problems is often standardized using common terms or icons (e.g., in Europe: five danger levels, <xref ref-type="bibr" rid="bib1.bibx7" id="altparen.2"/>, and five avalanche problems, <xref ref-type="bibr" rid="bib1.bibx8" id="altparen.3"/>), the degree of detail and the use of text and graphics vary considerably between forecast products issued by different (usually national) forecasting centers <xref ref-type="bibr" rid="bib1.bibx2 bib1.bibx12 bib1.bibx38" id="paren.4"/>. Important information describing the severity of the avalanche conditions, such as likely triggers required to release an avalanche, the frequency with which such triggering spots will be found in a region, the specifics of the likely locations of these triggering spots, and the expected avalanche sizes, is communicated in various ways (Table <xref ref-type="table" rid="Ch1.T1"/>). Even though this information defines the avalanche danger level, its communication is much less standardized. In North America, this information is often provided through a combination of keywords and graphics. In Europe, however, narrative textual danger descriptions are much more common (Table <xref ref-type="table" rid="Ch1.T1"/>, Fig. <xref ref-type="fig" rid="Ch1.F1"/>b), though in Norway a tabular format has been adopted <xref ref-type="bibr" rid="bib1.bibx12" id="paren.5"/>.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F1" specific-use="star"><?xmltex \currentcnt{1}?><?xmltex \def\figurename{Figure}?><label>Figure 1</label><caption><p id="d1e158"><bold>(a)</bold> In Europe, avalanche forecasts are structured according to an information pyramid <xref ref-type="bibr" rid="bib1.bibx9" id="paren.6"/>, with the danger level at the top (1), followed by the avalanche-prone locations and the avalanche problem (2 and 3) and a danger description (4) providing further details. <bold>(b)</bold> Exemplary description of a danger region in the Swiss avalanche forecast (forecast published on 26 February 2021 at 08:00 CET). Even though the danger description is written in present tense, it describes the expected conditions for the 24 h following publication.</p></caption>
        <?xmltex \igopts{width=483.69685pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f01.png"/>

      </fig>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T1" specific-use="star"><?xmltex \currentcnt{1}?><label>Table 1</label><caption><p id="d1e178">Overview showing examples of how information regarding contributing factors of avalanche danger is presented in avalanche forecast products. For each forecasting center, a randomly selected forecast product is provided in the supplementary material (see Supplement).</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="justify" colwidth="3.2cm"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="3.8cm"/>
     <oasis:colspec colnum="3" colname="col3" align="justify" colwidth="3cm"/>
     <oasis:colspec colnum="4" colname="col4" align="justify" colwidth="6cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Forecast in</oasis:entry>
         <oasis:entry colname="col2">Factors</oasis:entry>
         <oasis:entry colname="col3">Communication through</oasis:entry>
         <oasis:entry colname="col4">(Further) text elements in forecast</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Canada</oasis:entry>
         <oasis:entry colname="col2">Likelihood, avalanche size<inline-formula><mml:math id="M3" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Graphic, keyword</oasis:entry>
         <oasis:entry colname="col4">Avalanche problem description, travel and terrain advice, forecast details</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Colorado (United States)</oasis:entry>
         <oasis:entry colname="col2">Likelihood, avalanche size<inline-formula><mml:math id="M4" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Graphic, keyword</oasis:entry>
         <oasis:entry colname="col4">Summary, forecast discussion</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">France</oasis:entry>
         <oasis:entry colname="col2">(Not separately listed)<inline-formula><mml:math id="M5" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Keyword summary</oasis:entry>
         <oasis:entry colname="col4">Snow quality, snowpack stability</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Norway</oasis:entry>
         <oasis:entry colname="col2">Trigger, distribution, avalanche size, probability<inline-formula><mml:math id="M6" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Bullet points with keywords</oasis:entry>
         <oasis:entry colname="col4">Avalanche danger assessment, snowpack summary, weather</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Bavaria (Germany), <?xmltex \hack{\hfill\break}?>Euregio (Austria, Italy), Switzerland</oasis:entry>
         <oasis:entry colname="col2">(Not separately listed)<inline-formula><mml:math id="M7" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Narrative of danger description</oasis:entry>
         <oasis:entry colname="col4">Snowpack, weather, outlook</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table><table-wrap-foot><p id="d1e181"><inline-formula><mml:math id="M1" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula> The factors characterize the avalanche problem(s) separately.<?xmltex \hack{\\}?><inline-formula><mml:math id="M2" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula> The description of the factors refers to the main avalanche problem(s) relevant for the avalanche danger assessment and/or avalanche danger as a whole. The description of all the factors characterizing the avalanche problem or avalanche danger within the text is not compulsory. <?xmltex \hack{\\}?>Canada: Avalanche Canada; Colorado: Colorado Avalanche Information Center (CAIC); France: Météo-France; Norway: Norwegian Water Resources and Energy Directorate (NVE);  Euregio: Province of Tyrol, Autonomous Provinces of Bolzano–South Tyrol and Trento; Switzerland: Swiss Federal Institute for Forest, WSL Institute for Snow and Avalanche Research (SLF).</p></table-wrap-foot></table-wrap>

      <p id="d1e357">Public avalanche warning services in Europe aim to provide efficient and effective forecasts to their users <xref ref-type="bibr" rid="bib1.bibx4" id="paren.7"><named-content content-type="pre">e.g.,</named-content></xref>. To achieve this goal, forecasts in general must provide credible information of value to the user <xref ref-type="bibr" rid="bib1.bibx40 bib1.bibx15" id="paren.8"><named-content content-type="pre">e.g.,</named-content></xref>. Value, however, is directly influenced by forecasts being consistent and accurate <xref ref-type="bibr" rid="bib1.bibx24" id="paren.9"/>. In recent years, this fact has increasingly been recognized in avalanche forecasting. To date, the most effort exploring quality and consistency of avalanche forecasts has focused on the forecast danger level <xref ref-type="bibr" rid="bib1.bibx11 bib1.bibx14 bib1.bibx1 bib1.bibx19 bib1.bibx37 bib1.bibx38" id="paren.10"><named-content content-type="pre">e.g.,</named-content></xref> and more rarely on other forecast elements, such as the avalanche problem <xref ref-type="bibr" rid="bib1.bibx35" id="paren.11"/>. Little research has explored either consistency or quality of icons or the text used by forecasters when assessing avalanche danger. For instance, when asking avalanche professionals to assign a probability to the meaning of the five classes describing the likelihood of avalanches <xref ref-type="bibr" rid="bib1.bibx39" id="paren.12"/> or to rate the size of observed avalanches <xref ref-type="bibr" rid="bib1.bibx22" id="paren.13"/>, considerable variation in responses was noted. Most studies have treated the forecast as a product and, for example, explored usability by testing whether users were aware of different elements of the forecast <xref ref-type="bibr" rid="bib1.bibx42" id="paren.14"/> or whether users understood the information presented <xref ref-type="bibr" rid="bib1.bibx20" id="paren.15"/>. <xref ref-type="bibr" rid="bib1.bibx12" id="text.16"/> tested the comprehension of text, icons, and pictures among Norwegian avalanche bulletin users and noted that ability to comprehend the information provided in the forecast depends on the competency of the user and the complexity of the avalanche scenario. Recent work in North America used interviews to develop a typology of avalanche forecast users' competency with respect to forecast content <xref ref-type="bibr" rid="bib1.bibx33" id="paren.17"/>. In a similar vein, <xref ref-type="bibr" rid="bib1.bibx13" id="text.18"/> surveyed the literacy of forecast readers with respect to standardized terms and icons used in North America (such as listing or ordering the danger levels, identifying avalanche problem icons, or applying information in a slope-choice experiment).
<xref ref-type="bibr" rid="bib1.bibx3" id="text.19"/> explored the characterization of the severity of the avalanche problem in Canadian avalanche forecasts, described by the likelihood of avalanches (comparable to the combination of snowpack stability and the frequency distribution of snowpack stability in Europe) and avalanche size for each avalanche problem type separately, in relation to the avalanche danger rating. <xref ref-type="bibr" rid="bib1.bibx3" id="text.20"/> noted variations in the way the same avalanche danger level was characterized between different avalanche problems.</p>
      <p id="d1e410">However, to our knowledge, there has been no systematic exploration of how forecasters actually describe the avalanche conditions in the narrative part of avalanche forecasts, despite such textual descriptions being the main way of communicating the factors describing the severity of the expected avalanche conditions in many forecast products in Europe (Table <xref ref-type="table" rid="Ch1.T1"/>).</p>
      <p id="d1e415">Standards used in avalanche forecasting, including the avalanche danger scale <xref ref-type="bibr" rid="bib1.bibx7" id="paren.21"><named-content content-type="pre">Table <xref ref-type="table" rid="Ch1.T2"/>;</named-content></xref>, the avalanche problems <xref ref-type="bibr" rid="bib1.bibx8" id="paren.22"/>, the avalanche size classification <xref ref-type="bibr" rid="bib1.bibx6" id="paren.23"/>, or the conceptual model of avalanche hazard <xref ref-type="bibr" rid="bib1.bibx34" id="paren.24"/>, make use of specific terms to describe the stability of the snowpack (or what it takes to trigger an avalanche), the frequency distribution of snowpack stability (or how frequent triggering spots are), and what the expected avalanche size and hence the damage potential are.
Nonetheless, these descriptions often include undefined, ambiguous, or hedged statements <xref ref-type="bibr" rid="bib1.bibx29 bib1.bibx10" id="paren.25"/> allowing considerable room for interpretation by both forecasters and forecast users. Furthermore, there are many possible ways for forecasters to incorporate individual terms into the narrative texts often used to communicate details of avalanche danger in Europe (Table <xref ref-type="table" rid="Ch1.T1"/>).</p>
      <p id="d1e440">Thus, to answer the question of how avalanche danger is described in textual descriptions in avalanche forecasts, focusing on the perspective of the forecaster, we arrive at our first research question:
(1) how well do forecasters agree on the meaning of terms characterizing triggers required to release avalanches,  frequencies of triggering spots, and expected avalanche sizes?
Our second research question builds on this characterization, and asks the following:
(2) how does the use of language in danger descriptions relate to avalanche danger?
To address these questions, we explored danger descriptions, written using a controlled-language environment <xref ref-type="bibr" rid="bib1.bibx41" id="paren.26"><named-content content-type="pre">referred to as the catalogue of phrases;</named-content></xref>, and avalanche danger published in more than 1000 avalanche forecasts by the national avalanche warning service in Switzerland during eight forecast seasons. The use of the catalogue of phrases is important as it impacts the forecast product since all forecasters use the same set of words.<?pagebreak page3881?> It also impacts the analysis as the number of possible combinations of words and phrases, though large, is finite and known.
We analyzed these texts in a two-step process: first, starting from an iterative annotation process <xref ref-type="bibr" rid="bib1.bibx27" id="paren.27"/>, we annotated textual phrases relating to avalanche danger for further analysis. In a second step, Swiss avalanche forecasters related these text phrases directly to  contributing factors of avalanche danger (RQ1). Building on this classification, we then extracted and analyzed text used in published danger descriptions and related it to the reported avalanche danger levels (RQ2).</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T2" specific-use="star"><?xmltex \currentcnt{2}?><label>Table 2</label><caption><p id="d1e454">European Avalanche Danger Scale <xref ref-type="bibr" rid="bib1.bibx7" id="paren.28"/>.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="3">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="5cm"/>
     <oasis:colspec colnum="3" colname="col3" align="justify" colwidth="9.5cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Danger level</oasis:entry>
         <oasis:entry colname="col2">Snowpack stability</oasis:entry>
         <oasis:entry colname="col3">Likelihood of triggering</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">1 (low)</oasis:entry>
         <oasis:entry colname="col2">The snowpack is well bonded and stable in general.</oasis:entry>
         <oasis:entry colname="col3">Triggering is generally possible only from high additional loads<inline-formula><mml:math id="M14" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula> in isolated areas of very steep, extreme terrain<inline-formula><mml:math id="M15" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula>. Only small- and medium-sized natural avalanches are possible.</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">2 (moderate)</oasis:entry>
         <oasis:entry colname="col2">The snowpack is only moderately well bonded on some steep slopes<inline-formula><mml:math id="M16" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>, otherwise well bonded in general.</oasis:entry>
         <oasis:entry colname="col3">Triggering is possible primarily from high additional loads<inline-formula><mml:math id="M17" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula>, particularly on the indicated steep slopes<inline-formula><mml:math id="M18" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>. Very large natural avalanches are unlikely.</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">3 (considerable)</oasis:entry>
         <oasis:entry colname="col2">The snowpack is moderately to poorly bonded on many steep slopes<inline-formula><mml:math id="M19" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>.</oasis:entry>
         <oasis:entry colname="col3">Triggering is possible even from low additional loads<inline-formula><mml:math id="M20" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula>, particularly on the indicated steep slopes<inline-formula><mml:math id="M21" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>. In certain situations some large – and in isolated cases very large – natural avalanches are possible.</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">4 (high)</oasis:entry>
         <oasis:entry colname="col2">The snowpack is poorly bonded on most steep slopes<inline-formula><mml:math id="M22" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>.</oasis:entry>
         <oasis:entry colname="col3">Triggering is likely even by low additional loads<inline-formula><mml:math id="M23" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula> on many steep slopes<inline-formula><mml:math id="M24" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>. In some cases, numerous large and often very large natural avalanches can be expected.</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">5 (very high)</oasis:entry>
         <oasis:entry colname="col2">The snowpack is poorly bonded and largely unstable in general.</oasis:entry>
         <oasis:entry colname="col3">Numerous very large and often extremely large natural avalanches can be expected, even in moderately steep terrain<inline-formula><mml:math id="M25" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula>.</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table><table-wrap-foot><p id="d1e460"><inline-formula><mml:math id="M8" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">a</mml:mi></mml:msup></mml:math></inline-formula> The avalanche-prone locations are described in greater detail in the avalanche forecast (altitude, slope aspect, type of terrain): moderately steep terrain – slopes shallower than about 30<inline-formula><mml:math id="M9" display="inline"><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup></mml:math></inline-formula>; steep slopes – slopes steeper than about 30<inline-formula><mml:math id="M10" display="inline"><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup></mml:math></inline-formula>; very steep, extreme terrain – particularly adverse terrain related to slope angle (more than about 40<inline-formula><mml:math id="M11" display="inline"><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup></mml:math></inline-formula>), terrain profile, proximity to ridge, smoothness of underlying ground surface.<?xmltex \hack{\\}?><inline-formula><mml:math id="M12" display="inline"><mml:msup><mml:mi/><mml:mi mathvariant="normal">b</mml:mi></mml:msup></mml:math></inline-formula> Additional loads: low – individual skier or snowboarder riding softly and not falling, snowshoer, group with good spacing (minimum 10 <inline-formula><mml:math id="M13" display="inline"><mml:mrow class="unit"><mml:mi mathvariant="normal">m</mml:mi></mml:mrow></mml:math></inline-formula>) and keeping distances; high: two or more skiers or snowboarders without good spacing (or without intervals), snow machine, explosives; natural – without human influence.</p></table-wrap-foot></table-wrap>

</sec>
<sec id="Ch1.S2">
  <label>2</label><title>Public avalanche forecasts in Switzerland</title>
      <p id="d1e722">In Switzerland, the national avalanche warning service at the WSL Institute for Snow and Avalanche Research (SLF), Davos, is responsible for the publication of avalanche forecasts covering the Swiss Alps and the Jura mountains.</p>
      <p id="d1e725">Avalanche forecasters in Switzerland use definitions and guidelines provided by the European Avalanche Warning Services (EAWS) when assessing and communicating avalanche danger. Of particular relevance is the European Avalanche Danger Scale <xref ref-type="bibr" rid="bib1.bibx7" id="paren.29"><named-content content-type="pre">EADS;</named-content><named-content content-type="post">Table <xref ref-type="table" rid="Ch1.T2"/></named-content></xref>, which qualitatively describes the five danger levels (1 (low), 2 (moderate), 3 (considerable), 4 (high), 5 (very high)) in terms of snowpack stability and the likelihood of triggering. The EADS links triggers typically required to release<?pagebreak page3882?> avalanches, the number of potential triggering spots or of avalanches, the probability of avalanche release, and the potential size of avalanches to the ordinal danger levels.</p>
      <p id="d1e736">Swiss avalanche forecasts describe expected regional avalanche conditions, always communicating the highest danger level expected during the forecast period <xref ref-type="bibr" rid="bib1.bibx32" id="paren.30"/>. In Switzerland, dry-snow conditions, where they exist, are essentially always summarized by a danger rating, with the danger description describing these dry-snow conditions and relevant avalanche problems. Wet-snow conditions, on the other hand, are often mentioned only as a secondary problem. This in turn means that danger resulting from secondary wet-snow problems is at most as high as the danger level communicated with the primary problem but may often be lower. A danger rating referring to wet-snow conditions is only given if the danger of wet-snow or gliding avalanches exceeds that of dry-snow avalanches.</p>
      <p id="d1e742">To communicate spatial variation in avalanche conditions, the forecast area is divided into almost 150 <italic>warning regions</italic>, the smallest spatial units used in the forecast. These warning regions are aggregated flexibly to <italic>danger regions</italic>, which are characterized with the same danger level, avalanche problems, avalanche-prone locations, and danger description (see example in Fig. <xref ref-type="fig" rid="Ch1.F1"/>b, which shows the forecast components describing avalanche danger in a danger region). Each danger region contains a textual description of avalanche conditions. In Switzerland, the severity of the avalanche situation is described exclusively in the danger description (see also Table <xref ref-type="table" rid="Ch1.T1"/> for a comparison with other forecasts). The trigger, the frequency of triggering spots, and avalanche size described in the text may refer to a specific avalanche problem (as in the example in Fig. <xref ref-type="fig" rid="Ch1.F1"/>b) or to the avalanche conditions as a whole.</p>
      <p id="d1e758">Avalanche forecasts are published in the evening at 17:00 CET and are valid until the following day at 17:00 CET During the main winter season forecasts are also updated at 08:00 CET, remaining valid until 17:00 CET on the same day.</p>
      <p id="d1e761">Since November 2012, the text of Swiss avalanche forecasts has been prepared using  a controlled-language environment, relying on a so-called catalogue of phrases <xref ref-type="bibr" rid="bib1.bibx43 bib1.bibx41" id="paren.31"/> – a collection of predefined sentence templates, permitting instantaneous, automatic translation of the German text into French, Italian, and English. The aim of such a catalogue of phrases is, for one base language, to allow generation of naturalistic texts using a restricted lexicon, base syntax, and semantics <xref ref-type="bibr" rid="bib1.bibx17" id="text.32"/>. The resulting texts are understandable by speakers of the base language, and as shown by  <xref ref-type="bibr" rid="bib1.bibx41" id="text.33"/>, speakers could not distinguish between danger descriptions written using the catalogue of phrases and freely written danger descriptions. Using this catalogue of phrases also makes automatic translation straightforward, and recently the catalogue has been extended to Spanish and Catalan (since winter 2020/21).</p>
      <p id="d1e773">The catalogue of phrases consists of a number of <italic>sentences</italic>, each containing a number of <italic>phrase_options</italic>.
Phrase_options contain either <italic>values</italic>, the actual textual content, or up to two additional levels of phrase_options, thus allowing an enormous number of possible combinations.
An example, illustrating the creation of a single sentence, is shown and explained in Fig. <xref ref-type="fig" rid="Ch1.F2"/>.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F2" specific-use="star"><?xmltex \currentcnt{2}?><?xmltex \def\figurename{Figure}?><label>Figure 2</label><caption><p id="d1e789">Structure of the catalogue of phrases.
A <italic>sentence</italic> consists of <italic>phrase_options</italic>. These must be filled with <italic>values</italic>.
In this example, the sentence labeled <italic>Neuschnee02</italic> is selected.
This sentence contains four phrase_options, each providing a set of values (text modules).
In this example, only two of the possible values are shown. The operational language in the Swiss catalogue of phrases is German.</p></caption>
        <?xmltex \igopts{width=483.69685pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f02.png"/>

      </fig>

</sec>
<?pagebreak page3883?><sec id="Ch1.S3">
  <label>3</label><title>Data</title>
      <p id="d1e818">We analyzed 1286 map-based avalanche forecasts published at 17:00 CET during eight winter seasons between 27 November 2012 and 13 February 2020.
A total of 5897 danger regions were described by a danger level, an avalanche problem, aspects and elevations where the danger prevails, and a danger description.</p>
      <p id="d1e821">For this study, we extracted the forecast danger level (element 1 in Fig. <xref ref-type="fig" rid="Ch1.F1"/>) and the respective danger description related to the major problem being either dry-snow conditions or wet-snow or gliding avalanches (elements 4 and 3 in Fig. <xref ref-type="fig" rid="Ch1.F1"/>, Table <xref ref-type="table" rid="Ch1.T3"/>).</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T3" specific-use="star"><?xmltex \currentcnt{3}?><label>Table 3</label><caption><p id="d1e833">Data overview: avalanche forecasts.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="7">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right"/>
     <oasis:colspec colnum="6" colname="col6" align="right"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Type</oasis:entry>
         <oasis:entry colname="col2">1 (low)</oasis:entry>
         <oasis:entry colname="col3">2 (moderate)</oasis:entry>
         <oasis:entry colname="col4">3 (considerable)</oasis:entry>
         <oasis:entry colname="col5">4 (high)</oasis:entry>
         <oasis:entry colname="col6">5 (very high)</oasis:entry>
         <oasis:entry colname="col7">All</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Dry snow</oasis:entry>
         <oasis:entry colname="col2">1031</oasis:entry>
         <oasis:entry colname="col3">2245</oasis:entry>
         <oasis:entry colname="col4">1836</oasis:entry>
         <oasis:entry colname="col5">158</oasis:entry>
         <oasis:entry colname="col6">4</oasis:entry>
         <oasis:entry colname="col7">5274</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Wet snow</oasis:entry>
         <oasis:entry colname="col2">177</oasis:entry>
         <oasis:entry colname="col3">300</oasis:entry>
         <oasis:entry colname="col4">133</oasis:entry>
         <oasis:entry colname="col5">13</oasis:entry>
         <oasis:entry colname="col6">0</oasis:entry>
         <oasis:entry colname="col7">623</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">All</oasis:entry>
         <oasis:entry colname="col2">1208</oasis:entry>
         <oasis:entry colname="col3">2545</oasis:entry>
         <oasis:entry colname="col4">1969</oasis:entry>
         <oasis:entry colname="col5">171</oasis:entry>
         <oasis:entry colname="col6">4</oasis:entry>
         <oasis:entry colname="col7">5897</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

</sec>
<sec id="Ch1.S4">
  <label>4</label><title>Methods</title>
      <p id="d1e970">We worked with German danger descriptions as German is both the working language of forecasters in Switzerland and the base language used in the creation of the catalogue of phrases. Since the danger descriptions, written with the catalogue of phrases, are a form of controlled natural language <xref ref-type="bibr" rid="bib1.bibx17" id="paren.34"/>, they can be analyzed using standard natural language processing methods. As we are working with a finite corpus of phrases, and we are interested in how those meanings or phrases can be and are interpreted (the semantics), we manually annotated textual elements in the catalogue of phrases <xref ref-type="bibr" rid="bib1.bibx27" id="paren.35"/>. We followed the iterative annotation proposed by <xref ref-type="bibr" rid="bib1.bibx27" id="text.36"/>, which they describe as the model–annotate–model–annotate (MAMA) cycle.</p>
      <p id="d1e982">Our starting point was the catalogue of phrases and its 9989 unique values. As only some values contain information related to the three key factors characterizing avalanche danger – type of trigger, the frequency of triggering spots, and avalanche size – a two-step approach was used to annotate the text.</p>
      <p id="d1e985">First, rules were defined (step 1 in Fig. <xref ref-type="fig" rid="Ch1.F3"/>) before individual values in the catalogue of phrases were assigned to one of the three key factors in an iterative annotation process using these rules (Sect. <xref ref-type="sec" rid="Ch1.S4.SS1"/>).
This initial step allowed us to retain only values contained in the catalogue of phrases judged to describe one of the three key factors, considerably reducing the amount of labeling to be done in the following step.
Second (step 2 in Fig. <xref ref-type="fig" rid="Ch1.F3"/>), the values which characterize the key factors were assigned ordinally ranked thematic labels according to current practice and/or suggested labeling used in avalanche forecasting or recent research (Sect. <xref ref-type="sec" rid="Ch1.S4.SS2"/>).
These two steps allowed us to answer research question 1: how well do forecasters agree on the meaning of terms characterizing triggers required to release avalanches,  frequencies of triggering spots, and expected avalanche sizes?</p>
      <p id="d1e996">Finally, danger descriptions and the labels assigned to them were analyzed with respect to avalanche danger (step 3 in Fig. <xref ref-type="fig" rid="Ch1.F3"/>, Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>), permitting the exploration of research question 2: how does the use of language in danger descriptions relate to avalanche danger?</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F3" specific-use="star"><?xmltex \currentcnt{3}?><?xmltex \def\figurename{Figure}?><label>Figure 3</label><caption><p id="d1e1006">Workflow describing the annotation of values in the catalogue of phrases and the analysis of the danger descriptions. The annotation (step 1) and labeling (step 2) of the values allowed research question 1 to be answered (RQ1: how well do forecasters agree on the meaning of terms characterizing triggers required to release avalanches,  frequencies of triggering spots, and expected avalanche sizes?), while the application of the labeling to the danger descriptions (step 3) permitted RQ2 to be answered (RQ2: how does the use of language in danger descriptions relate to avalanche danger?). For details refer to text.</p></caption>
        <?xmltex \igopts{width=483.69685pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f03.png"/>

      </fig>

<?pagebreak page3884?><sec id="Ch1.S4.SS1">
  <label>4.1</label><title>Catalogue of phrases: annotation and extraction of values describing key factors</title>
      <p id="d1e1022">The values in the catalogue of phrases were labeled in an iterative process  <xref ref-type="bibr" rid="bib1.bibx16" id="paren.37"/>, summarized as follows (see also Fig. <xref ref-type="fig" rid="Ch1.F3"/> – step 1):
<list list-type="custom"><list-item><label>(a)</label>
      <p id="d1e1032">Annotation rules were developed based on the definitions or descriptions of key factors in the scientific literature and operational guidelines.  We distinguished three key factors, which we refer to as the <italic>trigger type</italic>, the <italic>frequency of triggering spots</italic>, and <italic>avalanche size</italic> (Table <xref ref-type="table" rid="Ch1.T4"/>). A short version of the annotation rules is provided in Appendix Table <xref ref-type="table" rid="App1.Ch1.S1.T7"/>. In addition, we also annotated text values specifying the <italic>location of triggering spots</italic>.</p></list-item><list-item><label>(b)</label>
      <p id="d1e1053">Relying on these rules, all the values in a set of 10 randomly selected danger descriptions (2 for each danger level) were annotated with regard to which of the key factors they belonged to.</p></list-item><list-item><label>(c)</label>
      <p id="d1e1057">Following annotation, the agreement between pairs of annotators was assessed by calculating the inter-rater agreement score (Cohen's kappa coefficient <inline-formula><mml:math id="M26" display="inline"><mml:mi mathvariant="italic">κ</mml:mi></mml:math></inline-formula>), which also takes into account the agreement by random chance <xref ref-type="bibr" rid="bib1.bibx18" id="paren.38"/>.</p></list-item><list-item><label>(d)</label>
      <p id="d1e1071">Steps (a) to (c) were repeated until sufficient agreement in labeling was achieved.
We considered a sufficient agreement if the minimal agreement between any of the annotators was <inline-formula><mml:math id="M27" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.6</mml:mn></mml:mrow></mml:math></inline-formula>, which is considered <italic>substantial</italic> agreement according to <xref ref-type="bibr" rid="bib1.bibx18" id="text.39"/>.
To achieve this level of agreement, three annotation rounds, after each of which the annotation rules were discussed and revised, were carried out. In each of these rounds, 10 new danger descriptions were annotated.
The agreement between annotators increased from <inline-formula><mml:math id="M28" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.54</mml:mn></mml:mrow></mml:math></inline-formula> (round 1) to <inline-formula><mml:math id="M29" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.7</mml:mn></mml:mrow></mml:math></inline-formula> (round 3).</p></list-item><list-item><label>(e)</label>
      <p id="d1e1117">Applying the annotation rules, the values contained in the catalogue of phrases were assigned to a key factor. As only a small subset was annotated in the three annotation rounds (5 % of the values), the assigned labels were quality-checked, resulting in the inclusion of two additional values. About 1200 values contained information characterizing one of the three key factors.</p></list-item></list></p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T4" specific-use="star"><?xmltex \currentcnt{4}?><label>Table 4</label><caption><p id="d1e1123">Labels and number of categories used to describe the key factors. In addition to the labels shown, a value could also be labeled <italic>not assignable</italic>. The order of the labels corresponds to the rank order used in this analysis with the left-most labels representing the most unfavorable conditions and the right-most label the most favorable conditions. A comparison with the terms used in the conceptual model of avalanche hazard (CMAH) is also provided as a guide.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.95}[.95]?><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="center"/>
     <oasis:colspec colnum="3" colname="col3" align="left"/>
     <oasis:colspec colnum="4" colname="col4" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">

         <oasis:entry colname="col1">Key factor</oasis:entry>

         <oasis:entry colname="col2">Categories</oasis:entry>

         <oasis:entry colname="col3">Labels</oasis:entry>

         <oasis:entry colname="col4">Key factor (CMAH)</oasis:entry>

       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>

         <oasis:entry colname="col1">Trigger type</oasis:entry>

         <oasis:entry colname="col2">2</oasis:entry>

         <oasis:entry colname="col3">Natural (expected, possible), additional load (low, high)</oasis:entry>

         <oasis:entry colname="col4">Sensitivity to triggers</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">Frequency of triggering spots</oasis:entry>

         <oasis:entry colname="col2">3</oasis:entry>

         <oasis:entry colname="col3">Many, some, a few</oasis:entry>

         <oasis:entry colname="col4" morerows="1">Spatial distribution</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">Location of triggering spots</oasis:entry>

         <oasis:entry colname="col2"/>

         <oasis:entry colname="col3">Text elements, not labeled (see also Table <xref ref-type="table" rid="App1.Ch1.S1.T11"/>)</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">Avalanche size</oasis:entry>

         <oasis:entry colname="col2">5</oasis:entry>

         <oasis:entry colname="col3">5 – extremely large, 4 – very large, 3 – large, 2 – medium, 1 – small</oasis:entry>

         <oasis:entry colname="col4">Avalanche size</oasis:entry>

       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

</sec>
<sec id="Ch1.S4.SS2">
  <label>4.2</label><title>Catalogue of phrases: labeling of values</title>
      <p id="d1e1230">Once the values were assigned to key factors, the second step was the labeling of the individual values (see also Fig. <xref ref-type="fig" rid="Ch1.F3"/> – step 2).</p>
      <?pagebreak page3885?><p id="d1e1235">We first grouped values with very similar meanings. Values considered similar included variations which we judged to be synonymous, such as <italic>even in places that are not usually affected</italic> (German original: <italic>an sonst wenig gefährdeten Orten</italic>)  and <italic>even in places that are usually less vulnerable</italic> (German original: <italic>an sonst weniger gefährdeten Orten</italic>), or singular and plural forms.
This reduced the original set of 1200 values to 109.</p>
      <p id="d1e1250">To label the values, no further annotation rules were defined as we were interested in how the forecasters (our annotators) understood these values (RQ 1).
The number and labels of classes was based on definitions and descriptions used in avalanche forecasting in Europe (Table <xref ref-type="table" rid="Ch1.T4"/>): five avalanche size classes and their official labels <xref ref-type="bibr" rid="bib1.bibx6" id="paren.40"/>, the distinction of trigger types as natural or artificial triggers <xref ref-type="bibr" rid="bib1.bibx7" id="paren.41"/>, and three classes for the frequency of triggering spots or number of avalanches as in the current working documents of the European Avalanche Warning Services <xref ref-type="bibr" rid="bib1.bibx5" id="paren.42"><named-content content-type="pre">e.g.,</named-content></xref>. In addition, two probability terms are used in Switzerland to describe the occurrence of natural avalanches.
<list list-type="custom"><list-item><label>(i)</label>
      <p id="d1e1268">Three annotators assigned a single class to the 109 groups of values, including the option that a class could not be assigned. The inter-rater agreement rates ranged from 0.53 (considered <italic>moderate</italic>) to 0.63 (considered <italic>substantial</italic>). A total of 53 % of the groups of values were rated the same by all 3 annotators; 22 of the values could not be assigned to a class by at least 2 of the 3 annotators. For instance, text describing avalanches releasing <italic>deep within the snowpack</italic> (German original: <italic>tief in der Schneedecke</italic>) or <italic>weak layers existing close to the snow surface</italic> (German original: <italic>Schwachschichten nahe an der Schneeoberfläche</italic>) could be interpreted as being related to avalanche size. These text values were therefore assigned a relation with avalanche size in the annotation step described in the previous section (Sect. <xref ref-type="sec" rid="Ch1.S4.SS1"/>). However, in the annotation round described here, when annotators were specifically asked to assign a size class (or two), none could do so.</p></list-item><list-item><label>(ii)</label>
      <p id="d1e1293">Removing the values which could not be assigned to a class in the first round (i), the eight avalanche forecasters working at SLF assigned one or two classes to values. The inter-rater agreement rate  <inline-formula><mml:math id="M30" display="inline"><mml:mi mathvariant="italic">κ</mml:mi></mml:math></inline-formula> was on average 0.74 <xref ref-type="bibr" rid="bib1.bibx18" id="paren.43"><named-content content-type="pre">considered <italic>substantial</italic>;</named-content></xref> between any two annotators, but ranged between 0.64 (considered <italic>substantial</italic>) and 0.87 (considered <italic>almost perfect</italic>; see also Appendix Fig. <xref ref-type="fig" rid="App1.Ch1.S1.F6"/>). A total of 53 % of the values were assigned the same class by all eight forecasters.</p></list-item></list>
If five annotators (a majority) indicated the same class, the value was assigned to this class. If there was no clear majority vote, the value was assigned to the two most frequent classes chosen. The values and their assignment to classes are shown in the Appendix (Tables <xref ref-type="table" rid="App1.Ch1.S1.T8"/> to <xref ref-type="table" rid="App1.Ch1.S1.T10"/>), with their German original, a corresponding English translation, and the assigned class labels. For the remainder of this paper, we refer purely to the class labels shown in Table <xref ref-type="table" rid="Ch1.T4"/>.</p>
      <p id="d1e1327">Values which described the location of potential trigger locations were not categorized. An overview of these values is given in the Appendix (Table <xref ref-type="table" rid="App1.Ch1.S1.T11"/>).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F4" specific-use="star"><?xmltex \currentcnt{4}?><?xmltex \def\figurename{Figure}?><label>Figure 4</label><caption><p id="d1e1335">Following the annotation and labeling (Sects. <xref ref-type="sec" rid="Ch1.S4.SS1"/> and <xref ref-type="sec" rid="Ch1.S4.SS2"/>), the key factors and their labels were extracted from each danger description. Here, the same example as used in Fig. <xref ref-type="fig" rid="Ch1.F1"/>b is shown.</p></caption>
          <?xmltex \igopts{width=483.69685pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f04.png"/>

        </fig>

</sec>
<sec id="Ch1.S4.SS3">
  <label>4.3</label><title>Danger description: analysis</title>
      <p id="d1e1358">Applying the annotated catalogue of phrases to the actual danger descriptions (Fig. <xref ref-type="fig" rid="Ch1.F3"/> – step 3), we were able to analyze the content of the danger descriptions. Labels were assigned to values according to Tables <xref ref-type="table" rid="App1.Ch1.S1.T8"/> to <xref ref-type="table" rid="App1.Ch1.S1.T10"/>.
For example, as shown in Fig. <xref ref-type="fig" rid="Ch1.F4"/>, the values <italic>reach large size</italic> (<inline-formula><mml:math id="M31" display="inline"><mml:mo lspace="0mm">=</mml:mo></mml:math></inline-formula> size 3), <italic>very isolated cases</italic> (<inline-formula><mml:math id="M32" display="inline"><mml:mo lspace="0mm">=</mml:mo></mml:math></inline-formula> a few), and <italic>can be triggered</italic> (<inline-formula><mml:math id="M33" display="inline"><mml:mo lspace="0mm">=</mml:mo></mml:math></inline-formula> additional load) would be used for further analysis. Where a value was not linked to a single class, we randomly selected one of the two most frequent labels rather than removing these cases or always opting for a more unfavorable label so as to retain the ambiguity expressed by forecasters in the analysis.
This random assignment was primarily required for values referring to avalanche sizes (Table <xref ref-type="table" rid="App1.Ch1.S1.T9"/>) as some terms were assigned to two size classes. For instance,  <italic>rather large</italic> was linked to avalanche sizes 2 and 3 by seven of the eight forecasters.</p>
      <p id="d1e1406">We analyzed danger descriptions relating to dry-snow and wet-snow conditions separately. We make this distinction as the danger rating and the accompanying danger description often refers to dry-snow conditions in the Swiss forecast (Sect. <xref ref-type="sec" rid="Ch1.S2"/>). In addition, wet-snow avalanches almost always release naturally <xref ref-type="bibr" rid="bib1.bibx29" id="paren.44"><named-content content-type="pre">e.g.,</named-content></xref>, in contrast to dry-snow avalanches, where naturally released and<?pagebreak page3886?> artificially triggering avalanches are of equal concern. The EADS, however, does not make this distinction between dry-snow and wet-snow conditions.</p>
      <p id="d1e1416">We conducted this part of the analysis in two steps:
first, we explored whether information describing each of the key factors was present in the danger descriptions, regardless of their label. Second, we analyzed the frequency that a certain class was mentioned, considering all danger descriptions of a specific data subset (e.g., a specific danger level). To do so, we searched for the most unfavorable piece of information describing a specific key factor within a danger description relying on the rank-order shown in Table <xref ref-type="table" rid="Ch1.T4"/>. To compare two proportions, we relied on a one-sided proportion test <xref ref-type="bibr" rid="bib1.bibx25" id="paren.45"><named-content content-type="pre">R function <italic>prop.test</italic>;</named-content></xref>, testing the hypothesis as to whether the proportion in one subgroup was significantly lower (or higher) than in another subgroup. We always explored the proportions from sequential danger levels (i.e., for 2 (moderate) and 3 (considerable)) in a pairwise fashion. We refer to results as statistically significant if <inline-formula><mml:math id="M34" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula> and report <inline-formula><mml:math id="M35" display="inline"><mml:mi>p</mml:mi></mml:math></inline-formula> values in three classes: <inline-formula><mml:math id="M36" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula>, <inline-formula><mml:math id="M37" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.01</mml:mn></mml:mrow></mml:math></inline-formula>, <inline-formula><mml:math id="M38" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.001</mml:mn></mml:mrow></mml:math></inline-formula>. Where the proportion test indicated significant differences for comparisons of consecutive danger level pairs, we report only the highest <inline-formula><mml:math id="M39" display="inline"><mml:mi>p</mml:mi></mml:math></inline-formula> value (indicating the lowest significance). The entire analysis was conducted using the software R <xref ref-type="bibr" rid="bib1.bibx28" id="paren.46"/>.</p>
</sec>
</sec>
<sec id="Ch1.S5">
  <label>5</label><title>Results</title>
<sec id="Ch1.S5.SS1">
  <label>5.1</label><title>Description of dry-snow avalanche conditions</title>
      <p id="d1e1512">A total of 5274 danger descriptions referred to dry-snow conditions. Of these, avalanche size (68 % of all cases) and the frequency of triggering spots (referred to as frequency, 76 %) were described most of the time, while information on the type of trigger was provided as often as not (53 %).
In addition to describing the frequency, 72 % of the danger descriptions specified the location of triggering spots (referred to as location).
Text indicating either a frequency or a specific location was indicated in 90 % of the danger descriptions.</p>
      <p id="d1e1515">The proportion of danger descriptions providing information on all three elements characterizing avalanche danger decreased consistently from one danger level to the next lowest one (see also uppermost row labeled <italic>all 3</italic> factors in Table <xref ref-type="table" rid="Ch1.T5"/>).
Differences were significant (<inline-formula><mml:math id="M40" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.001</mml:mn></mml:mrow></mml:math></inline-formula>) for all comparisons, except when comparing 5 (very high) (75 %) and 4 (high) (52 %).
The description of 2 (moderate) was the most incomplete in this regard: 34 % of the danger descriptions described only one or none of the three key factors (Table <xref ref-type="table" rid="Ch1.T5"/>, rows labeled <italic>1 of 3</italic> or <italic>none</italic>).</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T5" specific-use="star"><?xmltex \currentcnt{5}?><label>Table 5</label><caption><p id="d1e1547">Percentage of dry-snow danger descriptions which contained information on the key factors trigger type, frequency of triggering spots, and avalanche size. In addition, the proportion for the location of triggering spots is shown. The figure provides two levels of detail. First, the proportions that information on the three key factors characterizing avalanche danger was given in the danger description (i.e., when two of three factors were described). These proportions are highlighted bold. Second, proportions are shown for each individual combination of factors within these subgroups, with a 1 indicating when a key factor was described and 0 when a key factor was not described (i.e., in the second row, when <italic>trigger</italic>, <italic>frequency</italic>, and <italic>avalanche size</italic> were described (<inline-formula><mml:math id="M41" display="inline"><mml:mo lspace="0mm">=</mml:mo></mml:math></inline-formula> 1), but not <italic>location</italic> (<inline-formula><mml:math id="M42" display="inline"><mml:mo lspace="0mm">=</mml:mo></mml:math></inline-formula> 0)).</p></caption>
  <?xmltex \igopts{width=426.791339pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-t05.png"/>
</table-wrap>

      <p id="d1e1583">In the following, we explore the actual values of the key factors in the danger descriptions for each danger level. The results are summarized in Fig. <xref ref-type="fig" rid="Ch1.F5"/>a, c, and e and Table <xref ref-type="table" rid="Ch1.T6"/>.</p>
      <p id="d1e1590">The proportion of danger descriptions, which indicated a trigger, increased clearly with increasing danger level. A trigger was rarely specified at 1 (low) (3 %), more often at 2 (moderate) (43 %), and most of the time or always at the other danger levels (<inline-formula><mml:math id="M43" display="inline"><mml:mrow><mml:mo>≥</mml:mo><mml:mn mathvariant="normal">88</mml:mn></mml:mrow></mml:math></inline-formula> %). We labeled the trigger required to release an avalanche as either a <italic>natural avalanche</italic> or requiring an <italic>additional load</italic> (Table <xref ref-type="table" rid="Ch1.T4"/>). All the danger descriptions at 4 (high) and 5 (very high) indicated natural avalanches, compared to a proportion of 33 % at 3 (considerable), 2 % at 2 (moderate), and 0.5 % at 1 (low).
Overall, the proportion of danger descriptions, which mentioned natural avalanche occurrence increased significantly from one danger level to the next highest for all danger level pairs (<inline-formula><mml:math id="M44" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.001</mml:mn></mml:mrow></mml:math></inline-formula>).
In the Swiss forecast, two German terms are used to describe the probability of natural avalanche release: <italic>expected</italic> or <italic>probable</italic> (German original: <italic>zu erwarten</italic>), indicating a high probability, and <italic>possible</italic> (German original: <italic>möglich</italic>), indicating a lower probability.
For cases, when either of these terms was used, it was generally <italic>expected</italic> or <italic>probable</italic> at 4 (high) and 5 (very high) (88 % and 100 %, respectively) and mostly <italic>possible</italic> at the other danger levels (1 (low): 96 %; 2 (moderate): 90 %; 3 (considerable): 76 %).
In contrast, an additional load was comparably rarely indicated at 1 (low) (3 % of the time) and about as often as not at 2 (moderate) (41 %) and 3 (considerable) (55 %).
If an additional load was specified, it was mostly described as a low additional load at 3 (considerable) (98 %) and at 2<?pagebreak page3887?> (moderate) (68 %) and a high additional load for the few cases containing this information at 1 (low) (72 %).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F5" specific-use="star"><?xmltex \currentcnt{5}?><?xmltex \def\figurename{Figure}?><label>Figure 5</label><caption><p id="d1e1651">Bar plots showing the proportions for the terms characterizing the three key factors by danger level. The left column <bold>(a, c, e)</bold> shows the distributions for dry-snow conditions and the right column <bold>(b, d, f)</bold> for wet-snow conditions. The upper row <bold>(a, b)</bold> shows the trigger, the middle row <bold>(c, d)</bold> the frequency of triggering spots, and the lower row <bold>(e, f)</bold> the avalanche size. No data for wet-snow conditions for danger level 5 (very high).</p></caption>
          <?xmltex \igopts{width=398.338583pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f05.png"/>

        </fig>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T6" specific-use="star"><?xmltex \currentcnt{6}?><label>Table 6</label><caption><p id="d1e1678">Description of the contributing factors of avalanche danger for dry-snow and for wet-snow conditions and – as comparison – in the European Avalanche Danger Scale <xref ref-type="bibr" rid="bib1.bibx7" id="paren.47"><named-content content-type="pre">EADS; extracted from Table <xref ref-type="table" rid="Ch1.T2"/>;</named-content></xref>. Results from this study are summarized by showing the list of the most frequent terms ordered according to their frequency of occurrence and if more than 20 % of the time. The words in the EADS are translated according to the annotation in Tables <xref ref-type="table" rid="App1.Ch1.S1.T8"/>–<xref ref-type="table" rid="App1.Ch1.S1.T10"/> and the overview by <xref ref-type="bibr" rid="bib1.bibx23" id="text.48"/>; n.d. indicates that a key factor was not described in the danger descriptions or the EADS. If n.d. is listed first, this means that this key factor was more often not described compared to the most frequent label which was described; “–”: no data for wet-snow conditions at level 5 (very high).</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.95}[.95]?><oasis:tgroup cols="5">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="left"/>
     <oasis:colspec colnum="4" colname="col4" align="left"/>
     <oasis:colspec colnum="5" colname="col5" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Danger level</oasis:entry>
         <oasis:entry colname="col2">Factor</oasis:entry>
         <oasis:entry colname="col3">Dry</oasis:entry>
         <oasis:entry colname="col4">Wet</oasis:entry>
         <oasis:entry colname="col5">EADS</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">1 (low)</oasis:entry>
         <oasis:entry colname="col2">Trigger type and probability</oasis:entry>
         <oasis:entry colname="col3">n.d.</oasis:entry>
         <oasis:entry colname="col4">Natural possible</oasis:entry>
         <oasis:entry colname="col5">High additional load</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M45" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1208</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Frequency</oasis:entry>
         <oasis:entry colname="col3">A few</oasis:entry>
         <oasis:entry colname="col4">A few, n.d.</oasis:entry>
         <oasis:entry colname="col5">A few</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Avalanche size</oasis:entry>
         <oasis:entry colname="col3">1</oasis:entry>
         <oasis:entry colname="col4">2, 1</oasis:entry>
         <oasis:entry colname="col5">1 and 2</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">2 (moderate)</oasis:entry>
         <oasis:entry colname="col2">Trigger type and probability</oasis:entry>
         <oasis:entry colname="col3">n.d., additional load</oasis:entry>
         <oasis:entry colname="col4">Natural possible</oasis:entry>
         <oasis:entry colname="col5">High additional load</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M46" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">2545</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Frequency</oasis:entry>
         <oasis:entry colname="col3">Some, a few</oasis:entry>
         <oasis:entry colname="col4">n.d.</oasis:entry>
         <oasis:entry colname="col5">Some, specific</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Avalanche size</oasis:entry>
         <oasis:entry colname="col3">n.d., 2</oasis:entry>
         <oasis:entry colname="col4">3, 2</oasis:entry>
         <oasis:entry colname="col5">n.d., <inline-formula><mml:math id="M47" display="inline"><mml:mrow><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">4</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">3 (considerable)</oasis:entry>
         <oasis:entry colname="col2">Trigger type and probability</oasis:entry>
         <oasis:entry colname="col3">Additional load, natural</oasis:entry>
         <oasis:entry colname="col4">Natural expected</oasis:entry>
         <oasis:entry colname="col5">Low additional load</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M48" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1969</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Frequency</oasis:entry>
         <oasis:entry colname="col3">n.d., some</oasis:entry>
         <oasis:entry colname="col4">n.d., many, a few</oasis:entry>
         <oasis:entry colname="col5">Some, many</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Avalanche size</oasis:entry>
         <oasis:entry colname="col3">3, n.d.</oasis:entry>
         <oasis:entry colname="col4">3, 4</oasis:entry>
         <oasis:entry colname="col5"><inline-formula><mml:math id="M49" display="inline"><mml:mrow><mml:mo>≤</mml:mo><mml:mn mathvariant="normal">3</mml:mn></mml:mrow></mml:math></inline-formula>–4</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">4 (high)</oasis:entry>
         <oasis:entry colname="col2">Trigger type and probability</oasis:entry>
         <oasis:entry colname="col3">Natural expected</oasis:entry>
         <oasis:entry colname="col4">Natural expected</oasis:entry>
         <oasis:entry colname="col5">Natural expected, low additional load likely</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M50" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">171</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Frequency</oasis:entry>
         <oasis:entry colname="col3">n.d., many</oasis:entry>
         <oasis:entry colname="col4">Many</oasis:entry>
         <oasis:entry colname="col5">Many</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Avalanche size</oasis:entry>
         <oasis:entry colname="col3">4, 3</oasis:entry>
         <oasis:entry colname="col4">4</oasis:entry>
         <oasis:entry colname="col5">3 and 4</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">5 (very high)</oasis:entry>
         <oasis:entry colname="col2">Trigger type and probability</oasis:entry>
         <oasis:entry colname="col3">Natural expected</oasis:entry>
         <oasis:entry colname="col4">–</oasis:entry>
         <oasis:entry colname="col5">Natural expected</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M51" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">4</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Frequency</oasis:entry>
         <oasis:entry colname="col3">Many, n.d.</oasis:entry>
         <oasis:entry colname="col4">–</oasis:entry>
         <oasis:entry colname="col5">Many</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Avalanche size</oasis:entry>
         <oasis:entry colname="col3">5</oasis:entry>
         <oasis:entry colname="col4">–</oasis:entry>
         <oasis:entry colname="col5">4 and 5</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

      <p id="d1e2070">The frequency of potential triggering spots or of the number of avalanches, classified as either <italic>a few</italic>, <italic>some</italic>, or <italic>many</italic>, was described about half of the time (52 %–53 %) at 3 (considerable) and 4 (high) and more often at the other danger levels (<inline-formula><mml:math id="M52" display="inline"><mml:mrow><mml:mo>≥</mml:mo><mml:mn mathvariant="normal">75</mml:mn></mml:mrow></mml:math></inline-formula> %).
When the frequency was described, it was most often <italic>a few</italic> at 1 (low), <italic>some</italic> at 2 (moderate) and 3 (considerable), and <italic>many</italic> at 4 (high) and 5 (very high).
The proportion of danger descriptions which indicated <italic>a few</italic> locations decreased significantly (<inline-formula><mml:math id="M53" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.001</mml:mn></mml:mrow></mml:math></inline-formula>) from 1 (low) (87 %) to 2 (moderate) (0.33), from 2 (moderate) to 3 (considerable) (19 %), and from 3 (considerable) to 4 (high) (9 %).
Similarly, the proportion of forecasts which mentioned <italic>many</italic> locations increased significantly (<inline-formula><mml:math id="M54" display="inline"><mml:mrow><mml:mi>p</mml:mi><mml:mo>&lt;</mml:mo><mml:mn mathvariant="normal">0.001</mml:mn></mml:mrow></mml:math></inline-formula>) from 2 (moderate) (0.3 %) to 3 (considerable) (3 %) and from 3 (considerable) to 4 (high) (36 %).</p>
      <p id="d1e2133">Beside simply describing the frequency of potential triggering spots, a specific description of where in the terrain these spots were likely to be was provided often at 1 (low) (95 %) and 2 (moderate) (80 %), less often at 3 (considerable) (57 %) and 4 (high) (54 %), and rather seldom at 5 (very high) (25 %). In other words, pointing out specific locations was more often the case at danger levels when the frequency was rather low (<italic>a few</italic> or <italic>some</italic>). In most danger descriptions, there was at least an indication of either the frequency or the location of triggering spots (between 75 % at 5 (very high) and 99 % at 1 (low)).</p>
      <p id="d1e2142">Avalanche size was comparably rarely indicated at 2 (moderate) (53 %). For cases when an avalanche size was indicated, there was a perfect monotonic correlation between the most frequently indicated avalanche size and the danger level, with, for instance, size 1 being most frequently indicated at 1 (low) and size 5 at 5 (very high). As outlined in Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>, we opted to randomly assign labels where forecasters had no majority opinion with regard to the classification of textual elements. This was particularly common for some frequently used terms describing avalanche size. This meant that 35 % of the textual elements were therefore randomly assigned to avalanche size 1 or 2 or size 2 or 3. If we had instead consistently assigned the larger of the avalanche sizes, at 1 (low) the proportions of size 2 avalanches would have increased (from 19 % to 33 %) at the cost of size 1 avalanches (67 % to 52 %). A similar, though less pronounced shift in the proportion of size 3 avalanches would be observed at 2 (moderate) (from 14 % to 17 %) and 3 (considerable) (from 50 % to 57 %). However, the correlation between the most frequently indicated avalanche size and the danger level would still be perfectly monotonic.</p>
</sec>
<sec id="Ch1.S5.SS2">
  <label>5.2</label><title>Description of wet-snow or gliding avalanche conditions</title>
      <?pagebreak page3888?><p id="d1e2155">A total of 623 danger descriptions described wet-snow or gliding avalanches as the primary danger (Fig. <xref ref-type="fig" rid="Ch1.F5"/>b, d, and f and Table <xref ref-type="table" rid="Ch1.T6"/>).
These were almost always described as natural avalanches (<inline-formula><mml:math id="M55" display="inline"><mml:mrow><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">96</mml:mn></mml:mrow></mml:math></inline-formula> %).
The probability terms used to describe the occurrence of natural avalanches were predominantly <italic>possible</italic> at 1 (low) (94 %) and about as often <italic>possible</italic> (49 %) or <italic>expected</italic> (51 %) at 2 (moderate), while at 3 (considerable) and 4 (high) natural avalanches were almost always <italic>expected</italic> (93 % and 100 %, respectively).</p>
      <p id="d1e2185">The description of the frequency of expected avalanches showed a bi-modal distribution, with the middle class <italic>some</italic> rarely being used (5 %). Furthermore, frequency information was missing in 70 % of the cases at 2 (moderate) and 45 % of the time at 3 (considerable). However, as for dry-snow conditions, in these cases an indication of the location of potential release areas was often made in the text. When frequency information was indicated, it was essentially always <italic>a few</italic> at 1 (low)  (98 %) and always <italic>many</italic> at 4 (high). Considering text information describing the frequency and location of release spots together, the danger descriptions contained at least one piece of information in this regard (between 73 % at 2 (moderate) and 92 % at 1 (low)).</p>
      <p id="d1e2197">Avalanche size was often indicated (<inline-formula><mml:math id="M56" display="inline"><mml:mrow><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">80</mml:mn></mml:mrow></mml:math></inline-formula> % of the time) and increased from size 1 to 2 at 1 (low) (46 % and 53 %, respectively) to size 2 to 3 at 2 (moderate) (32 % and 58 %, respectively), to size 3 to 4 at 3 (considerable) (57 % and 39 %, respectively), and to size 4 at 4 (high) (92 %).</p>
</sec>
</sec>
<sec id="Ch1.S6">
  <label>6</label><title>Discussion</title>
      <p id="d1e2219">Our approach aimed to better understand how words and phrases from a structured catalogue are used to convey avalanche danger. In contrast to the relatively small number of other studies which have concerned themselves with the communication of avalanche danger through forecasts <xref ref-type="bibr" rid="bib1.bibx2 bib1.bibx12 bib1.bibx33 bib1.bibx13" id="paren.49"><named-content content-type="pre">e.g.,</named-content></xref>, our starting point was to explore how forecasters interpret (RQ1) and use narrative text to convey avalanche hazard (RQ2). We took advantage of a unique data set to perform our analysis: avalanche forecasts written over eight winter seasons using a structured catalogue in Switzerland. To discuss our results, we introduce here the semiotic triangle  <xref ref-type="bibr" rid="bib1.bibx26 bib1.bibx21" id="paren.50"/>, a concept commonly used in linguistics and cartography to understand the relationships between a
<list list-type="bullet"><list-item>
      <p id="d1e2232"><italic>referent</italic>, an instance in the real world, in our case a (partially observable) avalanche situation;</p></list-item><list-item>
      <p id="d1e2238"><italic>thought</italic>, the mental models used to form a judgment about a situation; and</p></list-item><list-item>
      <p id="d1e2244"><italic>symbols</italic>, the words or icons used to describe a referent.</p></list-item></list>
This triangle is helpful as it emphasizes that the process of moving from a referent (the avalanche situation) to a symbol (the avalanche forecast) is influenced by those observing and communicating that situation and that this process is not completely knowable. Perhaps the most important aspect of the semiotic triangle with respect to forecasting is that it makes explicit the obvious, but often forgotten reality that a forecast is an abstraction of a reality understood by individuals and communicated through symbols.</p>
      <p id="d1e2250">To answer the first research question (how well do forecasters agree on the meaning of terms characterizing triggers required to release avalanches,  frequencies of triggering spots, and expected avalanche sizes?), we asked forecasters to assign labels to text values available in the catalogue of phrases to describe these factors. This annotation process was a necessary step in exploring our second research question since we needed these labels to understand how avalanche danger was described by forecasters. However, equally importantly, it gave us insight into the degree to which a trained team of forecasters uses language to describe different characteristics of avalanche danger. Since the task was performed in isolation – that is to say forecasters classified terms independently of a specific avalanche situation – it relates to one side of the semiotic triangle: the relationship between the symbol (the language used to convey a situation using the varied options available in the catalogue of phrases) and thought (the abstraction of an avalanche situation described using a small number of key factor labels). Although the overall agreement in the assigned labels between forecasters was rather high (Fig. <xref ref-type="fig" rid="App1.Ch1.S1.F6"/>; <inline-formula><mml:math id="M57" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.64</mml:mn></mml:mrow></mml:math></inline-formula>), with 50 % of the text symbols being assigned to the same class by all forecasters, it is important to note that these values are based on expert annotation by a team working together on a daily basis.</p>
      <p id="d1e2267">Zooming in on the individual classifications, it is possible to identify areas for discussion in the forecasting team with regard to three issues. First, the terms used most consistently were those taken directly from definitions. For<?pagebreak page3890?> example, there was 100 % agreement about the use of terms used in the definition of avalanche size classes (e.g., <italic>small</italic> avalanche for a size 1 avalanche or <italic>very large</italic> avalanche for a size 4 avalanche). Second, other terms, especially those which hedge, were considered more ambiguous by the forecasters, with for example <italic>rather small</italic> avalanches being considered by four forecasters to be representative of size class 1 and by four forecasters to be representative of size class 1–2 avalanches. This difference matters since size 1 avalanches are typically not associated with burials, while size 2 may “bury, injure or kill a person”  <xref ref-type="bibr" rid="bib1.bibx6" id="paren.51"/> and as size 2 avalanches more often lead to burials of recreationalists in Switzerland. Third, we also identified a number of terms present in the structured catalogue which were never used by the forecasters. In general, annotating and assigning words and phrases to particular situations gave valuable insights into the ways in which avalanche forecasters describe avalanche situations and help identify areas where consistency could be improved.</p>
      <p id="d1e2282">Our second research question asked how the use of language in danger descriptions relates to avalanche danger. The answer to this question provides knowledge as to how forecasters take a referent, in this case the expected evolution of the avalanche situation over the next 24 h, and represents it through language. The annotations of words and phrases used in the avalanche forecast allow us to first characterize how avalanche danger is described and second explore the consistency of descriptions of similar avalanche danger.</p>
      <p id="d1e2286">The description of the three elements characterizing the danger level – the trigger required to release an avalanche, the frequency of triggering spots, and the expected avalanche size – varied in their degree of completeness. Danger level 2 (moderate) regarding avalanche danger in dry-snow conditions was characterized by all three factors only 21 % of the time, and 30 % of descriptions only mentioned one factor (most often the frequency and location of the likely triggering spots). Since in Switzerland many avalanche accidents happen at this level of forecast avalanche danger <xref ref-type="bibr" rid="bib1.bibx44" id="paren.52"><named-content content-type="pre">e.g.,</named-content></xref>, characterizing the likely consequences and triggers of these avalanches more often may be useful in communicating the situation. For danger levels 3 (considerable) and 4 (high), the  frequency of triggering spots was missing about half the time.</p>
      <p id="d1e2294">These distributions of missing information are clearly not random and reflect systematic choices made by forecasters in translating the avalanche danger (referent) to a danger description (symbol) through a thought process unknown to forecast users. It appears that the cases where information is missing are those where values would likely describe the middle ground rather than the extremes. Since this middle ground may in practice be where the interpretation of avalanche forecasts is more difficult for a recreationalist, and given that avalanche danger definitions include all three factors at all levels of avalanche danger, it is important to consider further the likely influence of missing information on users.</p>
      <p id="d1e2297">Irrespective of whether factors are described in a forecast, it is also important that the factors included are used consistently. In general, we found this to be the case, and the description of the elements characterizing avalanche danger changed significantly from one danger level to the next.
As shown in Sect. <xref ref-type="sec" rid="Ch1.S5"/> (Table <xref ref-type="table" rid="Ch1.T6"/>), dry-snow and wet-snow avalanche conditions were described differently:
natural avalanches are essentially always mentioned in danger descriptions describing wet-snow or gliding avalanches, regardless of danger level, while in dry-snow conditions they are primarily mentioned at danger level 3 (considerable) or higher.
Differences also exist regarding the largest expected avalanche size: these tended to be larger for wet-snow than for dry-snow avalanche conditions. For instance, for cases when avalanche size was described, size 3 avalanches were the most frequently expected avalanche size at 2 (moderate) in wet-snow conditions (55 %) and at 3 (considerable) in dry-snow conditions (50 %).
These findings vary from the definitions given by the EADS, which does not distinguish between avalanche sizes expected in dry- or wet-snow conditions. They do, however, correspond well with a study exploring a large data set of avalanche occurrence data in the region of Davos (eastern Swiss Alps), which showed that the largest observed avalanche was larger and that the number of natural avalanches was higher for wet-snow avalanches compared to dry-snow avalanches on days with the same forecast danger level <xref ref-type="bibr" rid="bib1.bibx29" id="paren.53"/>. Although this means that the description of the forecast corresponds to observations, it also highlights an inconsistency in the application of the danger levels allowing more natural avalanches at a larger size in wet-snow conditions than dry-snow conditions. This may also be one explanation for variations in the use of the danger levels in Switzerland compared to, for instance, its neighbors in Italy <xref ref-type="bibr" rid="bib1.bibx38" id="paren.54"/>.</p>
<sec id="Ch1.S6.SS1">
  <label>6.1</label><title>Implications for forecasters</title>
      <p id="d1e2317">The list of German words related to key factors and their association with a set of (categorical) labels (Tables <xref ref-type="table" rid="App1.Ch1.S1.T8"/> to <xref ref-type="table" rid="App1.Ch1.S1.T10"/> in the Appendix) provides an opportunity to improve the consistency of the terms used to describe specific conditions by avalanche forecasters in Switzerland. This list of words may also provide a valuable starting point to harmonizing danger descriptions in other parts of the Alps, where the operating language of avalanche forecasters is German. Since hedged phrases seem to reduce consistency between forecasters and thus cannot be correctly interpreted by forecast users, we suggest identifying and discussing the use of these terms in the catalogue of phrases.</p>
      <p id="d1e2324">Our results showed that information is often lacking with respect to trigger type, frequency of triggering spots, or avalanche size. It is unclear whether this missing information reflects (a) a conscious decision by forecasters to omit<?pagebreak page3891?> information considered redundant, (b) uncertainty by forecasters with respect to these factors at some danger levels, or (c) simply forgetting to provide information about these factors. If information is simply being forgotten, then a more structured approach, such as proposed by the CMAH, would solve the problem. However, providing information for all factors presupposes that this information is reliable and relevant to users. Our results suggest that investigating the reliability and the use of these key factors in forecasts in more detail is urgent before decisions can be made about the most effective format in which to communicate such information.</p>
</sec>
<sec id="Ch1.S6.SS2">
  <label>6.2</label><title>Implications for users of the avalanche forecast</title>
      <p id="d1e2335">The purpose of an avalanche forecast is, in the case of recreationalists, to provide useful information aiding decision-making in planning and carrying out activities. The first requirement for a useful avalanche forecast is therefore that it is correct and consistent. Our results show that in general, the use of language to communicate and specify avalanche danger is (reasonably) consistent between forecasters and correlates with forecast avalanche danger. Here, the semiotic triangle again comes into play as a user interprets the symbols used by a forecaster to create their own mental model of the avalanche conditions.</p>
      <p id="d1e2338">Our work though explored the use of language from a different perspective  – that of expert forecasters. It reveals that forecasters' use of language describing avalanche situations is more consistent using words and phrases which relate directly to definitions and that the characterization of avalanche danger is least complete where the situation is more ambiguous. Leaving out information, for example the likely triggers or size classes of avalanches expected for danger level 2 (moderate), may, for forecasters, actually convey information about the situation. For instance, information on the type of trigger is often missing at lower danger levels. To a forecaster not mentioning natural avalanches may be a clear indication that an additional load is required to release avalanches. However, it is unlikely that users of an avalanche forecast will interpret absence of information in this way. Again, a potential solution to this problem may be a more structured format, such as that used in Norway or in Canada, where important characteristics describing avalanche conditions, including expected avalanche size and whether natural avalanches are expected, are provided in tabular format (Norway) or graphically (Canada). However, such approaches still assume that forecasters are able to classify information about all factors unambiguously.</p>
      <p id="d1e2341">Our results suggest that communication of non-extreme situations is most subject to ambiguity and lack of information. Since these situations are also where most recreationalists are involved in accidents, exploring how avalanche danger is interpreted and used in decision-making by users is most important here <xref ref-type="bibr" rid="bib1.bibx33 bib1.bibx13" id="paren.55"><named-content content-type="pre">e.g.,</named-content></xref>.</p>
</sec>
<sec id="Ch1.S6.SS3">
  <label>6.3</label><title>Limitations</title>
      <p id="d1e2357">We explored danger descriptions from avalanche forecasts published in Switzerland using a structured sentence catalogue, where the operational language used by forecasters was German. Thus, care is required in generalizing our results to forecasts published by other warning services in other languages, even where the same avalanche danger scale is in use. For instance, <xref ref-type="bibr" rid="bib1.bibx38" id="text.56"/> noted a different use of danger level 4 (high) in France and parts of Italy, which may indicate that these are interpreted in a slightly different way compared to forecasts issued in Switzerland or Austria.</p>
      <p id="d1e2363">Words and phrases were annotated by the forecasting team, who always work in pairs and thus are very familiar with both the structured sentence catalogue and the avalanche situation in Switzerland. Our inter-annotator agreement is therefore likely  higher than for avalanche warning services where forecasters work alone or where free text is used to write forecasts. Furthermore, situations with avalanche danger levels of 4 (high) and 5 (very high) were much rarer (<inline-formula><mml:math id="M58" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">158</mml:mn></mml:mrow></mml:math></inline-formula>, <inline-formula><mml:math id="M59" display="inline"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">4</mml:mn></mml:mrow></mml:math></inline-formula>, respectively) than the large number of danger descriptions for danger levels 1 (low) to 3 (considerable).</p>
      <p id="d1e2390">The annotation was performed at the level of the entire set of phrases, not the list of phrases actually used in the forecasts. Thus, our approach does not distinguish whether a phrase not being used is simply due to it being typical for a rare situation (for instance describing danger level 5 (very high)) or because forecasters are not in full agreement using this phrase as suggested in the EADS (for instance a single mountain climber representing a high additional load).</p>
      <p id="d1e2393">Finally, the structured sentence catalogue was not completely static over time <xref ref-type="bibr" rid="bib1.bibx16" id="paren.57"/>. Although we took account of changes to the available words and phrases, these changes <xref ref-type="bibr" rid="bib1.bibx6" id="paren.58"><named-content content-type="pre">and changes to the various definitions used for, for example, avalanche size; Table <xref ref-type="table" rid="App1.Ch1.S1.T12"/>;</named-content></xref> are likely to have influenced the interpretations made by the avalanche forecasting team in their annotation and the use of language in forecast.</p>
</sec>
</sec>
<sec id="Ch1.S7" sec-type="conclusions">
  <label>7</label><title>Conclusions</title>
      <p id="d1e2415">We analyzed the text describing the expected avalanche conditions in almost 6000 danger descriptions, written relying on a catalogue of phrases, published in the public avalanche forecast in Switzerland. We focused specifically on three factors described in the textual danger description – the type of trigger required to release an avalanche, the frequency of potential triggering spots, and the expected largest avalanche size – and their relation with the issued danger level. To conduct this analysis, the Swiss avalanche forecasters assigned categories to individual terms used in the danger description. Although the agreement in the labeling was rather high – 50 % of the terms were assigned to the same class by all eight<?pagebreak page3892?> annotators – not all terms could be assigned to a specific class by some forecasters.</p>
      <p id="d1e2418">When we linked the factors used in danger descriptions to avalanche danger we found that, especially for avalanche danger level 2 (moderate), only 21 % of descriptions used all three factors, and 30 % of descriptions mentioned only a single factor.  Furthermore, avalanche size classes are used differently to describe dry-snow and wet-snow or gliding avalanche conditions. The results highlight the demand to review and harmonize the use of terms to describe the trigger required to release an avalanche, the frequency of potential triggering spots, and the expected largest avalanche size and their relation to the danger level. Since our approach is data-driven, it provides very clear pointers as to terms which are used inconsistently or not at all by forecasters and thus gives a valuable framework for forecasting services in reviewing the quality and consistency of written forecasts. However, we focused exclusively on the perspective of Swiss forecasters working in German. Our results cannot be directly transferred to other forecasting services and languages, and the analysis was greatly simplified by use of the sentence catalogue used to write Swiss avalanche danger descriptions.</p>
      <p id="d1e2421">Future work should also explore the perspective of the user of the avalanche forecast. Are danger descriptions the best possible way to communicate important pieces of information including avalanche size or the occurrence of natural avalanches? Do users interpret this information in similar ways to forecasters?</p>
</sec>

      
      </body>
    <back><app-group>

<app id="App1.Ch1.S1">
  <?xmltex \currentcnt{A}?><label>Appendix A</label><title>Annotation rules, German–English word lists</title>
      <p id="d1e2435">In the following, we first provide a short version of the annotation rules (Table <xref ref-type="table" rid="App1.Ch1.S1.T7"/>).</p>
      <p id="d1e2440">Tables <xref ref-type="table" rid="App1.Ch1.S1.T8"/> to <xref ref-type="table" rid="App1.Ch1.S1.T11"/> list the German words and their English translation for the three key factors and their labels. These may be used as a guidance for the interpretation of the labels used in the Swiss avalanche forecasts. The proportions shown in brackets indicate how often a German word was assigned to a label. For instance, for <italic>maintaining distances between individuals</italic> (German original: <italic>Entlastungsabstände</italic>) (0.75) (Table <xref ref-type="table" rid="App1.Ch1.S1.T8"/>), six of the eight forecasters considered this to mean a <italic>low additional load</italic>. Note that the proportions shown in the English column are indications only as many-to-one and one-to-many translations were possible (i.e., two English translations for one German word, as for <italic>spontan</italic> (German) and English <italic>spontaneous</italic> or <italic>occur  naturally</italic>).</p>
      <p id="d1e2468">Finally, Table <xref ref-type="table" rid="App1.Ch1.S1.T12"/> shows the labels for the avalanche size classification prior to their renaming in 2019.<?xmltex \hack{\vspace*{1cm}}?></p>

      <?xmltex \floatpos{p}?><fig id="App1.Ch1.S1.F6"><?xmltex \currentcnt{A1}?><?xmltex \def\figurename{Figure}?><label>Figure A1</label><caption><p id="d1e2477">Kappa scores for the eight forecasters (f1–f8); <inline-formula><mml:math id="M60" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.6</mml:mn></mml:mrow></mml:math></inline-formula> is considered <italic>substantial</italic>, <inline-formula><mml:math id="M61" display="inline"><mml:mrow><mml:mi mathvariant="italic">κ</mml:mi><mml:mo>&gt;</mml:mo><mml:mn mathvariant="normal">0.8</mml:mn></mml:mrow></mml:math></inline-formula> <italic>almost perfect</italic> <xref ref-type="bibr" rid="bib1.bibx18" id="paren.59"/>.</p></caption>
        <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://nhess.copernicus.org/articles/21/3879/2021/nhess-21-3879-2021-f06.png"/>

      </fig>

<?xmltex \floatpos{p}?><table-wrap id="App1.Ch1.S1.T7"><?xmltex \currentcnt{A1}?><label>Table A1</label><caption><p id="d1e2522">Annotation rules.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="2">
     <oasis:colspec colnum="1" colname="col1" align="justify" colwidth="3cm"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="5cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Key factor</oasis:entry>
         <oasis:entry colname="col2">Assign expressions which indicate …</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Type of trigger or release probability</oasis:entry>
         <oasis:entry colname="col2">… the occurrence of natural avalanches (e.g., <italic>spontaneous</italic>) or the probability of an avalanche release (e.g., <italic>to be expected</italic>) or the trigger required to release an avalanche (e.g., <italic>human</italic>). Consider also temporal aspects (e.g., <italic>avalanches are possible any time</italic>).</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Frequency and location of triggering spots</oasis:entry>
         <oasis:entry colname="col2">… the frequency or location of triggering spots. Distinguish between terms which indicate a frequency or number (e.g., <italic>many</italic> <inline-formula><mml:math id="M62" display="inline"><mml:mo>→</mml:mo></mml:math></inline-formula> frequency) and a location in the terrain (e.g., <italic>close to ridge line</italic> <inline-formula><mml:math id="M63" display="inline"><mml:mo>→</mml:mo></mml:math></inline-formula> location) describing triggering spots.</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Avalanche size</oasis:entry>
         <oasis:entry colname="col2">… an avalanche size. Consider terms officially defined by <xref ref-type="bibr" rid="bib1.bibx6" id="text.60"><named-content content-type="post">Table <xref ref-type="table" rid="App1.Ch1.S1.T12"/>; e.g., <italic>large</italic>,</named-content></xref>, but also those which may be considered synonyms or place-holders for an avalanche size (e.g., <italic>fairly large</italic>).</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

<?xmltex \floatpos{p}?><table-wrap id="App1.Ch1.S1.T8" specific-use="star"><?xmltex \currentcnt{A2}?><label>Table A2</label><caption><p id="d1e2624">Labels assigned to German text values describing the type of trigger (or load) to release an avalanche, including the proportion of forecasters who assigned the respective label–sub-label combination to this value (in brackets) and their corresponding English translations. Note that the proportions shown in the English column are indications only as many-to-one and one-to-many translations were possible (i.e., one English translation for two German words or vice versa). Bold – value was used during the 8 years.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="5">
     <oasis:colspec colnum="1" colname="col1" align="justify" colwidth="1.8cm"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="2cm"/>
     <oasis:colspec colnum="3" colname="col3" align="justify" colwidth="1.5cm"/>
     <oasis:colspec colnum="4" colname="col4" align="justify" colwidth="5cm"/>
     <oasis:colspec colnum="5" colname="col5" align="justify" colwidth="5cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Key factor</oasis:entry>
         <oasis:entry colname="col2">Label</oasis:entry>
         <oasis:entry colname="col3">Sub-label</oasis:entry>
         <oasis:entry colname="col4">German</oasis:entry>
         <oasis:entry colname="col5">English</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Type of trigger</oasis:entry>
         <oasis:entry rowsep="1" colname="col2">Natural</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"/>
         <oasis:entry rowsep="1" colname="col4"><bold>spontan</bold> (1), <bold>jederzeit möglich</bold> (1),  <bold>möglich</bold> (1), <bold>zu erwarten</bold> (1)</oasis:entry>
         <oasis:entry rowsep="1" colname="col5"><bold>Spontaneous/occur naturally</bold> (1); <bold>anytime possible</bold> (1); <bold>possible</bold>, <bold>to be expected, probable</bold> (1)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Additional load</oasis:entry>
         <oasis:entry rowsep="1" colname="col3">Low</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>einzelner Wintersportler</bold> (1), <bold>Person</bold> (0.88), <bold>mit kleiner Belastung</bold> (1), <bold>störanfällig</bold> (0.75), <bold>können sehr leicht ausgelöst werden</bold> (1), <bold>können leicht ausgelöst werden</bold> (1), <bold>leicht auslösbar</bold> (1), <bold>Entlastungsabstände</bold> (0.75)</oasis:entry>
         <oasis:entry rowsep="1" colname="col5"><bold>Single winter-sport participants</bold> (1), <bold>person/human</bold> (0.88), <bold>even in case of small load</bold> (1), <bold>prone to triggering</bold>  (0.75), <bold>can be released very easily</bold> (1), <bold>can be released easily</bold> (1), <bold>maintaining distances between individuals</bold> (0.75)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2"/>
         <oasis:entry rowsep="1" colname="col3">Low or high</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>auslösbar</bold> (0.75), <bold>können ausgelöst werden</bold> (0.75), Bergsteiger (0.63), Fussgänger (0.63)</oasis:entry>
         <oasis:entry rowsep="1" colname="col5"><bold>Capable of being triggered</bold> (0.75), <bold>can be released</bold> (0.75), climber (0.63), hiker (0.63)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2"/>
         <oasis:entry colname="col3">High</oasis:entry>
         <oasis:entry colname="col4"><bold>mit grosser Belastung</bold> (1), Gruppe Personen (1), Sprengung (1), gesprengt (1), kaum auslösbar (1)</oasis:entry>
         <oasis:entry colname="col5"><bold>With large additional load</bold> (1), group of people (1), explosives triggered (1), unlikely to be released (1)</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

<?xmltex \floatpos{p}?><table-wrap id="App1.Ch1.S1.T9" specific-use="star"><?xmltex \currentcnt{A3}?><label>Table A3</label><caption><p id="d1e2817">Labels assigned to German text values describing the frequency of potential triggering spots or the number of avalanches, including the proportion of forecasters who assigned the respective label to this value (in brackets) and their corresponding English translations. Note that the proportions shown in the English column are indications only as many-to-one and one-to-many translations were possible (i.e., one English translation for two German words or vice versa). Bold – value was used during the 8 years.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="justify" colwidth="1.8cm"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="2.4cm"/>
     <oasis:colspec colnum="3" colname="col3" align="justify" colwidth="5.9cm"/>
     <oasis:colspec colnum="4" colname="col4" align="justify" colwidth="5.9cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Key factor</oasis:entry>
         <oasis:entry colname="col2">Label</oasis:entry>
         <oasis:entry colname="col3">German</oasis:entry>
         <oasis:entry colname="col4">English</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Frequency</oasis:entry>
         <oasis:entry rowsep="1" colname="col2">Low/a few</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>sehr vereinzelt</bold> (1), <bold>vereinzelt</bold> (1), <bold>lokal</bold> (0.88), <bold>sehr selten</bold> (1), <bold>selten</bold> (1), <bold>eher selten</bold> (0.63), <bold>nur wenige</bold> (1), <bold>wenige</bold> (1), <bold>einzelne</bold> (1)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Very isolated</bold> (1), <bold>isolated</bold> (1), <bold>in some localities</bold> (0.88), <bold>very/rather rare</bold> (1), <bold>rare</bold> (1), <bold>rather rare</bold> (0.63), <bold>rather few/a few</bold> (1), <bold>few/a few</bold> (1), <bold>locally</bold> (1)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Medium/some</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>teilweise</bold> (1), <bold>teils</bold> (1), <bold>stellenweise</bold> (0.63), mehrere (0.88)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>In some cases</bold> (1), <bold>in some places</bold> (1), several (0.88)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">High/many</oasis:entry>
         <oasis:entry colname="col3"><bold>sehr viele</bold> (1), <bold>viele</bold> (0.88), <bold>zahlreiche</bold> (1), <bold>weit verbreitet</bold> (1), <bold> verbreitet</bold> (0.63), <bold>viele Stellen</bold> (0.88), <bold>vielerorts/an vielen Orten</bold> (0.88), <bold>allgemein</bold> (0.63), <bold>sehr/recht häufig</bold> (1),  <bold>häufig</bold> (0.63), <bold>sehr oft</bold> (1)</oasis:entry>
         <oasis:entry colname="col4"><bold>A great many</bold> (1), <bold>many</bold> (0.88), <bold>numerous</bold> (1), <bold>very widespread</bold> (1), <bold>widespread/over a wide area</bold> (0.63), <bold>many locations</bold> (0.88), <bold>in many places</bold> (0.88), <bold>very/rather frequent</bold> (1), <bold>frequent</bold> (0.63), <bold>very often</bold> (1)</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

<?xmltex \floatpos{h!}?><table-wrap id="App1.Ch1.S1.T10" specific-use="star"><?xmltex \currentcnt{A4}?><label>Table A4</label><caption><p id="d1e3032">Labels assigned to German text values describing avalanche size, including the proportion of forecasters who assigned the respective label to this value (in brackets) and their corresponding English translations. Not shown are values describing avalanche size, which could not be assigned to a label (step 1, Sect. <xref ref-type="sec" rid="Ch1.S4.SS1"/>). Note that the proportions shown in the English column are indications only as many-to-one and one-to-many translations were possible (i.e., one English translation for two German words or vice versa). Bold - value was used during the 8 years.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.95}[.95]?><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="justify" colwidth="1.8cm"/>
     <oasis:colspec colnum="2" colname="col2" align="justify" colwidth="2cm"/>
     <oasis:colspec colnum="3" colname="col3" align="justify" colwidth="6cm"/>
     <oasis:colspec colnum="4" colname="col4" align="justify" colwidth="6cm"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Key factor</oasis:entry>
         <oasis:entry colname="col2">Label</oasis:entry>
         <oasis:entry colname="col3">German</oasis:entry>
         <oasis:entry colname="col4">English</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Avalanche size</oasis:entry>
         <oasis:entry rowsep="1" colname="col2">Size 1</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>kleine Lawine</bold> (1),  <bold>Rutsch</bold> (1), <bold>Mitreiss- und Absturzgefahr</bold> (1)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Small avalanche</bold> (1), <bold>sluff</bold> (1), <bold>danger of avalanches sweeping people along and giving rise to falls</bold> (1)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 1 or 2</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>eher klein</bold> (0.5), <bold>nebst Verschüttungsgefahr vor allem Mitreiss- und Absturzgefahr beachten</bold> (0.75)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Rather small</bold> (0.5); <bold>apart from the danger of being buried, restraint should be exercised in view of the danger of avalanches sweeping people along and giving rise to falls</bold> (0.75)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 2</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>mittlere Lawine</bold> (1)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Medium-sized avalanche</bold> (1)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 2 or size 3</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>recht gross</bold> (0.75), <bold>ziemlich gross</bold> (0.88), <bold>gefährlich gross</bold> (0.63)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Fairly large</bold> (0.75), <bold>rather large</bold> (0.88), <bold>dangerously large</bold> (0.63)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 3</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>grosse Lawine</bold> (1)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Large avalanche</bold> (1)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 4</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>sehr grosse Lawine</bold> (1), <bold>Tallawine</bold> (0.63), <bold>bis in Tallagen</bold> (0.63), grosse Tallawine (0.75)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Very large avalanche</bold> (1), <bold>avalanches capable of reaching the valley</bold> (0.63), large avalanches capable of reaching the valley (0.75)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry rowsep="1" colname="col2">Size 4 or size 5</oasis:entry>
         <oasis:entry rowsep="1" colname="col3"><bold>können ins Grüne vorstossen</bold> (0.5)</oasis:entry>
         <oasis:entry rowsep="1" colname="col4"><bold>Capable of reaching a long way into areas with no snow cover</bold> (0.5)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">Size 5</oasis:entry>
         <oasis:entry colname="col3"><bold>extrem grosse Lawine</bold> (1); <bold>können sehr/aussergewöhnlich weit vorstossen</bold> (0.63); ausserordentlich gross (0.75); sehr grosse Tallawine (0.75); Lawinen, welche die üblichen Lawinenzüge in Länge oder Breite übertreffen (0.75)</oasis:entry>
         <oasis:entry colname="col4"><bold>Extremely large avalanche</bold> (1), <bold>avalanches capable of exceeding the length or width of the usual paths</bold> (0.63), exceptionally large (0.75), very large avalanche capable of reaching the valley (0.75), capable of reaching a very/an exceptionally long way (0.75)</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

<?xmltex \floatpos{h!}?><table-wrap id="App1.Ch1.S1.T11" specific-use="star"><?xmltex \currentcnt{A5}?><label>Table A5</label><caption><p id="d1e3266">Text values providing location-specific information. Numerous combinations and variants exist. Not shown are values describing aspect and elevation as these are normally shown in the aspect–elevation plot (Fig. <xref ref-type="fig" rid="Ch1.F1"/>b) and values which were not used in the analyzed forecasts. This list should therefore be seen as an example rather than an exhaustive list.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.95}[.95]?><oasis:tgroup cols="2">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">German</oasis:entry>
         <oasis:entry colname="col2">English</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">kammfern</oasis:entry>
         <oasis:entry colname="col2">At a distance from ridgelines</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">windgeschützte Lagen</oasis:entry>
         <oasis:entry colname="col2">Protected from the wind</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Geländekanten</oasis:entry>
         <oasis:entry colname="col2">Behind abrupt changes in the terrain</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Felswandfüsse</oasis:entry>
         <oasis:entry colname="col2">Base of rock walls</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Passlagen</oasis:entry>
         <oasis:entry colname="col2">Pass areas</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Kammlagen</oasis:entry>
         <oasis:entry colname="col2">Adjacent to ridgelines</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Gipfellagen</oasis:entry>
         <oasis:entry colname="col2">The vicinity of peaks</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Böschungen</oasis:entry>
         <oasis:entry colname="col2">Cut slopes</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Grashänge</oasis:entry>
         <oasis:entry colname="col2">Grassy slopes</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">felsdurchsetztes/absturzgefährdetes Gelände</oasis:entry>
         <oasis:entry colname="col2">Rocky terrain/in terrain where there is a danger of falling</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">(steile/sehr steile/extrem steile) Hänge/Gelände</oasis:entry>
         <oasis:entry colname="col2">(Steep/very steep/extremely steep) slopes/terrain</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Übergänge von (wenig zu viel Schnee)</oasis:entry>
         <oasis:entry colname="col2">At transitions from a shallow to a deep snowpack</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">in Randbereichen</oasis:entry>
         <oasis:entry colname="col2">At their margins</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">bei Einfahrt in (Rinnen/Mulden)</oasis:entry>
         <oasis:entry colname="col2">When entering (gullies/bowls)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">schneearme Stellen</oasis:entry>
         <oasis:entry colname="col2">Where the snow cover is rather shallow</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Triebschneehänge</oasis:entry>
         <oasis:entry colname="col2">Wind-loaded slopes</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">(hoch gelegenen/(noch nicht entladenen) Einzugsgebieten</oasis:entry>
         <oasis:entry colname="col2">(High-altitude) starting zones (that have retained the snow thus far)</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">häufig befahrenes Variantengelände und Tourengelände</oasis:entry>
         <oasis:entry colname="col2">Highly frequented off-piste terrain and on popular backcountry touring routes</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">selten befahrenes Gelände</oasis:entry>
         <oasis:entry colname="col2">In little used terrain</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Waldgrenze</oasis:entry>
         <oasis:entry colname="col2">At tree line</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

<?xmltex \floatpos{h!}?><table-wrap id="App1.Ch1.S1.T12"><?xmltex \currentcnt{A6}?><label>Table A6</label><caption><p id="d1e3481">Shift in textual labels assigned to avalanche sizes according to the European Avalanche Warning Services (EAWS) in 2018 (until 2018: <xref ref-type="bibr" rid="bib1.bibx30" id="altparen.61"/>; since winter 2018/19: <xref ref-type="bibr" rid="bib1.bibx6 bib1.bibx31" id="altparen.62"/>.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="3">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="left"/>
     <oasis:thead>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col1" morerows="1">Size class</oasis:entry>

         <oasis:entry rowsep="1" namest="col2" nameend="col3" align="center">Label </oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col2">Until 2018</oasis:entry>

         <oasis:entry colname="col3">Since winter 2018/19</oasis:entry>

       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>

         <oasis:entry colname="col1">1</oasis:entry>

         <oasis:entry colname="col2">Sluff</oasis:entry>

         <oasis:entry colname="col3">Sluff, small</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">2</oasis:entry>

         <oasis:entry colname="col2">Small</oasis:entry>

         <oasis:entry colname="col3">Medium</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">3</oasis:entry>

         <oasis:entry colname="col2">Medium</oasis:entry>

         <oasis:entry colname="col3">Large</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">4</oasis:entry>

         <oasis:entry colname="col2">Large</oasis:entry>

         <oasis:entry colname="col3">Very large</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1">5</oasis:entry>

         <oasis:entry colname="col2">Very large</oasis:entry>

         <oasis:entry colname="col3">Extremely large</oasis:entry>

       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

</app>
  </app-group><notes notes-type="dataavailability"><title>Data availability</title>

      <?pagebreak page3895?><p id="d1e3589">Data will be made available at the data repository of the Swiss Federal Institute for Forest Snow and Landscape Research (WSL; <ext-link xlink:href="https://doi.org/10.16904/envidat.266" ext-link-type="DOI">10.16904/envidat.266</ext-link>; <xref ref-type="bibr" rid="bib1.bibx36" id="altparen.63"/>).</p>
  </notes><app-group>
        <supplementary-material position="anchor"><p id="d1e3598">The supplement related to this article is available online at: <inline-supplementary-material xlink:href="https://doi.org/10.5194/nhess-21-3879-2021-supplement" xlink:title="pdf">https://doi.org/10.5194/nhess-21-3879-2021-supplement</inline-supplementary-material>.</p></supplementary-material>
        </app-group><notes notes-type="authorcontribution"><title>Author contributions</title>

      <p id="d1e3607">This contribution is based on the MSc thesis by VH <xref ref-type="bibr" rid="bib1.bibx16" id="paren.64"/>. VH developed the study design and performed the annotation of the values and the initial analysis. FT and RSP supervised the MSc thesis. For the purpose of this paper, FT re-analyzed a subset of the data used in the MSc thesis and conducted the survey of the avalanche forecasters. FT and RSP wrote the manuscript, and VH provided repeated feedback on the manuscript.</p>
  </notes><notes notes-type="competinginterests"><title>Competing interests</title>

      <p id="d1e3616">The contact author has declared that neither they nor their co-authors have any competing interests.</p>
  </notes><notes notes-type="disclaimer"><title>Disclaimer</title>

      <p id="d1e3623">Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p>
  </notes><ack><title>Acknowledgements</title><p id="d1e3629">We thank Kurt Winkler for providing a detailed overview of the catalogue of phrases and Marc Ruesch for his support with the extraction of the textual descriptions from the database. We thank Benjamin Zweifel, Célia Lucas, Christine Pielmeier, Jürg Trachsel, Kurt Winkler, Lukas Dürr, and Thomas Stucki – avalanche forecasters at the national avalanche warning service at the WSL Institute for Snow and Avalanche Research (SLF) in Switzerland – for their annotations. We thank Christoph Mitterer (avalanche warning service Tyrol, Austria) and Thomas Feistl (avalanche warning service Bavaria, Germany) for providing feedback regarding the structure and content of their forecast products (Table <xref ref-type="table" rid="Ch1.T1"/>). We also thank the two anonymous reviewers and the editor Pascal Haegeli for providing constructive feedback, which helped us to improve this paper.</p></ack><notes notes-type="reviewstatement"><title>Review statement</title>

      <p id="d1e3636">This paper was edited by Pascal Haegeli and reviewed by two anonymous referees.</p>
  </notes><ref-list>
    <title>References</title>

      <ref id="bib1.bibx1"><?xmltex \def\ref@label{{Brabec and Stucki(1998)}}?><label>Brabec and Stucki(1998)</label><?label brab98?><mixed-citation>
Brabec, B. and Stucki, T.: Verification of avalanche bulletins by
questionnaires, in: Proceedings 25 Years of Snow Avalanche Research at NGI, Norges Geotekniske Institutt NGI, 12–16 May 1998, Voss, Norway, edited by: Hestnes, E., NGI publication, 203,
79–83, 1998.</mixed-citation></ref>
      <ref id="bib1.bibx2"><?xmltex \def\ref@label{{Burkeljca(2013)}}?><label>Burkeljca(2013)</label><?label burk13?><mixed-citation>
Burkeljca, J.: Shifting audience and the visual language of avalanche risk
communication, in: Proceedings ISSW 2013, International Snow Science
Workshop, 7–11 October 2013, Grenoble – Chamonix Mont-Blanc, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx3"><?xmltex \def\ref@label{{Clark(2019)}}?><label>Clark(2019)</label><?label clark19MScLinkingCMAHdangerScale?><mixed-citation>
Clark, T.: Exploring the link between the Conceptual Model of Avalanche Hazard
and the North American Public Avalanche Danger Scale, Master's thesis, Simon
Fraser University, Vancoucer, Canada, 115 pp., 2019.</mixed-citation></ref>
      <ref id="bib1.bibx4"><?xmltex \def\ref@label{{EAWS(2017)}}?><label>EAWS(2017)</label><?label eaws17memorandumUnderstanding?><mixed-citation>EAWS: Memorandum of understanding for the European Avalanche Warning Services
(EAWS), memorandum, European Avalanche Warning Services EAWS, available at: <uri>https://www.avalanches.org/about/memorandum-of-understanding/</uri> (last access: 22 December 2021), 2017.</mixed-citation></ref>
      <ref id="bib1.bibx5"><?xmltex \def\ref@label{{EAWS(2021{\natexlab{a}})}}?><label>EAWS(2021a)</label><?label eaws21_draftAvalDangerDefinitions?><mixed-citation>
EAWS: Definition of avalanche danger, avalanche danger level and their
contributing factors; presented at EAWS General Assembly, Davos, Switzerland,
2021, EAWS working group Matrix and Scale, working group members: Müller,
K., Bellido, G., Bertrando, L., Feistl, T., Mitterer, C., Palmgren, P.,
Sofia, S., and Techel, F.,  presented at: EAWS General Assembly, Davos, Switzerland, June 2021, 2021a.</mixed-citation></ref>
      <ref id="bib1.bibx6"><?xmltex \def\ref@label{{EAWS(2021{\natexlab{b}})}}?><label>EAWS(2021b)</label><?label eaws21avalSizeScale?><mixed-citation>EAWS: Standards: avalanche size, European Avalanche Warning Services (EAWS),
available at: <uri>https://www.avalanches.org/standards/avalanche-size/</uri> (last
access: 17 November 2021), 2021b.</mixed-citation></ref>
      <ref id="bib1.bibx7"><?xmltex \def\ref@label{{EAWS(2021a)}}?><label>EAWS(2021a)</label><?label eaws21avalancheDangerScale?><mixed-citation>EAWS: Standards: European Avalanche Danger Scale (2018/19), <uri>https://www.avalanches.org/standards/avalanche-danger-scale/</uri> (last access:
17 November 2021), 2021a.</mixed-citation></ref>
      <ref id="bib1.bibx8"><?xmltex \def\ref@label{{EAWS(2021b)}}?><label>EAWS(2021b)</label><?label eaws21avalancheProblems?><mixed-citation>EAWS: Standards: Avalanche problems,
available at: <uri>https://www.avalanches.org/standards/avalanche-problems/</uri> (last access:
17 November 2021), 2021b.</mixed-citation></ref>
      <ref id="bib1.bibx9"><?xmltex \def\ref@label{{EAWS(2021c)}}?><label>EAWS(2021c)</label><?label eaws21informationPyramid?><mixed-citation>EAWS: Standards: Information pyramid,
available at: <uri>https://www.avalanches.org/standards/information-pyramid/</uri> (last access:
17 November 2021), 2021c.</mixed-citation></ref>
      <ref id="bib1.bibx10"><?xmltex \def\ref@label{{Ebert and Milne(2021)}}?><label>Ebert and Milne(2021)</label><?label eber2021forecastVerification?><mixed-citation>Ebert, P. A. and Milne, P.: Methodological and conceptual challenges in rare and severe event forecast-verification, Nat. Hazards Earth Syst. Sci. Discuss. [preprint], <ext-link xlink:href="https://doi.org/10.5194/nhess-2021-215" ext-link-type="DOI">10.5194/nhess-2021-215</ext-link>, in review, 2021.</mixed-citation></ref>
      <ref id="bib1.bibx11"><?xmltex \def\ref@label{{Elder and Armstrong(1987)}}?><label>Elder and Armstrong(1987)</label><?label elde87?><mixed-citation>
Elder, K. and Armstrong, B.: A quantitative approach for verifying avalanche
hazard ratings, in: Symposium at Davos 1986 on Avalanche Formation, Movement
and Effects, vol. 162 of International Association of Hydrological
Sciences Publication, 593–603, 1987.</mixed-citation></ref>
      <ref id="bib1.bibx12"><?xmltex \def\ref@label{{Engeset et~al.(2018)}}?><label>Engeset et al.(2018)</label><?label enge18communicateAvalWarningsNorway?><mixed-citation>Engeset, R. V., Pfuhl, G., Landrø, M., Mannberg, A., and Hetland, A.: Communicating public avalanche warnings – what works?, Nat. Hazards Earth Syst. Sci., 18, 2537–2559, <ext-link xlink:href="https://doi.org/10.5194/nhess-18-2537-2018" ext-link-type="DOI">10.5194/nhess-18-2537-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx13"><?xmltex \def\ref@label{{Finn(2020)}}?><label>Finn(2020)</label><?label finn20riskLiteracyAvalBulletins?><mixed-citation>
Finn, H.: Examining risk literacy in a complex decision-making e<?pagebreak page3896?>nvironment: A
study of public avalanche bulletins, Master's thesis, School of Resource and
Environmental Management. Simon Fraser University, Burnaby, B.C., m.R.M.
research project no. 745, 2020-04, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx14"><?xmltex \def\ref@label{{Giraud et~al.(1987)}}?><label>Giraud et al.(1987)</label><?label gira87?><mixed-citation>
Giraud, G., Lafeuille, J., and Pahaut, E.: Evaluation de la qualité de la
prévision du risque d'avalanche, Int. Ass. Hydrol. Sci. Publ., 162,
583–591, 1987.</mixed-citation></ref>
      <ref id="bib1.bibx15"><?xmltex \def\ref@label{{Gordon and Shaykewich(2000)}}?><label>Gordon and Shaykewich(2000)</label><?label gord00forecastVerificationWMO?><mixed-citation>Gordon, N. and Shaykewich, J.: Guidelines of performance assessment of public
weather services, World Meteorological Organization, Geneva, Switzerland, available at: <uri>https://library.wmo.int/index.php?lvl=notice_display&amp;id=11898#.YcHrS1kxlZc</uri> (last access: 21 December 2021), WMO/TD No. 1023, 2000.</mixed-citation></ref>
      <ref id="bib1.bibx16"><?xmltex \def\ref@label{{Hutter(2020)}}?><label>Hutter(2020)</label><?label hutt20MScThesis_dangerDescriptionsAvalFx?><mixed-citation>
Hutter, V.: The link between danger level and danger description in Swiss snow
avalanche forecasts, Master's thesis, Fakultät für Forstwissenschaften
und Ressourcenmanagement, Technische Universität München, Deutschland, 82
pp., 2020.</mixed-citation></ref>
      <ref id="bib1.bibx17"><?xmltex \def\ref@label{{Kuhn(2014)}}?><label>Kuhn(2014)</label><?label kuhn2014surveyClassifControlledNatLanguage?><mixed-citation>Kuhn, T.: A survey and classification of controlled natural languages,
Computational Linguistics, 40, 121–170, <ext-link xlink:href="https://doi.org/10.1162/COLI_a_00168" ext-link-type="DOI">10.1162/COLI_a_00168</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx18"><?xmltex \def\ref@label{{Landis and Koch(1977)}}?><label>Landis and Koch(1977)</label><?label land77kappa?><mixed-citation>Landis, J. R. and Koch, G. G.: The measurement of observer agreement for
categorical data, Biometrics, 33, 159–174, <ext-link xlink:href="https://doi.org/10.2307/2529310" ext-link-type="DOI">10.2307/2529310</ext-link>, 1977.</mixed-citation></ref>
      <ref id="bib1.bibx19"><?xmltex \def\ref@label{{Lazar et~al.(2016)}}?><label>Lazar et al.(2016)</label><?label laza16?><mixed-citation>
Lazar, B., Trautmann, S., Cooperstein, M., Greene, E., and Birkeland, K.: North
American avalanche danger scale: Do backcountry forecasters apply it
consistently?, in: Proceedings ISSW 2016. International Snow Science
Workshop, 2–7 October 2016, Breckenridge, Co., 457–465, 2016.</mixed-citation></ref>
      <ref id="bib1.bibx20"><?xmltex \def\ref@label{{{LWD Steiermark}(2015)}}?><label>LWD Steiermark(2015)</label><?label stei15?><mixed-citation>
LWD Steiermark: Ergebnisse der Online-Umfrage des LWD Steiermark 2015, Lawinenwarndienst Steiermark, Graz, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx21"><?xmltex \def\ref@label{{MacEachren(2004)}}?><label>MacEachren(2004)</label><?label maceachren04maps?><mixed-citation>
MacEachren, A. M.: How maps work: representation, visualization, and design,
Guilford Press, New York, 2004.</mixed-citation></ref>
      <ref id="bib1.bibx22"><?xmltex \def\ref@label{{Moner et~al.(2013)}}?><label>Moner et al.(2013)</label><?label mone13avalancheSize?><mixed-citation>
Moner, I., Orgué, S., Gavaldà, J., and Bacardit, M.: How big is big:
results of the avalanche size classification survey, in: Proceedings ISSW
2013. International Snow Science Workshop, 7–11 October 2013, Grenoble –
Chamonix Mont-Blanc, France, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx23"><?xmltex \def\ref@label{{M\"{u}ller et~al.(2016)}}?><label>Müller et al.(2016)</label><?label muell16adam?><mixed-citation>
Müller, K., Mitterer, C., Engeset, R., Ekker, R., and Kosberg, S.: Combining
the conceptual model of avalanche hazard with the Bavarian matrix, in:
Proceedings ISSW 2016, International Snow Science Workshop, 2–7 October
2016, Breckenridge, Co., USA, 472–479, 2016.</mixed-citation></ref>
      <ref id="bib1.bibx24"><?xmltex \def\ref@label{{Murphy(1993)}}?><label>Murphy(1993)</label><?label murp93?><mixed-citation>Murphy, A. H.: What is a good forecast? An essay on the nature of goodness in
weather forecasting, Weather Forecast., 8, 281–293,
<ext-link xlink:href="https://doi.org/10.1175/1520-0434(1993)008&lt;0281:WIAGFA&gt;2.0.CO;2" ext-link-type="DOI">10.1175/1520-0434(1993)008&lt;0281:WIAGFA&gt;2.0.CO;2</ext-link>, 1993.</mixed-citation></ref>
      <ref id="bib1.bibx25"><?xmltex \def\ref@label{{Newcombe(1998)}}?><label>Newcombe(1998)</label><?label newc1998propTest?><mixed-citation>Newcombe, R. G.: Interval estimation for the difference between independent
proportions: comparison of eleven methods, Stat. Med., 8,
873–890,
<ext-link xlink:href="https://doi.org/10.1002/(sici)1097-0258(19980430)17:8&lt;873::aid-sim779&gt;3.0.co;2-i" ext-link-type="DOI">10.1002/(sici)1097-0258(19980430)17:8&lt;873::aid-sim779&gt;3.0.co;2-i</ext-link>, 1998.</mixed-citation></ref>
      <ref id="bib1.bibx26"><?xmltex \def\ref@label{{Ogden and Richards(1925)}}?><label>Ogden and Richards(1925)</label><?label ogden25meaning?><mixed-citation>
Ogden, C. K. and Richards, I. A.: The Meaning of Meaning: A Study of the
Influence of Language upon Thought and of the Science of Symbolism, vol. 29,
Harcourt, Brace, 1925.</mixed-citation></ref>
      <ref id="bib1.bibx27"><?xmltex \def\ref@label{{Pustejovsky and Stubbs(2013)}}?><label>Pustejovsky and Stubbs(2013)</label><?label pust13natLanguageAnnotation?><mixed-citation>
Pustejovsky, J. and Stubbs, A.: Natural Language Annotation for Machine
Learning: A guide to corpus building for applications, O'Reilly Media,
Sebastopol, CA, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx28"><?xmltex \def\ref@label{{{R Core Team}(2020)}}?><label>R Core Team(2020)</label><?label R21software?><mixed-citation>R Core Team: R: A Language and Environment for Statistical Computing, R
Foundation for Statistical Computing, Vienna, Austria,
available at: <uri>https://www.R-project.org/</uri> (last access: 1 July 2020), 2020.</mixed-citation></ref>
      <ref id="bib1.bibx29"><?xmltex \def\ref@label{{Schweizer et~al.(2020)}}?><label>Schweizer et al.(2020)</label><?label schw20avalancheOccurrenceDangerLevel?><mixed-citation>Schweizer, J., Mitterer, C., Techel, F., Stoffel, A., and Reuter, B.: On the relation between avalanche occurrence and avalanche danger level, The Cryosphere, 14, 737–750, <ext-link xlink:href="https://doi.org/10.5194/tc-14-737-2020" ext-link-type="DOI">10.5194/tc-14-737-2020</ext-link>, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx30"><?xmltex \def\ref@label{{{SLF}(2017)}}?><label>SLF(2017)</label><?label slf17bullInterpretGuide?><mixed-citation>SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <uri>http://www.slf.ch/lawineninfo/zusatzinfos/interpretationshilfe/interpretationshilfe_e.pdf</uri> (last access: 20 October 2018),
edition December 2017, 53 pp., 2017.</mixed-citation></ref>
      <ref id="bib1.bibx31"><?xmltex \def\ref@label{{{SLF}(2019)}}?><label>SLF(2019)</label><?label slf19bullInterpretGuide?><mixed-citation>SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <uri>https://www.slf.ch/files/user_upload/SLF/Lawinenbulletin_Schneesituation/Wissen_zum_Lawinenbulletin/Interpretationshilfe/Interpretationshilfe_EN.pdf</uri> (last access: 15 September 2020),
edition December 2019, 52 pp., 2019.</mixed-citation></ref>
      <ref id="bib1.bibx32"><?xmltex \def\ref@label{{{SLF}(2020)}}?><label>SLF(2020)</label><?label slf20bullInterpretGuide?><mixed-citation>SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <uri>http://www.slf.ch/lawineninfo/zusatzinfos/interpretationshilfe/interpretationshilfe_e.pdf</uri> (last access: 1 November 2021),
edition December 2020, 53 pp., 2020.</mixed-citation></ref>
      <ref id="bib1.bibx33"><?xmltex \def\ref@label{{St.~Clair et~al.(2021)}}?><label>St. Clair et al.(2021)</label><?label clai21avalBullUserTypology?><mixed-citation>St. Clair, A., Finn, H., and Hageli, P.: Where the rubber of the RISP model
meets the road: Contextualizing risk information seeking and processing with
an avalanche bulletin user typology, Int. J. Dis. Risk
Red., 66, 102626, <ext-link xlink:href="https://doi.org/10.1016/j.ijdrr.2021.102626" ext-link-type="DOI">10.1016/j.ijdrr.2021.102626</ext-link>, 2021.</mixed-citation></ref>
      <ref id="bib1.bibx34"><?xmltex \def\ref@label{{Statham et~al.(2018{\natexlab{a}})}}?><label>Statham et al.(2018a)</label><?label stat18cmah?><mixed-citation>Statham, G., Haegeli, P., Greene, E., Birkeland, K., Israelson, C., Tremper,
B., Stethem, C., McMahon, B., White, B., and Kelly, J.: A conceptual model of
avalanche hazard, Nat. Hazards, 90, 663–691,
<ext-link xlink:href="https://doi.org/10.1007/s11069-017-3070-5" ext-link-type="DOI">10.1007/s11069-017-3070-5</ext-link>, 2018a.</mixed-citation></ref>
      <ref id="bib1.bibx35"><?xmltex \def\ref@label{{Statham et~al.(2018{\natexlab{b}})}}?><label>Statham et al.(2018b)</label><?label stath18consistencyForecastCanada?><mixed-citation>
Statham, G., Holeczi, S., and Shandro, B.: Consistency and accuracy of public
avalanche forecasts in Western Canada, in: Proceedings ISSW 2018,
International Snow Science Workshop, 7–12 October 2018, Innsbruck, Austria,
1491–1496, 2018b.</mixed-citation></ref>
      <ref id="bib1.bibx36"><?xmltex \def\ref@label{Techel(2021)}?><label>Techel(2021)</label><?label Techel2021?><mixed-citation>Techel, F.: How is avalanche danger described in textual descriptions in avalanche forecasts in Switzerland?, EnviDat [data set], <ext-link xlink:href="https://doi.org/10.16904/envidat.266" ext-link-type="DOI">10.16904/envidat.266</ext-link>, 2021.</mixed-citation></ref>
      <ref id="bib1.bibx37"><?xmltex \def\ref@label{{Techel and Schweizer(2017)}}?><label>Techel and Schweizer(2017)</label><?label tech17localDangerLevelEstimates_CRST?><mixed-citation>Techel, F. and Schweizer, J.: On using local avalanche danger level estimates
for regional forecast verification, Cold Reg. Sci. Technol., 144,
52–62, <ext-link xlink:href="https://doi.org/10.1016/j.coldregions.2017.07.012" ext-link-type="DOI">10.1016/j.coldregions.2017.07.012</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx38"><?xmltex \def\ref@label{{Techel et~al.(2018)}}?><label>Techel et al.(2018)</label><?label tech18spatialConsistencyBiasAvalancheForecasts?><mixed-citation>Techel, F., Mitterer, C., Ceaglio, E., Coléou, C., Morin, S., Rastelli, F., and Purves, R. S.: Spatial consistency and bias in avalanche forecasts – a case study in the European Alps, Nat. Hazards Earth Syst. Sci., 18, 2697–2716, <ext-link xlink:href="https://doi.org/10.5194/nhess-18-2697-2018" ext-link-type="DOI">10.5194/nhess-18-2697-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx39"><?xmltex \def\ref@label{{Thumlert et~al.(2020)}}?><label>Thumlert et al.(2020)</label><?label thum20likelihoodScaleAvalFx?><mixed-citation>
Thumlert, S., Statham, G., and Jamieson, B.: The likelihood scale in avalanche
forecasting, The Avalanche Review, 38, 31–33, 2020.</mixed-citation></ref>
      <ref id="bib1.bibx40"><?xmltex \def\ref@label{{Williams(1980)}}?><label>Williams(1980)</label><?label will80?><mixed-citation>Williams, K.: Credibility of avalanche warnings, J. Glaciol., 26,
93–96, <ext-link xlink:href="https://doi.org/10.1017/S0022143000010625" ext-link-type="DOI">10.1017/S0022143000010625</ext-link>, 1980.</mixed-citation></ref>
      <ref id="bib1.bibx41"><?xmltex \def\ref@label{{Winkler and Kuhn(2017)}}?><label>Winkler and Kuhn(2017)</label><?label wink17a?><mixed-citation>Winkler, K. and Kuhn, T.: Fully automatic multi-language translation with a
catalogue of phrases – successful employment for the Swiss avalanche
bulletin, Lang. Resour. Eval., 51, 13–35,
<ext-link xlink:href="https://doi.org/10.1007/s10579-015-9316-5" ext-link-type="DOI">10.1007/s10579-015-9316-5</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bibx42"><?xmltex \def\ref@label{{Winkler and Techel(2014)}}?><label>Winkler and Techel(2014)</label><?label wink14reviewSwissForecast?><mixed-citation>
Winkler, K. and Techel, F.: Users rating of the Swiss avalanche forecast, in:
Proceedings ISSW 2014, International Snow Science Workshop, 29 September–3
October 2014, Banff, Canada,  437–444, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx43"><?xmltex \def\ref@label{{Winkler et~al.(2013)}}?><label>Winkler et al.(2013)</label><?label wink13?><mixed-citation>
Winkler, K., Bächtold, M., Gallorini, S., Niederer, U., Stucki, T.,
Pielmeier, C., Darms, G., Dürr, L., Techel, F., and Zweifel, B.: Swiss
avalanche bulletin: automated translation with a catalogue of phras<?pagebreak page3897?>es, in:
Proceedings ISSW 2013, International Snow Science Workshop, 7–11 October
2013, Grenoble – Chamonix Mont-Blanc, France, 437–441, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx44"><?xmltex \def\ref@label{{Winkler et~al.(2021)}}?><label>Winkler et al.(2021)</label><?label wink21correlationAvyDangerAccidents?><mixed-citation>Winkler, K., Schmudlach, G., Degraeuwe, B., and Techel, F.: On the correlation
between the forecast avalanche danger and avalanche risk taken by backcountry
skiers in Switzerland, Cold Reg. Science Technol., 188, 103299,
<ext-link xlink:href="https://doi.org/10.1016/j.coldregions.2021.103299" ext-link-type="DOI">10.1016/j.coldregions.2021.103299</ext-link>, 2021.</mixed-citation></ref>

  </ref-list></back>
    <!--<article-title-html>How is avalanche danger described in textual descriptions in avalanche forecasts in Switzerland? Consistency between forecasters and avalanche danger</article-title-html>
<abstract-html/>
<ref-html id="bib1.bib1"><label>Brabec and Stucki(1998)</label><mixed-citation>
Brabec, B. and Stucki, T.: Verification of avalanche bulletins by
questionnaires, in: Proceedings 25 Years of Snow Avalanche Research at NGI, Norges Geotekniske Institutt NGI, 12–16 May 1998, Voss, Norway, edited by: Hestnes, E., NGI publication, 203,
79–83, 1998.
</mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>Burkeljca(2013)</label><mixed-citation>
Burkeljca, J.: Shifting audience and the visual language of avalanche risk
communication, in: Proceedings ISSW 2013, International Snow Science
Workshop, 7–11 October 2013, Grenoble – Chamonix Mont-Blanc, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>Clark(2019)</label><mixed-citation>
Clark, T.: Exploring the link between the Conceptual Model of Avalanche Hazard
and the North American Public Avalanche Danger Scale, Master's thesis, Simon
Fraser University, Vancoucer, Canada, 115 pp., 2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>EAWS(2017)</label><mixed-citation>
EAWS: Memorandum of understanding for the European Avalanche Warning Services
(EAWS), memorandum, European Avalanche Warning Services EAWS, available at: <a href="https://www.avalanches.org/about/memorandum-of-understanding/" target="_blank"/> (last access: 22 December 2021), 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>EAWS(2021a)</label><mixed-citation>
EAWS: Definition of avalanche danger, avalanche danger level and their
contributing factors; presented at EAWS General Assembly, Davos, Switzerland,
2021, EAWS working group Matrix and Scale, working group members: Müller,
K., Bellido, G., Bertrando, L., Feistl, T., Mitterer, C., Palmgren, P.,
Sofia, S., and Techel, F.,  presented at: EAWS General Assembly, Davos, Switzerland, June 2021, 2021a.
</mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>EAWS(2021b)</label><mixed-citation>
EAWS: Standards: avalanche size, European Avalanche Warning Services (EAWS),
available at: <a href="https://www.avalanches.org/standards/avalanche-size/" target="_blank"/> (last
access: 17 November 2021), 2021b.
</mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>EAWS(2021a)</label><mixed-citation>
EAWS: Standards: European Avalanche Danger Scale (2018/19), <a href="https://www.avalanches.org/standards/avalanche-danger-scale/" target="_blank"/> (last access:
17 November 2021), 2021a.
</mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>EAWS(2021b)</label><mixed-citation>
EAWS: Standards: Avalanche problems,
available at: <a href="https://www.avalanches.org/standards/avalanche-problems/" target="_blank"/> (last access:
17 November 2021), 2021b.
</mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>EAWS(2021c)</label><mixed-citation>
EAWS: Standards: Information pyramid,
available at: <a href="https://www.avalanches.org/standards/information-pyramid/" target="_blank"/> (last access:
17 November 2021), 2021c.
</mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>Ebert and Milne(2021)</label><mixed-citation>
Ebert, P. A. and Milne, P.: Methodological and conceptual challenges in rare and severe event forecast-verification, Nat. Hazards Earth Syst. Sci. Discuss. [preprint], <a href="https://doi.org/10.5194/nhess-2021-215" target="_blank">https://doi.org/10.5194/nhess-2021-215</a>, in review, 2021.
</mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>Elder and Armstrong(1987)</label><mixed-citation>
Elder, K. and Armstrong, B.: A quantitative approach for verifying avalanche
hazard ratings, in: Symposium at Davos 1986 on Avalanche Formation, Movement
and Effects, vol. 162 of International Association of Hydrological
Sciences Publication, 593–603, 1987.
</mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>Engeset et al.(2018)</label><mixed-citation>
Engeset, R. V., Pfuhl, G., Landrø, M., Mannberg, A., and Hetland, A.: Communicating public avalanche warnings – what works?, Nat. Hazards Earth Syst. Sci., 18, 2537–2559, <a href="https://doi.org/10.5194/nhess-18-2537-2018" target="_blank">https://doi.org/10.5194/nhess-18-2537-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>Finn(2020)</label><mixed-citation>
Finn, H.: Examining risk literacy in a complex decision-making environment: A
study of public avalanche bulletins, Master's thesis, School of Resource and
Environmental Management. Simon Fraser University, Burnaby, B.C., m.R.M.
research project no. 745, 2020-04, 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>Giraud et al.(1987)</label><mixed-citation>
Giraud, G., Lafeuille, J., and Pahaut, E.: Evaluation de la qualité de la
prévision du risque d'avalanche, Int. Ass. Hydrol. Sci. Publ., 162,
583–591, 1987.
</mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>Gordon and Shaykewich(2000)</label><mixed-citation>
Gordon, N. and Shaykewich, J.: Guidelines of performance assessment of public
weather services, World Meteorological Organization, Geneva, Switzerland, available at: <a href="https://library.wmo.int/index.php?lvl=notice_display&amp;id=11898#.YcHrS1kxlZc" target="_blank"/> (last access: 21 December 2021), WMO/TD No. 1023, 2000.
</mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>Hutter(2020)</label><mixed-citation>
Hutter, V.: The link between danger level and danger description in Swiss snow
avalanche forecasts, Master's thesis, Fakultät für Forstwissenschaften
und Ressourcenmanagement, Technische Universität München, Deutschland, 82
pp., 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>Kuhn(2014)</label><mixed-citation>
Kuhn, T.: A survey and classification of controlled natural languages,
Computational Linguistics, 40, 121–170, <a href="https://doi.org/10.1162/COLI_a_00168" target="_blank">https://doi.org/10.1162/COLI_a_00168</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>Landis and Koch(1977)</label><mixed-citation>
Landis, J. R. and Koch, G. G.: The measurement of observer agreement for
categorical data, Biometrics, 33, 159–174, <a href="https://doi.org/10.2307/2529310" target="_blank">https://doi.org/10.2307/2529310</a>, 1977.
</mixed-citation></ref-html>
<ref-html id="bib1.bib19"><label>Lazar et al.(2016)</label><mixed-citation>
Lazar, B., Trautmann, S., Cooperstein, M., Greene, E., and Birkeland, K.: North
American avalanche danger scale: Do backcountry forecasters apply it
consistently?, in: Proceedings ISSW 2016. International Snow Science
Workshop, 2–7 October 2016, Breckenridge, Co., 457–465, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib20"><label>LWD Steiermark(2015)</label><mixed-citation>
LWD Steiermark: Ergebnisse der Online-Umfrage des LWD Steiermark 2015, Lawinenwarndienst Steiermark, Graz, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib21"><label>MacEachren(2004)</label><mixed-citation>
MacEachren, A. M.: How maps work: representation, visualization, and design,
Guilford Press, New York, 2004.
</mixed-citation></ref-html>
<ref-html id="bib1.bib22"><label>Moner et al.(2013)</label><mixed-citation>
Moner, I., Orgué, S., Gavaldà, J., and Bacardit, M.: How big is big:
results of the avalanche size classification survey, in: Proceedings ISSW
2013. International Snow Science Workshop, 7–11 October 2013, Grenoble –
Chamonix Mont-Blanc, France, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib23"><label>Müller et al.(2016)</label><mixed-citation>
Müller, K., Mitterer, C., Engeset, R., Ekker, R., and Kosberg, S.: Combining
the conceptual model of avalanche hazard with the Bavarian matrix, in:
Proceedings ISSW 2016, International Snow Science Workshop, 2–7 October
2016, Breckenridge, Co., USA, 472–479, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib24"><label>Murphy(1993)</label><mixed-citation>
Murphy, A. H.: What is a good forecast? An essay on the nature of goodness in
weather forecasting, Weather Forecast., 8, 281–293,
<a href="https://doi.org/10.1175/1520-0434(1993)008&lt;0281:WIAGFA&gt;2.0.CO;2" target="_blank">https://doi.org/10.1175/1520-0434(1993)008&lt;0281:WIAGFA&gt;2.0.CO;2</a>, 1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib25"><label>Newcombe(1998)</label><mixed-citation>
Newcombe, R. G.: Interval estimation for the difference between independent
proportions: comparison of eleven methods, Stat. Med., 8,
873–890,
<a href="https://doi.org/10.1002/(sici)1097-0258(19980430)17:8&lt;873::aid-sim779&gt;3.0.co;2-i" target="_blank">https://doi.org/10.1002/(sici)1097-0258(19980430)17:8&lt;873::aid-sim779&gt;3.0.co;2-i</a>, 1998.
</mixed-citation></ref-html>
<ref-html id="bib1.bib26"><label>Ogden and Richards(1925)</label><mixed-citation>
Ogden, C. K. and Richards, I. A.: The Meaning of Meaning: A Study of the
Influence of Language upon Thought and of the Science of Symbolism, vol. 29,
Harcourt, Brace, 1925.
</mixed-citation></ref-html>
<ref-html id="bib1.bib27"><label>Pustejovsky and Stubbs(2013)</label><mixed-citation>
Pustejovsky, J. and Stubbs, A.: Natural Language Annotation for Machine
Learning: A guide to corpus building for applications, O'Reilly Media,
Sebastopol, CA, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib28"><label>R Core Team(2020)</label><mixed-citation>
R Core Team: R: A Language and Environment for Statistical Computing, R
Foundation for Statistical Computing, Vienna, Austria,
available at: <a href="https://www.R-project.org/" target="_blank"/> (last access: 1 July 2020), 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib29"><label>Schweizer et al.(2020)</label><mixed-citation>
Schweizer, J., Mitterer, C., Techel, F., Stoffel, A., and Reuter, B.: On the relation between avalanche occurrence and avalanche danger level, The Cryosphere, 14, 737–750, <a href="https://doi.org/10.5194/tc-14-737-2020" target="_blank">https://doi.org/10.5194/tc-14-737-2020</a>, 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib30"><label>SLF(2017)</label><mixed-citation>
SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <a href="http://www.slf.ch/lawineninfo/zusatzinfos/interpretationshilfe/interpretationshilfe_e.pdf" target="_blank"/> (last access: 20 October 2018),
edition December 2017, 53 pp., 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib31"><label>SLF(2019)</label><mixed-citation>
SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <a href="https://www.slf.ch/files/user_upload/SLF/Lawinenbulletin_Schneesituation/Wissen_zum_Lawinenbulletin/Interpretationshilfe/Interpretationshilfe_EN.pdf" target="_blank"/> (last access: 15 September 2020),
edition December 2019, 52 pp., 2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib32"><label>SLF(2020)</label><mixed-citation>
SLF: Avalanche bulletin interpretation guide, WSL Institute for Snow and
Avalanche Research SLF,
available at: <a href="http://www.slf.ch/lawineninfo/zusatzinfos/interpretationshilfe/interpretationshilfe_e.pdf" target="_blank"/> (last access: 1 November 2021),
edition December 2020, 53 pp., 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib33"><label>St. Clair et al.(2021)</label><mixed-citation>
St. Clair, A., Finn, H., and Hageli, P.: Where the rubber of the RISP model
meets the road: Contextualizing risk information seeking and processing with
an avalanche bulletin user typology, Int. J. Dis. Risk
Red., 66, 102626, <a href="https://doi.org/10.1016/j.ijdrr.2021.102626" target="_blank">https://doi.org/10.1016/j.ijdrr.2021.102626</a>, 2021.
</mixed-citation></ref-html>
<ref-html id="bib1.bib34"><label>Statham et al.(2018a)</label><mixed-citation>
Statham, G., Haegeli, P., Greene, E., Birkeland, K., Israelson, C., Tremper,
B., Stethem, C., McMahon, B., White, B., and Kelly, J.: A conceptual model of
avalanche hazard, Nat. Hazards, 90, 663–691,
<a href="https://doi.org/10.1007/s11069-017-3070-5" target="_blank">https://doi.org/10.1007/s11069-017-3070-5</a>, 2018a.
</mixed-citation></ref-html>
<ref-html id="bib1.bib35"><label>Statham et al.(2018b)</label><mixed-citation>
Statham, G., Holeczi, S., and Shandro, B.: Consistency and accuracy of public
avalanche forecasts in Western Canada, in: Proceedings ISSW 2018,
International Snow Science Workshop, 7–12 October 2018, Innsbruck, Austria,
1491–1496, 2018b.
</mixed-citation></ref-html>
<ref-html id="bib1.bib36"><label>Techel(2021)</label><mixed-citation>
Techel, F.: How is avalanche danger described in textual descriptions in avalanche forecasts in Switzerland?, EnviDat [data set], <a href="https://doi.org/10.16904/envidat.266" target="_blank">https://doi.org/10.16904/envidat.266</a>, 2021.
</mixed-citation></ref-html>
<ref-html id="bib1.bib37"><label>Techel and Schweizer(2017)</label><mixed-citation>
Techel, F. and Schweizer, J.: On using local avalanche danger level estimates
for regional forecast verification, Cold Reg. Sci. Technol., 144,
52–62, <a href="https://doi.org/10.1016/j.coldregions.2017.07.012" target="_blank">https://doi.org/10.1016/j.coldregions.2017.07.012</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib38"><label>Techel et al.(2018)</label><mixed-citation>
Techel, F., Mitterer, C., Ceaglio, E., Coléou, C., Morin, S., Rastelli, F., and Purves, R. S.: Spatial consistency and bias in avalanche forecasts – a case study in the European Alps, Nat. Hazards Earth Syst. Sci., 18, 2697–2716, <a href="https://doi.org/10.5194/nhess-18-2697-2018" target="_blank">https://doi.org/10.5194/nhess-18-2697-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib39"><label>Thumlert et al.(2020)</label><mixed-citation>
Thumlert, S., Statham, G., and Jamieson, B.: The likelihood scale in avalanche
forecasting, The Avalanche Review, 38, 31–33, 2020.
</mixed-citation></ref-html>
<ref-html id="bib1.bib40"><label>Williams(1980)</label><mixed-citation>
Williams, K.: Credibility of avalanche warnings, J. Glaciol., 26,
93–96, <a href="https://doi.org/10.1017/S0022143000010625" target="_blank">https://doi.org/10.1017/S0022143000010625</a>, 1980.
</mixed-citation></ref-html>
<ref-html id="bib1.bib41"><label>Winkler and Kuhn(2017)</label><mixed-citation>
Winkler, K. and Kuhn, T.: Fully automatic multi-language translation with a
catalogue of phrases – successful employment for the Swiss avalanche
bulletin, Lang. Resour. Eval., 51, 13–35,
<a href="https://doi.org/10.1007/s10579-015-9316-5" target="_blank">https://doi.org/10.1007/s10579-015-9316-5</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib42"><label>Winkler and Techel(2014)</label><mixed-citation>
Winkler, K. and Techel, F.: Users rating of the Swiss avalanche forecast, in:
Proceedings ISSW 2014, International Snow Science Workshop, 29 September–3
October 2014, Banff, Canada,  437–444, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib43"><label>Winkler et al.(2013)</label><mixed-citation>
Winkler, K., Bächtold, M., Gallorini, S., Niederer, U., Stucki, T.,
Pielmeier, C., Darms, G., Dürr, L., Techel, F., and Zweifel, B.: Swiss
avalanche bulletin: automated translation with a catalogue of phrases, in:
Proceedings ISSW 2013, International Snow Science Workshop, 7–11 October
2013, Grenoble – Chamonix Mont-Blanc, France, 437–441, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib44"><label>Winkler et al.(2021)</label><mixed-citation>
Winkler, K., Schmudlach, G., Degraeuwe, B., and Techel, F.: On the correlation
between the forecast avalanche danger and avalanche risk taken by backcountry
skiers in Switzerland, Cold Reg. Science Technol., 188, 103299,
<a href="https://doi.org/10.1016/j.coldregions.2021.103299" target="_blank">https://doi.org/10.1016/j.coldregions.2021.103299</a>, 2021.
</mixed-citation></ref-html>--></article>
