<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1405-3195</journal-id>
<journal-title><![CDATA[Agrociencia]]></journal-title>
<abbrev-journal-title><![CDATA[Agrociencia]]></abbrev-journal-title>
<issn>1405-3195</issn>
<publisher>
<publisher-name><![CDATA[Colegio de Postgraduados]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1405-31952011000300007</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Model evaluation of quality attributes for hops (Humulus lupulus L.)]]></article-title>
<article-title xml:lang="es"><![CDATA[Evaluación de modelos de los atributos de calidad para los lúpulos (Humulus lupulus L.)]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Pavlovic]]></surname>
<given-names><![CDATA[Martin]]></given-names>
</name>
<xref ref-type="aff" rid="A01"/>
<xref ref-type="aff" rid="A02"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Pavlovic]]></surname>
<given-names><![CDATA[Viljem]]></given-names>
</name>
<xref ref-type="aff" rid="A03"/>
</contrib>
</contrib-group>
<aff id="A01">
<institution><![CDATA[,International Hop Growers' Convention  ]]></institution>
<addr-line><![CDATA[Brumath ]]></addr-line>
<country>France</country>
</aff>
<aff id="A02">
<institution><![CDATA[,Slovenian Institute of Hop Research and Brewing  ]]></institution>
<addr-line><![CDATA[Zalec ]]></addr-line>
<country>Slovenia</country>
</aff>
<aff id="A03">
<institution><![CDATA[,University of Maribor Faculty of Agriculture and Life Sciences ]]></institution>
<addr-line><![CDATA[Hoce ]]></addr-line>
<country>Slovenia</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>05</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>05</month>
<year>2011</year>
</pub-date>
<volume>45</volume>
<numero>3</numero>
<fpage>339</fpage>
<lpage>351</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_arttext&amp;pid=S1405-31952011000300007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_abstract&amp;pid=S1405-31952011000300007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_pdf&amp;pid=S1405-31952011000300007&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Hops (Humulus lupulus L.) ate vital fot the brewing industry, as they contribute significantly to the organoleptic qualities of beet, including taste and flavor. Experimental hop breeding data from the Slovenian Institute of Hop Research and Brewing (IHPS) were used to create a model based on the multi-attribute decision modeling methodology. The model has 18 attributes hierarchically grouped within four main attributes: Biology, Chemistry, Morphology and Brewing value. Furthermore, utility functions in the model were defined by sets of elementary decision rules throughout the entire hierarchy for all aggregated attributes. The central part of the model contains 144 decision rules, which were specified according to the model users' previous breeding experiences. Four prospective hop hybrids and a reference hop variety with the target characteristics of plant resistance and brewing value were evaluated. Based on the breeding experiences and model results attributes' assessments were carried out. Decisions based on the model evaluation offered an additional tool for experts' final decisions in selecting appropriate materials for further breeding or the commercial use of hop plants.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[Los lúpulos (Humulus lupulus L.) son fundamentales para la industria cervecera, ya que contribuyen significativamente a las cualidades organolépticas de la cerveza, como el gusto y el sabor. Los datos de mejoramiento experimental de lúpulos del Instituto Esloveno de Investigación de Lúpulos y Elaboración de Cerveza (IHPS) se usaron para crear un modelo basado en la metodología de modelado de decisiones de atributos múltiples. El modelo cuenta con 18 atributos agrupados jerárquicamente dentro de cuatro atributos principales: Biología, Química, Morfología y el Valor de elaboración de la cerveza. Además, las funciones de utilidad en el modelo se definieron por conjuntos de reglas de decisión primaria en la jerarquía completa de todos los atributos agregados. La parte central del modelo contiene 144 reglas de decisión, especificadas de acuerdo a las experiencias previas de mejoramiento de los usuarios del modelo. Se evaluaron cuatro posibles híbridos de lúpulo y una variedad de lúpulo de referencia con las características previstas de resistencia de las plantas y el valor de elaboración. Basándose en las experiencias de mejoramiento y los resultados del modelo, se realizaron las evaluaciones de los atributos. Las decisiones basadas en la evaluación del modelo proporcionaron una herramienta adicional para las decisiones finales de los expertos en la selección de materiales apropiados para mejoramiento futuro o el uso comercial de plantas de lúpulo.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[hop industry]]></kwd>
<kwd lng="en"><![CDATA[breeding]]></kwd>
<kwd lng="en"><![CDATA[decision-making]]></kwd>
<kwd lng="en"><![CDATA[model]]></kwd>
<kwd lng="en"><![CDATA[IHPS]]></kwd>
<kwd lng="es"><![CDATA[industria del lúpulo]]></kwd>
<kwd lng="es"><![CDATA[mejoramiento]]></kwd>
<kwd lng="es"><![CDATA[toma de decisiones]]></kwd>
<kwd lng="es"><![CDATA[modelo]]></kwd>
<kwd lng="es"><![CDATA[IHPS]]></kwd>
</kwd-group>
</article-meta>
</front><body><![CDATA[  	    <p align="justify"><font face="verdana" size="4">Matem&aacute;ticas aplicadas, estad&iacute;stica y computaci&oacute;n</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="center"><font face="verdana" size="4"><b>Model evaluation of quality attributes for hops <i>(Humulus lupulus</i> L.)</b></font></p>  	    <p align="center"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="center"><font face="verdana" size="3"><b>Evaluaci&oacute;n de modelos de los atributos de calidad para los l&uacute;pulos <i>(Humulus lupulus</i> L.)</b></font></p>  	    <p align="center"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="center"><font face="verdana" size="2"><b>Martin Pavlovic<sup>1,2</sup>, Viljem Pavlovic<sup>3</sup></b></font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><sup><i>1</i></sup> <i>International Hop Growers' Convention IHGC&#45;Secretary General, 22, rue des Roses, F&#45;67173 Brumath, France.</i> (<a href="mailto:martin.pavlovic@guest.arnes.si">martin.pavlovic@guest.arnes.si</a>). <i>* Author for correspondence.</i></font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2"><sup><i>2</i></sup> <i>Slovenian Institute of Hop Research and Brewing, Zalskega tabora 2, 3310 Zalec, Slovenia.</i></font></p>  	    <p align="justify"><font face="verdana" size="2"><sup><i>3</i></sup> <i>University of Maribor, Faculty of Agriculture and Life Sciences, Pivola 10, 2311 Hoce, Slovenia.</i></font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2">Received: July, 2010.    <br> 	Approved: March, 2011.</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Abstract</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Hops <i>(Humulus lupulus</i> L.) ate vital fot the brewing industry, as they contribute significantly to the organoleptic qualities of beet, including taste and flavor. Experimental hop breeding data from the Slovenian Institute of Hop Research and Brewing (IHPS) were used to create a model based on the multi&#45;attribute decision modeling methodology. The model has 18 attributes hierarchically grouped within four main attributes: <i>Biology, Chemistry, Morphology</i> and <i>Brewing value.</i> Furthermore, utility functions in the model were defined by sets of elementary decision rules throughout the entire hierarchy for all aggregated attributes. The central part of the model contains 144 decision rules, which were specified according to the model users' previous breeding experiences. Four prospective hop hybrids and a reference hop variety with the target characteristics of plant resistance and brewing value were evaluated. Based on the breeding experiences and model results attributes' assessments were carried out. Decisions based on the model evaluation offered an additional tool for experts' final decisions in selecting appropriate materials for further breeding or the commercial use of hop plants.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Key words:</b> hop industry, breeding, decision&#45;making, model, IHPS.</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2"><b>Resumen</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Los l&uacute;pulos <i>(Humulus lupulus</i> L.) son fundamentales para la industria cervecera, ya que contribuyen significativamente a las cualidades organol&eacute;pticas de la cerveza, como el gusto y el sabor. Los datos de mejoramiento experimental de l&uacute;pulos del Instituto Esloveno de Investigaci&oacute;n de L&uacute;pulos y Elaboraci&oacute;n de Cerveza (IHPS) se usaron para crear un modelo basado en la metodolog&iacute;a de modelado de decisiones de atributos m&uacute;ltiples. El modelo cuenta con 18 atributos agrupados jer&aacute;rquicamente dentro de cuatro atributos principales: <i>Biolog&iacute;a, Qu&iacute;mica, Morfolog&iacute;a</i> y <i>el Valor de elaboraci&oacute;n de la cerveza.</i> Adem&aacute;s, las funciones de utilidad en el modelo se definieron por conjuntos de reglas de decisi&oacute;n primaria en la jerarqu&iacute;a completa de todos los atributos agregados. La parte central del modelo contiene 144 reglas de decisi&oacute;n, especificadas de acuerdo a las experiencias previas de mejoramiento de los usuarios del modelo. Se evaluaron cuatro posibles h&iacute;bridos de l&uacute;pulo y una variedad de l&uacute;pulo de referencia con las caracter&iacute;sticas previstas de resistencia de las plantas y el valor de elaboraci&oacute;n. Bas&aacute;ndose en las experiencias de mejoramiento y los resultados del modelo, se realizaron las evaluaciones de los atributos. Las decisiones basadas en la evaluaci&oacute;n del modelo proporcionaron una herramienta adicional para las decisiones finales de los expertos en la selecci&oacute;n de materiales apropiados para mejoramiento futuro o el uso comercial de plantas de l&uacute;pulo.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Palabras clave:</b> industria del l&uacute;pulo, mejoramiento, toma de decisiones, modelo, IHPS.</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Introduction</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Brewing industry requires raw materials of a high quality and hops <i>(Humulus lupulus</i> L.) are vital, as they contribute significantly to the organoleptic qualities of beer, including taste and flavor. To remain competitive in the global hop industry, hop breeders must respond to the ever&#45;changing needs of the brewing community by providing appropriate new varieties. The aim of hop breeding is to satisfy the needs throughout the whole chain of the hop industry. The target characteristics of new varieties include suitable brewing value (amount of alpha&#45;acids, good flavor), high&#45;quality crops and resistance to pests, as well as resistance to diseases. The main hop consumer is the brewing industry, which needs stable amounts of high&#45;quality hops of desired varieties and origin, with constant quality (Pavlovic <i>et al.,</i> 2008).</font></p>  	    <p align="justify"><font face="verdana" size="2">During the last few decades there has been sustained interest in the ability to identify or assess hop varieties or potential breeding materials with chemical analysis of the essential oils and resin components, the composition of which is genetically controlled (Lemmens, 1998). However, expert decisions for further selection of hybrids require the synthesis of information from different kinds of data&#45;subjective (assessments in the field) and objective (chemical analysis). To improve hop breeding results, various decision support methods are available for application. Javornik <i>et al.</i> (2005) report about molecular approaches, which can support breeders' decisions in early crossing combinations. Henning and Towsend (2005) use a similar approach, while De Keukleire (1999) suggest classical chemical analysis to choose the best new variety. Furthermore, the use of methods within the expert system in hop breeding has been discussed (Pavlovic <i>et al.,</i> 2007). Recently, multi&#45;criteria decision analysis (MCDA) has been recognized in hop hybrids assessment as a promising method. The MCDA approach is able to synthesize information about many different and often conflicting attributes into one unified assessment (Rozman <i>et al.,</i> 2006) that can be numerical or discrete (Pazek <i>et al.,</i> 2006). To date, MCDA has been widely used in agriculture, as described by Znidarsic <i>et al.</i> (2006), Scatasta <i>et al.</i> (2007) and Pazek and Rozman (2007).</font></p>  	    <p align="justify"><font face="verdana" size="2">The DEX method (Bohanec, 2008), which is employed in this study, uses qualitative variables and utility functions in the form of decision rules, and provides qualitative assessments of alternatives. Recently, DEX has been used in agronomy to assess the impact of cropping systems on soil quality (Bohanec <i>et al.,</i> 2007) and the economic and ecological impact of using genetically modified crops (Bohanec <i>et al.,</i> 2008).</font></p>  	    <p align="justify"><font face="verdana" size="2">This research belongs to an international project called Automation Agents in Decision Support Systems (Pavlovic <i>et al.,</i> 2008). In this paper, a multi&#45;attribute decision model based on DEX methodology for hop hybrids assessment applied to four promising hop hybrids (appropriate hybrids for further breeding) is presented also in a hop industry case study.</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2"><b>Material and Methods</b></font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Plant material</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Within the hop breeding research program carried out at the Slovenian Institute of Hop Research and Brewing (IHPS), various hop hybrids appeared to have good prospects for further breeding according to the research objectives in terms of brewing and agricultural value (Cerenak, 2006).</font></p>  	    <p align="justify"><font face="verdana" size="2">In this research, the data from the four most promising Slovenian hop hybrids, A1/54, A2/104, A3/112, and A4/122, were compared with the reference variety, which had the desired characteristics for plant resistance and brewing value. The assessment was carried out with a qualitative multi&#45;attribute model based on the DEX methodology.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>DEX methodology</b></font></p>  	    <p align="justify"><font face="verdana" size="2">The assessment was carried out with a qualitative multi&#45;attribute model based on the DEX methodology (Bohanec <i>et al.,</i> 2000). We first developed the model and then applied it to assess the aforementioned hop hybrids. DEX combines traditional multi&#45;attribute decision&#45;making with some elements of Expert Systems and Machine Learning. The distinguishing characteristic of DEX is its capability to deal with qualitative variables. Instead of numerical variables, which typically constitute traditional quantitative MCDA models, DEX uses qualitative variables whose values are usually represented by words rather than numbers, such as UNACCEPTABLE, APPROPRIATE, HIGH, PROSPECTIVE, etc. Furthermore, DEX uses "if&#45;then" decision rules to evaluate decision alternatives. The method is supported by the software program DEXi (Bohanec, 2008), which has been applied to various real&#45;life decision problems (Znidarsic and Bohanec, 2007). DEX models are developed through the following three steps:</font></p>  	    <blockquote> 		    <p align="justify"><font face="verdana" size="2">1) The problem is decomposed into less complex individual problems; the problems are hierarchically structured into a tree of attributes that represents the "skeleton" of the model. Terminal nodes of the tree, i.e., leaves or <i>basic attributes,</i> represent inputs to the model, and the root node represents the main output: an overall assessment of the evaluated alternatives (hop hybrids in our case). The internal nodes of the model are called <i>aggregate attributes.</i></font></p>  		    <p align="justify"><font face="verdana" size="2">2)&nbsp;Each sub&#45;problem is represented by a qualitative attribute with a defined value domain with a set of values. The value domain is discrete and typically consists of words. Usually, the domain is also ordered preferentially, so that consecutive words denote more and more desirable characteristics of the corresponding attributes.</font></p>  		    <p align="justify"><font face="verdana" size="2">3)&nbsp;To define the aggregation of values from the input to output attributes of the model, utility functions are defined for each aggregate attribute in the model. In the DEX method the utility functions are represented by decision rules, which are typically formulated by decision makers or domain experts.</font></p> 	</blockquote>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2"><b>Model for hop hybrids evaluation</b></font></p>  	    <p align="justify"><font face="verdana" size="2">The model for hop hybrids' evaluation takes into account four main factors: the <i>Biology, Chemistry, Morphology</i> and <i>Brewing value</i> of the hop hybrids. This is reflected in the hierarchical structure of the model, which consists of four corresponding sub&#45;trees of attributes (<a href="/img/revistas/agro/v45n3/a7f1.jpg" target="_blank">Figure 1</a>). Based on the breeding team's experience, sets of discrete values were defined for all 18 attributes in the model (<a href="/img/revistas/agro/v45n3/a7t1.jpg" target="_blank">Table 1</a>).</font></p>  	    <p align="justify"><font face="verdana" size="2"><b><i>Biology</i></b></font></p>  	    <p align="justify"><font face="verdana" size="2">The aggregate attribute <i>Biology</i> includes two basic attributes: (i) <i>plant resistance,</i> and (ii) <i>plant outlook. Plant resistance</i> is related to two main hop diseases, downy mildew on hops <i>(Pseudoperonospora humuli)</i> and powdery mildew on hops <i>(Sphaerotheca humuli),</i> and it was evaluated in a field collection of hop breeding material. Each plant was assessed based on the occurrence of infected tissue of the two main hop diseases from 0 to 2, where 0 indicates a resistant plant, 1 a moderately susceptible plant and 2 a susceptible plant (Seigner <i>et al.,</i> 2005, Radisek <i>et al.,</i> 2007). Since the reference variety was of low resistance against plant diseases, the mark BAD RESISTANT was given to samples with the same level of susceptibility within a tolerance of 15 %. Hybrids with a lower level of damaged plants were labeled RESISTANT, while those with a higher level of damaged plants were SUSCEPTIBLE.</font></p>  	    <p align="justify"><font face="verdana" size="2">The attribute <i>plant outlook</i> includes properties such as plant vigor, i.e., branching out, the technological ripeness, the length and the tightness of the hop cones. These properties were measured regularly according to a research plan methodology (Cerenak, 2006). The model enables three attribute values: BAD, SUITABLE and GOOD.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b><i>Chemistry</i></b></font></p>  	    <p align="justify"><font face="verdana" size="2">The aggregate attribute <i>Chemistry</i> consists of three attributes: (i) <i>essential oils,</i> (ii) <i>ageing</i> and (iii) <i>bitterness. Bitterness</i> is assessed through the relative content of <i>alpha&#45;acids, beta&#45;acids</i> in dry matter and the percentage of <i>cohumulone</i> in alpha&#45;acids. For each attribute a set of numeric values was defined again based on chemical analysis, in which the following methods were used: humidity content, LCV (lead conductance value in hops), percentage of xanthohumol (Analytica EBC, 1998) and the HSI (ASBC, 1992). The attribute <i>ageing,</i> which determines the loss of alpha acid content defined by the HSI, depends on temperature. Thus, measurements were taken when the hops were stored at 4 &deg;C and 20 &deg;C. Individual hybrid assessment results were compared with the results of the reference hop variety. According to the DEX methodology, quantitative measures were converted into qualitative values. Hybrids were assessed as; WORSE if the attribute values were lower than 80 % of those from the reference variety; GOOD if they ranged between 80 % and 95 %; REFERENCE if they ranged between 95 % and 105 %; BETTER if they were higher than 105 %.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b><i>Morphology</i></b></font></p>  	    <p align="justify"><font face="verdana" size="2">Attributes within the aggregate attribute <i>Morphology:</i> (i) <i>spindle share,</i> (ii) <i>spindle length,</i> (iii) <i>weight of cones,</i> (iv) <i>density of cones</i> and (v) <i>seeds,</i> illustrate the characteristics of hop cones (female blossoms) that represent the main plant product. These characteristics affect the hop production technology procedures and consequently hop yield quality and amount. Within the evaluation of these morphological characteristics, hop hybrids were evaluated after a harvest according to the approved research plan with the use of the domain system from 0 to 5 (Cerenak, 2006). In the model, marks 5 and 4 took a discrete value GOOD, mark 3 from the assessment was defined as ACCEPTABLE, while marks 2, 1 and 0 received the value BAD.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b><i>Brewing value</i></b></font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2">This attribute was determined with chemical analysis of wort and beer brewed with the selected hop hybrids and a reference variety. The results of the chemical analysis were the starting point for the assessment. After the hopping, all types of wort were analyzed with standard analysis protocols. In wort, the contents of the extract (%), alcohol (% v/v), P.I. value, color EBC, bitterness, alpha&#45;acids (%), iso&#45;alpha&#45;acids (mg L<sup>&#45;1</sup>), polyphenols (mg L<sup>&#45;1</sup>) and anthocyanogens (mg L<sup>&#45;1</sup>) were measured (Analytica EBC, 1998; MEBAK, 2002).</font></p>  	    <p align="justify"><font face="verdana" size="2">In a small experimental microbrewery, samples of the hop hybrids were used for brewing. The <i>Brewing value</i> of the beer samples brewed from those hop hybrids was based on a panel sensory assessment by 22 beer experts. Standard parameters such as the beer's taste, hop aroma quality, hop aroma intensity, bitterness quality and bitterness intensity of the beer samples brewed with the selected hop hybrids and the reference variety were examined according to DLG tests (MEBAK, 2002). The experimental beer tasting took place at the Research Institute of Brewing and Malting PLC, Prague, Czech Republic. The average mark from the sensory assessment panel was included in the model. The quality domain embraced three levels: BAD, GOOD and EXCELLENT. High priority was given to this attribute since it was determined to be an eliminating one. Namely, if the sensory assessments did not meet the brewing experts' minimal expectations, the hybrid was considered inappropriate for further hop breeding.</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Utility functions</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Utility functions are components of multi&#45;attribute models that define the aggregation aspect of option evaluation. For each aggregate attribute <i>y,</i> whose descendants in the tree of attributes are <i>x<sub>1</sub></i> , <i>x<sub>2</sub></i> , ..., <i>x<sub>n</sub></i> , the corresponding utility function <i>f</i> defines the mapping:</font></p>  	    <p align="justify"><font face="verdana" size="2">&fnof;: X<sub>1</sub> x X<sub>2</sub> x... x <i>X<sub>n</sub></i> &rarr; <i>Y</i></font></p>  	    <p align="justify"><font face="verdana" size="2">where X<sub>1</sub>,..., <i>X<sub>n</sub></i> and <i>Y</i> denote value domains of the attributes x<sub>1</sub>, ..., <i>x<sub>n</sub></i> and <i>y</i>.</font></p>  	    <p align="justify"><font face="verdana" size="2">In DEX (Bohanec, 2008), the value domains are discrete; therefore, the function <i>f</i> maps all the <i>combinations of values</i> X = X<sub>1</sub> x X<sub>2</sub> x ... x <i>X<sub>n</sub></i> into the values of Y The mapping is represented in a table, where each row gives the value of <i>y</i> for one combination of values x &pound; X. Rows are also called <i>decision rules,</i> because each row can be interpreted as an "if&#45;then" rule of the form:</font></p>  	    <blockquote> 	      <p align="justify"><font face="verdana" size="2">if x<sub>1</sub>=v<sub>1</sub> and x<sub>2</sub>=v<sub>2</sub> and ... and <i>x<sub>n</sub>=v<sub>n</sub></i> then y=v</font></p> </blockquote>     <p align="justify"><font face="verdana" size="2">where v<sub>1</sub> &isin; X<sub>1</sub>, ..., <i>v<sub>n</sub></i>&isin; and <i>v</i> &isin; Y.</font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2">The rules define the mapping of four attributes <i>Biology, Chemistry, Morphology</i> and <i>Brewing value</i> into the overall <i>Hop hybrid assessment</i> for one combination of values of the four attributes. Each decision rule defines the value of the <i>Hop hybrid assessment</i> for one combination of values of the former four attributes. Since <i>Biology</i> and <i>Chemistry</i> can take four different values, and <i>Morphology</i> and <i>Brewing value</i> can take three values (<a href="/img/revistas/agro/v45n3/a7t1.jpg" target="_blank">Table 1</a>), there are 4x4x3x3=144 possible combinations; hence, there are 144 decision rules.</font></p>  	    <p align="justify"><font face="verdana" size="2"><a href="/img/revistas/agro/v45n3/a7t2.jpg" target="_blank">Table 2</a> shows the weights that were defined by the breeding and brewing experts for each corresponding attribute. The two main aggregate attributes, <i>Chemistry</i> and <i>Brewing value,</i> have the most important role in the hybrids assessment. <i>Chemistry</i> determines the type of hop variety (aroma, alpha or super&#45;alpha type), while <i>Brewing value</i> includes an elimination characteristic; consequently, they were assigned relatively high weights, 35 % and 40 %.</font></p>  	    <p align="justify"><font face="verdana" size="2">Let us illustrate this method using the utility function that maps <i>plant resistance (x<sub>1</sub>)</i> and <i>plant outlook (x<sub>2</sub>)</i> to <i>Biology (y).</i> In this case, the whole table (<a href="/img/revistas/agro/v45n3/a7f2.jpg" target="_blank">Figure 2</a>, bottom right) contains nine rules. Only three of these (rules 1, 8 and 9) were explicitly defined by the expert (this is indicated by the bold values in the <i>Biology</i> column). These three rules constitute the initial set S. In addition to these three rules, the user also indicated (<a href="/img/revistas/agro/v45n3/a7f2.jpg" target="_blank">Figure 2</a>, bottom left) that the weights of the attributes <i>plant resistance</i> and <i>plant outlook</i> should be <i>w<sub>1</sub></i> = 86 % and <i>w<sub>2</sub></i> = 14 %.</font></p>  	    <p align="justify"><font face="verdana" size="2">The decision rules for the final hop hybrid assessment were defined according to the model users' previous breeding experiences. The rules were determined taking into account the minimum and maximum values of the four constituting attributes. For instance, the hop hybrid with the lowest defined values in all attributes was assigned the worst assessment result. On the other hand, the hop hybrid with the highest relative assessment result signified the hybrid with the highest optimal set of values, i.e., the best prospective hybrid for further breeding.</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Results and Discussion</b></font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Evaluation of the hybrids</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Among all the hop plants analyzed and eliminated stepwise through a selection procedure in hop breeding (Cerenak, 2006), the four hop hybrids A1/54, A2/104, A3/112 and A4/122 and the reference variety were involved in a comparative model assessment. The hop hybrids had been selected among sets of seedlings analyzed and assessed as significantly promising new hop varieties. Numerical data of analyses and measurements of hop cones as well as beer sensory estimation were used to describe hybrids' production and brewing quality parameters. They were analyzed, and the results were additionally discussed. The model enabled a final assessment of the hybrids based on the defined attributes and the decision rules within the defined utility functions.</font></p>  	    <p align="justify"><font face="verdana" size="2">All hop hybrids were described with fitting values, which were defined for each of the basic attributes. Furthermore, a list in which the hybrids were ranked in order of performance was created. This enabled a relative scoring system, in which hop hybrids or varieties could be compared against one another based on their performance. The level of importance was shown for each criterion within the assessment and pointed out differences among the hybrids analyzed. In addition, the model's results offered information for the next steps in the breeding process.</font></p>  	    <p align="justify"><font face="verdana" size="2">Based on the breeding experiences and the model results, assessments of overall as well as individual attributes were carried out. A3/112 and A4/122 reached the overall level of the reference variety and were thus assessed as appropriate for further breeding or commercial use. In contrast, A1/54 and A2/104 did not meet expectations in their attributes in relation to the reference variety. A2/104 was overall assessed as WORSE, while A1/54 was assessed as NON&#45;PROSPECTIVE. Therefore, they were considered hybrids with less breeding potential in terms of agricultural and brewing values. All evaluation results for the model attributes are shown in detail in <a href="/img/revistas/agro/v45n3/a7t3.jpg" target="_blank">Table 3</a> and additionally discussed.</font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2"><b><i>A3/112 and A4/122</i></b></font></p>  	    <p align="justify"><font face="verdana" size="2">The model results showed that A3/112 was assessed as the hybrid with the highest breeding potential. In <i>Biology,</i> this hybrid was assessed as EXCELLENT, in <i>Chemistry</i> as REFERENCE, in <i>Morphology</i> as ACCEPTABLE and in <i>Brewing value</i> as GOOD. In relation to the reference variety, this hybrid had a comparative advantage in <i>Biology</i> but also a comparative disadvantage in <i>Brewing value.</i> A comparison of the alpha&#45;acids value, for example, for A4/112 and the reference variety marked them as equal. Furthermore, A3/112 was relatively superior in <i>ageing</i> (HSI),<i>plant resistance</i> and lower <i>cohumulone</i> attributes, which have the most important economic effects in terms of the hop price. By all quality parameters analyzed in the attribute <i>Brewing value,</i> A3/112 was equivalent to the reference variety. In hop aroma intensity and quality, A3/112 was assessed as inferior, but otherwise in bitterness intensity as equal to the reference variety (<a href="/img/revistas/agro/v45n3/a7t3.jpg" target="_blank">Table 3</a>, <a href="/img/revistas/agro/v45n3/a7f3.jpg" target="_blank">Figure 3</a>).</font></p>  	    <p align="justify"><font face="verdana" size="2">A4/122 was well balanced in its properties. In no attribute did this hybrid receive either outstanding (+) or disappointing (&#151;) marks. Furthermore, compared with A3/112, A4/122 was equally ranked in the attributes <i>Chemistry, Morphology</i> and <i>Brewing value.</i> However, A3/112 was better ranked in the attribute <i>Biology.</i> The hybrid A4/122 and the reference variety were in the broad spectrum equally ranked, but in some of the attributes both were behind the characteristics of A3/112 (<a href="/img/revistas/agro/v45n3/a7t3.jpg" target="_blank">Table 3</a>).</font></p>  	    <p align="justify"><font face="verdana" size="2"><b><i>A2/104 and A1/54</i></b></font></p>  	    <p align="justify"><font face="verdana" size="2">In terms of model results, A2/104 took third place among the four hybrids analyzed. This hybrid was assessed as equal to the reference variety in <i>Chemistry</i> and <i>Morphology.</i> A2/104 had higher alpha&#45;acid content than the reference variety; however, <i>Brewing value</i> was assessed with the model's lowest mark, BAD (<a href="/img/revistas/agro/v45n3/a7t3.jpg" target="_blank">Table 3</a>). Furthermore, this hybrid had relatively the highest (non&#45;desirable) content of polyphenols as well as the lowest sensory assessment value in hop aroma intensity and bitterness intensity.</font></p>  	    <p align="justify"><font face="verdana" size="2">Hybrid A1/54 was assessed as GOOD in terms of the attribute <i>Chemistry;</i> however, even in that attribute, it ranked behind the other three hybrids analyzed. A1/54 was also ranked the lowest with BAD in <i>Brewing value,</i> the most important attribute. This hybrid required the highest quantity of hops needed within the brewing process. The sensory beer taste results ranked A1/54 at the bottom. Among all the hybrids, A1/54 scored the lowest marks in hop aroma and bitterness quality, which also resulted in the lowest mark BAD obtained for the <i>Brewing value.</i> That placed this hybrid in fourth place among the hybrids analyzed (<a href="/img/revistas/agro/v45n3/a7t3.jpg" target="_blank">Table 3</a>).</font></p>  	    <p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Conclusions</b></font></p>  	    <p align="justify"><font face="verdana" size="2">Despite minor deficiencies such as the use of qualitative data only, we found that this approach fulfilled most of the breeders' expectations and revealed considerable advantages in comparison with other approaches. The multi&#45;attribute model can therefore be regarded as a useful supplementary tool for hop hybrids assessment.</font></p>  	    <p align="justify"><font face="verdana" size="2">This method cannot entirely replace experts in breeding and brewing but can serve as an additional instrument in decision&#45;making, since the decisions based on model testing offered much faster results that validated the application of the model for further research. In the future, data about new upcoming hybrids will be added and assessed in comparison with experts' decisions. Furthermore, we also expect to upgrade the model by adding new attributes in response to new goals in hop breeding programs.</font></p>  	    ]]></body>
<body><![CDATA[<p align="justify"><font face="verdana" size="2">&nbsp;</font></p>  	    <p align="justify"><font face="verdana" size="2"><b>Literature Cited</b></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">ASBC, 1992. American Society of Brewing Chemists. Methods of Analysis. 8<sup>th</sup> ed. H &#151; 6,12. The Society, St. Paul, MN.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556118&pid=S1405-3195201100030000700001&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Analytica EBC, 1998. European Brewery Convention. Grundwerk: Section 7. EBC Analysis Committee, Hans Carl Getraenke Fachverlag, Nuernberg, Germany. 33 p.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556120&pid=S1405-3195201100030000700002&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Bohanec, M., and B. Zupan. 2004. A function&#45;decomposition method for development of hierarchical multi&#45;attribute decision models. Decis. Support Syst. 36: 215&#45;233.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556122&pid=S1405-3195201100030000700003&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Bohanec, M., J. Cortet, B. Griffiths, M. Znidarsic, M. Debeljak, S. Caul, J. Thompson, and P.H. Krogh. 2007. A qualitative multi&#45;attribute model for assessing the impact of cropping systems on soil quality. Pedobiologia 51(3): 207&#151;218.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556124&pid=S1405-3195201100030000700004&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    ]]></body>
<body><![CDATA[<!-- ref --><p align="justify"><font face="verdana" size="2">Bohanec, M. 2008. DEXi: Program for multi&#45;attribute decision making, User's manual, Version 3.00. IJS Report DP&#45;9989, Jozef Stefan Institute, Ljubljana. <a href="http://kt.ijs.si/MarkoBohanec/pub/DEXiManual30r.pdf" target="_blank">http://kt.ijs.si/MarkoBohanec/pub/DEXiManual30r.pdf</a> (Accessed: July 2008).    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556126&pid=S1405-3195201100030000700005&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Bohanec, M., A. Messean, S. Scatasta, F. Angevin, B. Griffiths, P.H. Krogh, M. Znidarsic, and S. Dzeroski. 2008. A qualitative multi&#45;attribute model for economic and ecological assessment of genetically modified crops. Ecol. Model. 215: 247&#45;261.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556128&pid=S1405-3195201100030000700006&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Cerenak, A. 2006. Hop breeding. Final project report. Slovenian institute of hop research and brewing. Contract Nr. 231105&#45;000090. 59 p.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556130&pid=S1405-3195201100030000700007&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">De Keukleire, D. 1999. Fundamentals of beer and hop chemistry. Quimica Nova 23(1): 108&#45;112.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556132&pid=S1405-3195201100030000700008&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Javornik, B., J. Jakse, N. Stajner, P. Kozjak, and A. Cerenak. 2005. Molecular genetic hop (Humulus Lupulus L.) research in Slovenia. Acta Hort. (ISHS) 668: 31&#45;34.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556134&pid=S1405-3195201100030000700009&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    ]]></body>
<body><![CDATA[<!-- ref --><p align="justify"><font face="verdana" size="2">Lemmens, G. W. C. 1998. The breeding and parentage of hop varieties. Brew. Dig. 73(5): 16&#45;26.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556136&pid=S1405-3195201100030000700010&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">MEBAK. 2002. Brautechnische Analysenmethoden, Band II. Methodensammlung der Mitteleuropaischen Brautechnischen Analysenkommission Weihenstephan. 332 p.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556138&pid=S1405-3195201100030000700011&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Pavlovic, M., F. N. Koumboulis, M. P. Tzamtzi, and C. Rozman. 2008. Role of automation agents in agribusiness decision support systems. Agrociencia 42(8): 913&#45;923.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556140&pid=S1405-3195201100030000700012&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Pavlovic, V., A. Cerenak, M. Pavlovic, and C. Rozman. 2007. Use of numerical methods in hop breeding &#151; concept of an expert system. Hmeljarski bilten 14: 11&#45;17.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556142&pid=S1405-3195201100030000700013&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Pazek, K., C. Rozman, A. Borec, J. Turk, D. Majkovic, M. Bavec, and F. Bavec. 2006. The Use of multi criteria models for decision support on organic farms. Biol. Agric. Hort. 24 (1): 73&#45;89.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556144&pid=S1405-3195201100030000700014&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    ]]></body>
<body><![CDATA[<!-- ref --><p align="justify"><font face="verdana" size="2">Pazek, K., and C. Rozman. 2007. The Decision support system for supplementary activities on organic farms. Agricultura 5(1): 15&#45;20.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556146&pid=S1405-3195201100030000700015&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Radisek, S., A. Cerenak, and B. Javornik. 2007. Hop disease resistance breeding: Procedures and techniques in selection of seedlings. Hmeljarski bilten 14: 5&#45;10.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556148&pid=S1405-3195201100030000700016&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Rozman, C., and K. Pazek. 2005. Application of computer supported multi&#45;criteria decision models in agriculture. Agric. Conspec. Sci. 70(4): 127&#45;134.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556150&pid=S1405-3195201100030000700017&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Rozman, C., K. Pazek, M. Bavec, F. Bavec, J. Turk, and D. Majkovic. 2006. The Multi&#45;criteria analysis of spelt food processing alternatives on small organic farms. J. Sustainable Agric. 28(2): 159&#45;179.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556152&pid=S1405-3195201100030000700018&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Scatasta, S., J. Wesseler, M. Demont, M. Bohanec, S. Dzeroski, and M. Znidarsic. 2007. Multi&#45;Attribute modeling of economic and ecological impacts of agricultural innovations on cropping systems. J. Systemics, Cybernetics and Informatics 4(2): 52&#45;59.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556154&pid=S1405-3195201100030000700019&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    ]]></body>
<body><![CDATA[<!-- ref --><p align="justify"><font face="verdana" size="2">Seigner, E., A. Lutz, H. Radic&#45;Miehle, S. Seefelder, and F. G. Felsenstein. 2005. Breeding for powdery mildew resistance in hop <i>(Humulus lupulus</i> L.). Strategies at the Hop Research Center, Huell, Germany. Acta Hort. (ISHS) 668: 19&#45;31.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556156&pid=S1405-3195201100030000700020&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Znidarsic, M., M. Bohanec, and B. Zupan. 2006. proDEX &#45; a DSS tool for environmental decision&#45;making. Environ. Model. Softw. 21(10): 1514&#45;1516.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556158&pid=S1405-3195201100030000700021&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>  	    <!-- ref --><p align="justify"><font face="verdana" size="2">Znidarsic, M., and M. Bohanec. 2007. Automatic revision of qualitative multi&#45;attribute decision models. Fund. Computing Decis. Sci. 32(4): 315&#45;326.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=556160&pid=S1405-3195201100030000700022&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></font></p>      ]]></body><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="book">
<collab>ASBC</collab>
<source><![CDATA[American Society of Brewing Chemists. Methods of Analysis]]></source>
<year>1992</year>
<edition>8th</edition>
<page-range>6,12</page-range><publisher-loc><![CDATA[St. Paul^eMN MN]]></publisher-loc>
<publisher-name><![CDATA[The Society]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="book">
<collab>Analytica EBC</collab>
<source><![CDATA[European Brewery Convention. Grundwerk: Section 7]]></source>
<year>1998</year>
<publisher-loc><![CDATA[Nuernberg ]]></publisher-loc>
<publisher-name><![CDATA[EBC Analysis CommitteeHans Carl Getraenke Fachverlag]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Zupan]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[A function-decomposition method for development of hierarchical multi-attribute decision models]]></article-title>
<source><![CDATA[Decis. Support Syst.]]></source>
<year>2004</year>
<volume>36</volume>
<page-range>215-233</page-range></nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Cortet]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Griffiths]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Znidarsic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Debeljak]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Caul]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Thompson]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Krogh]]></surname>
<given-names><![CDATA[P.H.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[A qualitative multi-attribute model for assessing the impact of cropping systems on soil quality]]></article-title>
<source><![CDATA[Pedobiologia]]></source>
<year>2007</year>
<volume>51</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>207-218</page-range></nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<source><![CDATA[DEXi: Program for multi-attribute decision making, User's manual, Version 3.00]]></source>
<year>2008</year>
<publisher-loc><![CDATA[Ljubljana ]]></publisher-loc>
<publisher-name><![CDATA[Jozef Stefan Institute]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Messean]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Scatasta]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Angevin]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Griffiths]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Krogh]]></surname>
<given-names><![CDATA[P.H.]]></given-names>
</name>
<name>
<surname><![CDATA[Znidarsic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Dzeroski]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[A qualitative multi-attribute model for economic and ecological assessment of genetically modified crops]]></article-title>
<source><![CDATA[Ecol. Model.]]></source>
<year>2008</year>
<volume>215</volume>
<page-range>247-261</page-range></nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Cerenak]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Hop breeding. Final project report. Slovenian institute of hop research and brewing]]></source>
<year>2006</year>
<page-range>59</page-range></nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[De Keukleire]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Fundamentals of beer and hop chemistry]]></article-title>
<source><![CDATA[Quimica Nova]]></source>
<year>1999</year>
<volume>23</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>108-112</page-range></nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Javornik]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Jakse]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Stajner]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Kozjak]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[Cerenak]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Molecular genetic hop (Humulus Lupulus L.) research in Slovenia]]></article-title>
<source><![CDATA[Acta Hort.]]></source>
<year>2005</year>
<volume>668</volume>
<page-range>31-34</page-range><publisher-name><![CDATA[ISHS]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lemmens]]></surname>
<given-names><![CDATA[G. W. C.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The breeding and parentage of hop varieties]]></article-title>
<source><![CDATA[Brew. Dig.]]></source>
<year>1998</year>
<volume>73</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>16-26</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="book">
<collab>MEBAK</collab>
<source><![CDATA[Brautechnische Analysenmethoden]]></source>
<year>2002</year>
<volume>II</volume>
<page-range>332</page-range><publisher-loc><![CDATA[Weihenstephan ]]></publisher-loc>
<publisher-name><![CDATA[Methodensammlung der Mitteleuropaischen Brautechnischen Analysenkommission]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pavlovic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Koumboulis]]></surname>
<given-names><![CDATA[F. N.]]></given-names>
</name>
<name>
<surname><![CDATA[Tzamtzi]]></surname>
<given-names><![CDATA[M. P.]]></given-names>
</name>
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Role of automation agents in agribusiness decision support systems]]></article-title>
<source><![CDATA[Agrociencia]]></source>
<year>2008</year>
<volume>42</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>913-923</page-range></nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pavlovic]]></surname>
<given-names><![CDATA[V.]]></given-names>
</name>
<name>
<surname><![CDATA[Cerenak]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Pavlovic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Use of numerical methods in hop breeding - concept of an expert system]]></article-title>
<source><![CDATA[Hmeljarski bilten]]></source>
<year>2007</year>
<volume>14</volume>
<page-range>11-17</page-range></nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pazek]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Borec]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Turk]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Majkovic]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Bavec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bavec]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The Use of multi criteria models for decision support on organic farms]]></article-title>
<source><![CDATA[Biol. Agric. Hort.]]></source>
<year>2006</year>
<volume>24</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>73-89</page-range></nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pazek]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The Decision support system for supplementary activities on organic farms]]></article-title>
<source><![CDATA[Agricultura]]></source>
<year>2007</year>
<volume>5</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>15-20</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Radisek]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Cerenak]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Javornik]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Hop disease resistance breeding: Procedures and techniques in selection of seedlings]]></article-title>
<source><![CDATA[Hmeljarski bilten]]></source>
<year>2007</year>
<volume>14</volume>
<page-range>5-10</page-range></nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Pazek]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Application of computer supported multi-criteria decision models in agriculture]]></article-title>
<source><![CDATA[Agric. Conspec. Sci.]]></source>
<year>2005</year>
<volume>70</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>127-134</page-range></nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rozman]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Pazek]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Bavec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bavec]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Turk]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Majkovic]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The Multi-criteria analysis of spelt food processing alternatives on small organic farms]]></article-title>
<source><![CDATA[J. Sustainable Agric.]]></source>
<year>2006</year>
<volume>28</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>159-179</page-range></nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Scatasta]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Wesseler]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Demont]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Dzeroski]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Znidarsic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Multi-Attribute modeling of economic and ecological impacts of agricultural innovations on cropping systems]]></article-title>
<source><![CDATA[J. Systemics, Cybernetics and Informatics]]></source>
<year>2007</year>
<volume>4</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>52-59</page-range></nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Seigner]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[Lutz]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Radic-Miehle]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Seefelder]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Felsenstein]]></surname>
<given-names><![CDATA[F. G.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Breeding for powdery mildew resistance in hop (Humulus lupulus L.). Strategies at the Hop Research Center, Huell, Germany]]></article-title>
<source><![CDATA[Acta Hort.]]></source>
<year>2005</year>
<volume>668</volume>
<page-range>19-31</page-range><publisher-name><![CDATA[ISHS]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Znidarsic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Zupan]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[proDEX - a DSS tool for environmental decision-making]]></article-title>
<source><![CDATA[Environ. Model. Softw.]]></source>
<year>2006</year>
<volume>21</volume>
<numero>10</numero>
<issue>10</issue>
<page-range>1514-1516</page-range></nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Znidarsic]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bohanec]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Automatic revision of qualitative multi-attribute decision models]]></article-title>
<source><![CDATA[Fund. Computing Decis. Sci.]]></source>
<year>2007</year>
<volume>32</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>315-326</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
