<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1405-5546</journal-id>
<journal-title><![CDATA[Computación y Sistemas]]></journal-title>
<abbrev-journal-title><![CDATA[Comp. y Sist.]]></abbrev-journal-title>
<issn>1405-5546</issn>
<publisher>
<publisher-name><![CDATA[Instituto Politécnico Nacional, Centro de Investigación en Computación]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1405-55462024000401741</article-id>
<article-id pub-id-type="doi">10.13053/cys-28-4-4720</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Discovering Diagnostic Features Used by a CNN in Plant Species Identification]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Figueroa-Mata]]></surname>
<given-names><![CDATA[Geovanni]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Mata-Montero]]></surname>
<given-names><![CDATA[Erick]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Acosta-Vargas]]></surname>
<given-names><![CDATA[Luis]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Costa Rica Institute of Technology School of Mathematics ]]></institution>
<addr-line><![CDATA[Cartago ]]></addr-line>
<country>Costa Rica</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Costa Rica Institute of Technology School of Computing ]]></institution>
<addr-line><![CDATA[Cartago ]]></addr-line>
<country>Costa Rica</country>
</aff>
<aff id="Af3">
<institution><![CDATA[,Costa Rica Institute of Technology School of Forestry Engineering ]]></institution>
<addr-line><![CDATA[Cartago ]]></addr-line>
<country>Costa Rica</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>12</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>12</month>
<year>2024</year>
</pub-date>
<volume>28</volume>
<numero>4</numero>
<fpage>1741</fpage>
<lpage>1755</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_arttext&amp;pid=S1405-55462024000401741&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_abstract&amp;pid=S1405-55462024000401741&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_pdf&amp;pid=S1405-55462024000401741&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract: An approach to improve the explainability (interpretability) of convolutional neural networks that identify plant species from leaf images is proposed. Specifically, a methodology is established to discover the most determining diagnostic features used by a convolutional neural network (CNN) in the identification of 63 native plant species from Costa Rica. The result is a CNN that not only identifies plant species but also provides an explanation through a heat map and a translation of that map into a table of diagnostic features used in classical taxonomy, each with a weight that describes the relative importance of each trait (e.g., apex, primary vein, and leaf base). To achieve this, a CNN was trained using leaf images from 63 vascular plant species from Costa Rica. Once the network was trained, the Layer-wise Relevance Propagation (LRP) technique was applied to a subset  I of 50 leaves images distributed uniformly across a set of 10 species to visualize the representations (heat maps) learned by the internal layers of the CNN. Then, a taxonomist was asked to perform an equivalent task manually, annotating the same 50 leaf images in  I by graphically highlighting the most significant features according to their expert judgment (feature map). Finally, algorithmic comparisons were made between the heat maps and feature maps to determine the similarity between the hottest areas used by the CNN and the features used in classical taxonomy.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Convolutional neural network]]></kwd>
<kwd lng="en"><![CDATA[heat map]]></kwd>
<kwd lng="en"><![CDATA[layer-wise relevance propagation]]></kwd>
<kwd lng="en"><![CDATA[deep learning]]></kwd>
<kwd lng="en"><![CDATA[interpretability]]></kwd>
<kwd lng="en"><![CDATA[automated plant species identification]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Aakif]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Khan]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Automatic classification of plants based on their leaves]]></article-title>
<source><![CDATA[Biosystems Engineering]]></source>
<year>2015</year>
<volume>139</volume>
<page-range>66-75</page-range></nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abdulazeez]]></surname>
<given-names><![CDATA[A. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Zeebaree]]></surname>
<given-names><![CDATA[D. Q.]]></given-names>
</name>
<name>
<surname><![CDATA[Zebari]]></surname>
<given-names><![CDATA[D. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Hameed]]></surname>
<given-names><![CDATA[T. H.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Leaf identification based on shape, color, texture and vines using probabilistic neural network]]></article-title>
<source><![CDATA[Computación y Sistemas]]></source>
<year>2021</year>
<volume>25</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>1-15</page-range></nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bach]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Binder]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Montavon]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Klauschen]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Müller]]></surname>
<given-names><![CDATA[K. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Samek]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation]]></article-title>
<source><![CDATA[PLOS ONE]]></source>
<year>2015</year>
<volume>10</volume>
<numero>7</numero>
<issue>7</issue>
<page-range>1-46</page-range></nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Biran]]></surname>
<given-names><![CDATA[O.]]></given-names>
</name>
<name>
<surname><![CDATA[Cotton]]></surname>
<given-names><![CDATA[C. V.]]></given-names>
</name>
</person-group>
<source><![CDATA[Explanation and justification in machine learning: A survey]]></source>
<year>2017</year>
<conf-name><![CDATA[ International Joint Conference on Artificial Intelligence and Workshop on Explainable AI]]></conf-name>
<conf-loc> </conf-loc>
<page-range>8-13</page-range></nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Brooks]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[COCO annotator]]></source>
<year>2019</year>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Doshi-Velez]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Kim]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
</person-group>
<source><![CDATA[Towards a rigorous science of interpretable machine learning]]></source>
<year>2017</year>
</nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Figueroa-Mata]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Mata-Montero]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[Valverde-Otárola]]></surname>
<given-names><![CDATA[J. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Arias-Aguilar]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Zamora-Villalobos]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Using deep learning to identify Costa Rican native tree species from wood cut images]]></article-title>
<source><![CDATA[Frontiers in Plant Science]]></source>
<year>2022</year>
<volume>13</volume>
</nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Goëau]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Bonnet]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[Joly]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Plant identification based on noisy web data: The amazing performance of deep learning]]></source>
<year>2017</year>
<conf-name><![CDATA[ Conference and Labs of the Evaluation Forum]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1-13</page-range></nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="">
<collab>Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services</collab>
<source><![CDATA[Un report: Nature&#8217;s dangerous decline &#8217;unprecedented&#8217;; species extinction rates &#8217;acelerating&#8217;]]></source>
<year>2019</year>
</nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kumar]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Belhumeur]]></surname>
<given-names><![CDATA[P. N.]]></given-names>
</name>
<name>
<surname><![CDATA[Biswas]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Jacobs]]></surname>
<given-names><![CDATA[D. W.]]></given-names>
</name>
<name>
<surname><![CDATA[Kress]]></surname>
<given-names><![CDATA[W. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Lopez]]></surname>
<given-names><![CDATA[I. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Soares]]></surname>
<given-names><![CDATA[J. V. B.]]></given-names>
</name>
</person-group>
<source><![CDATA[Leafsnap: A computer vision system for automatic plant species identification]]></source>
<year>2012</year>
<conf-name><![CDATA[ Computer Vision &#8211; ECCV]]></conf-name>
<conf-date>2012</conf-date>
<conf-loc> </conf-loc>
<page-range>502-16</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lasseck]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Image-based plant species identification with deep convolutional neural networks]]></source>
<year>2017</year>
<conf-name><![CDATA[ Conference and Labs of the Evaluation Forum]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1-12</page-range></nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lee]]></surname>
<given-names><![CDATA[S. H.]]></given-names>
</name>
<name>
<surname><![CDATA[Chan]]></surname>
<given-names><![CDATA[C. S.]]></given-names>
</name>
<name>
<surname><![CDATA[Mayo]]></surname>
<given-names><![CDATA[S. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Remagnino]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[How deep learning extracts and learns leaf features for plant classification]]></article-title>
<source><![CDATA[Pattern Recognition]]></source>
<year>2017</year>
<volume>71</volume>
<page-range>1-13</page-range></nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mata-Montero]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[Carranza-Rojas]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[A texture and curvature bimodal leaf recognition model for identification of Costa Rican plant species]]></source>
<year>2015</year>
<conf-name><![CDATA[ Latin American Computing Conference]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1-12</page-range></nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Miller]]></surname>
<given-names><![CDATA[T.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Explanation in artificial intelligence: Insights from the social sciences]]></article-title>
<source><![CDATA[Artificial Intelligence]]></source>
<year>2019</year>
<volume>267</volume>
<page-range>1-38</page-range></nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Montavon]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Binder]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Lapuschkin]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Samek]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
<name>
<surname><![CDATA[Müller]]></surname>
<given-names><![CDATA[K. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Layer-wise relevance propagation: An overview]]></article-title>
<source><![CDATA[Explainable AI: Interpreting, explaining and visualizing deep learning]]></source>
<year>2019</year>
<volume>11700</volume>
<page-range>193-209</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ras]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Xie]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Van-Gerven]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Doran]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Explainable deep learning: A field guide for the uninitiated]]></article-title>
<source><![CDATA[Journal of Artificial Intelligence Research]]></source>
<year>2022</year>
<volume>73</volume>
<page-range>329-97</page-range></nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Samek]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
<name>
<surname><![CDATA[Montavon]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Lapuschkin]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Anders]]></surname>
<given-names><![CDATA[C. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Müller]]></surname>
<given-names><![CDATA[K. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Explaining deep neural networks and beyond: A review of methods and applications]]></article-title>
<source><![CDATA[Proceedings of the IEEE]]></source>
<year>2021</year>
<volume>109</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>247-78</page-range></nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Selvaraju]]></surname>
<given-names><![CDATA[R. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Cogswell]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Das]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Vedantam]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Parikh]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Batra]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<source><![CDATA[Grad-CAM: Visual explanations from deep networks via gradient-based localization]]></source>
<year>2017</year>
<conf-name><![CDATA[ International Conference on Computer Vision]]></conf-name>
<conf-loc> </conf-loc>
<page-range>618-26</page-range></nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Simonyan]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Vedaldi]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Zisserman]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Deep inside convolutional networks: Visualising image classification models and saliency maps]]></source>
<year>2014</year>
<conf-name><![CDATA[ Workshop at International Conference on Learning Representations]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1-8</page-range></nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wäldchen]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Rzanny]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Seeland]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Mäder]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Automated plant species identification&#8212;trends and future directions]]></article-title>
<source><![CDATA[PLOS Computational Biology]]></source>
<year>2018</year>
<volume>14</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1-19</page-range></nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wu]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Xiang]]></surname>
<given-names><![CDATA[Y.]]></given-names>
</name>
<name>
<surname><![CDATA[Liu]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Wen]]></surname>
<given-names><![CDATA[Z.]]></given-names>
</name>
</person-group>
<source><![CDATA[Automatic leaf recognition based on deep convolutional networks]]></source>
<year>2017</year>
<volume>10636</volume>
<conf-name><![CDATA[ Neural Information Processing]]></conf-name>
<conf-loc> </conf-loc>
<page-range>505-15</page-range></nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Zeiler]]></surname>
<given-names><![CDATA[M. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Fergus]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
</person-group>
<source><![CDATA[Visualizing and understanding convolutional networks]]></source>
<year>2014</year>
<volume>8689</volume>
<conf-name><![CDATA[ European Conference on Computer Vision]]></conf-name>
<conf-loc> </conf-loc>
<page-range>818-33</page-range></nlm-citation>
</ref>
<ref id="B23">
<nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Zhou]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[Khosla]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Lapedriza]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Oliva]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Torralba]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Learning deep features for discriminative localization]]></source>
<year>2016</year>
<conf-name><![CDATA[ Conference on Computer Vision and Pattern Recognition]]></conf-name>
<conf-loc> </conf-loc>
<page-range>2921-9</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
