<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1405-5546</journal-id>
<journal-title><![CDATA[Computación y Sistemas]]></journal-title>
<abbrev-journal-title><![CDATA[Comp. y Sist.]]></abbrev-journal-title>
<issn>1405-5546</issn>
<publisher>
<publisher-name><![CDATA[Instituto Politécnico Nacional, Centro de Investigación en Computación]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1405-55462021000400683</article-id>
<article-id pub-id-type="doi">10.13053/cys-25-4-4050</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Actions Selection during a Mobile Robot Navigation for the Autonomous Recharging Problem]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[López-Lozada]]></surname>
<given-names><![CDATA[Elizabeth]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Rubio Espino]]></surname>
<given-names><![CDATA[Elsa]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Sossa-Azuela]]></surname>
<given-names><![CDATA[Juan Humberto]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Ponce-Ponce]]></surname>
<given-names><![CDATA[Víctor Hugo]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Instituto Politécnico Nacional Centro de Investigación en Computación ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Mexico</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>12</month>
<year>2021</year>
</pub-date>
<volume>25</volume>
<numero>4</numero>
<fpage>683</fpage>
<lpage>693</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_arttext&amp;pid=S1405-55462021000400683&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_abstract&amp;pid=S1405-55462021000400683&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.mx/scielo.php?script=sci_pdf&amp;pid=S1405-55462021000400683&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract: The use of mobile robots has increased for its application in various areas such as supply chains, factories, cleaning, disinfection, medical assistance, search, and exploration. It is a fact that most of these robots, if not all, use batteries to power themselves. During a mobile robot task execution, the battery's electric charge tends to deplete as a function of the energy load demands, which would cause the robot to shut down if the discharge is critical, leaving its task inconclusive. Therefore, it is of utmost importance that the robot learns when to charge its batteries, avoiding turning off. This work shows a reactive navigation scheme for a mobile robot that integrates a module for battery-level monitoring. A robot moves from a starting point to a destination according to the battery level. During the navigation, the robot decides when to change the course toward a battery charging station. This paper presents a rules-based reinforcement learning architecture with three entries; these entries correspond to the robot's battery level, the distance to the destination, and the distance to the battery charging station. According to the simulations, the robot learns to select an appropriate action to accomplish its task.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Mobile robot]]></kwd>
<kwd lng="en"><![CDATA[navigation]]></kwd>
<kwd lng="en"><![CDATA[path-planning]]></kwd>
<kwd lng="en"><![CDATA[fuzzy Q-learning]]></kwd>
<kwd lng="en"><![CDATA[artificial potential fields]]></kwd>
<kwd lng="en"><![CDATA[reinforcement learning]]></kwd>
<kwd lng="en"><![CDATA[autonomous recharging problem]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<label>1</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abhishek]]></surname>
<given-names><![CDATA[T.S.]]></given-names>
</name>
<name>
<surname><![CDATA[Schilberg]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Doss]]></surname>
<given-names><![CDATA[A.S.A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Obstacle avoidance algorithms: A review]]></article-title>
<source><![CDATA[IOP Conference Series: Materials Science and Engineering]]></source>
<year>2021</year>
<volume>1012</volume>
<page-range>1-23</page-range></nlm-citation>
</ref>
<ref id="B2">
<label>2</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Agarwal]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[Bharti]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Nature inspired evolutionary approaches for robot navigation: Survey]]></article-title>
<source><![CDATA[Journal of Information and Optimization Sciences]]></source>
<year>2020</year>
<volume>41</volume>
<page-range>421-36</page-range></nlm-citation>
</ref>
<ref id="B3">
<label>3</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Cheng]]></surname>
<given-names><![CDATA[Z.]]></given-names>
</name>
<name>
<surname><![CDATA[Fu]]></surname>
<given-names><![CDATA[X.]]></given-names>
</name>
<name>
<surname><![CDATA[Wang]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Xu]]></surname>
<given-names><![CDATA[X.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Research on robot charging strategy based on the scheduling algorithm of minimum encounter time]]></article-title>
<source><![CDATA[Journal of the Operational Research Society]]></source>
<year>2019</year>
<page-range>1-9</page-range></nlm-citation>
</ref>
<ref id="B4">
<label>4</label><nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[de Lucca Siqueira]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Della Mea Plentz]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[De Pieri]]></surname>
<given-names><![CDATA[E. R.]]></given-names>
</name>
</person-group>
<source><![CDATA[A fuzzy approach to the autonomous recharging problem for mobile robots]]></source>
<year>2016</year>
<conf-name><![CDATA[ 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1065-70</page-range></nlm-citation>
</ref>
<ref id="B5">
<label>5</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Gul]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Rahiman]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A comprehensive study for robot navigation techniques]]></article-title>
<source><![CDATA[Cogent Engineering]]></source>
<year>2019</year>
<volume>6</volume>
<page-range>1-25</page-range></nlm-citation>
</ref>
<ref id="B6">
<label>6</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Francis]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Faust]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Chiang]]></surname>
<given-names><![CDATA[H.T.L.]]></given-names>
</name>
<name>
<surname><![CDATA[Hsu]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Kew]]></surname>
<given-names><![CDATA[J.C.]]></given-names>
</name>
<name>
<surname><![CDATA[Fiser]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Lee]]></surname>
<given-names><![CDATA[T.W.E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Long-range indoor navigation with prm-rl]]></article-title>
<source><![CDATA[IEEE Transactions on Robotics]]></source>
<year>2020</year>
<volume>36</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1115-34</page-range></nlm-citation>
</ref>
<ref id="B7">
<label>7</label><nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Gamal]]></surname>
<given-names><![CDATA[O.]]></given-names>
</name>
<name>
<surname><![CDATA[Cai]]></surname>
<given-names><![CDATA[X.]]></given-names>
</name>
<name>
<surname><![CDATA[Roth]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
</person-group>
<source><![CDATA[Learning from fuzzy system demonstration: Autonomous navigation of mobile robot in static indoor environment using multimodal deep learning]]></source>
<year>2020</year>
<conf-name><![CDATA[ 24th International Conference on System Theory, Control, and Computing (ICSTCC)]]></conf-name>
<conf-loc> </conf-loc>
<page-range>218-25</page-range></nlm-citation>
</ref>
<ref id="B8">
<label>8</label><nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Glorennec]]></surname>
<given-names><![CDATA[P.Y.]]></given-names>
</name>
<name>
<surname><![CDATA[Jouffe]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Fuzzy q-learning]]></source>
<year>1997</year>
<volume>2</volume>
<conf-name><![CDATA[ 6th International Fuzzy Systems Conference]]></conf-name>
<conf-loc> </conf-loc>
<page-range>659-62</page-range></nlm-citation>
</ref>
<ref id="B9">
<label>9</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hosseini-Rostami]]></surname>
<given-names><![CDATA[S.M.]]></given-names>
</name>
<name>
<surname><![CDATA[Kumar]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Wang]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Liu]]></surname>
<given-names><![CDATA[X.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Obstacle avoidance of mobile robots using modified artificial potential field algorithm]]></article-title>
<source><![CDATA[Journal on Wireless Communications and Networking]]></source>
<year>2019</year>
<volume>2019</volume>
</nlm-citation>
</ref>
<ref id="B10">
<label>10</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Imrane]]></surname>
<given-names><![CDATA[M.L.]]></given-names>
</name>
<name>
<surname><![CDATA[Melingui]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Ahanda]]></surname>
<given-names><![CDATA[J.J.B. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Motto]]></surname>
<given-names><![CDATA[F.B.]]></given-names>
</name>
<name>
<surname><![CDATA[Merzouki]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Artificial potential field neuro-fuzzy controller for autonomous navigation of mobile robots. Proceedings of the Institution of Mechanical Engineers]]></article-title>
<source><![CDATA[Journal of Systems and Control Engineering]]></source>
<year>2020</year>
<volume>235</volume>
<numero>5</numero>
<issue>5</issue>
</nlm-citation>
</ref>
<ref id="B11">
<label>11</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Jiang]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Huang]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Ding]]></surname>
<given-names><![CDATA[Z.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Path planning for intelligent robots based on deep q-learning with experience replay and heuristic knowledge]]></article-title>
<source><![CDATA[Journal of Automatica Sinica]]></source>
<year>2020</year>
<volume>7</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1179-89</page-range></nlm-citation>
</ref>
<ref id="B12">
<label>12</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ma]]></surname>
<given-names><![CDATA[T.-y.]]></given-names>
</name>
<name>
<surname><![CDATA[Xie]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Optimal fast charging station locations for electric ridesharing service with online vehicle-charging station assignment. Transportation Research]]></article-title>
<source><![CDATA[Transport and Environment]]></source>
<year>2021</year>
<volume>90</volume>
<page-range>102682</page-range></nlm-citation>
</ref>
<ref id="B13">
<label>13</label><nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rappaport]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Bettstetter]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
</person-group>
<source><![CDATA[Coordinated recharging of mobile robots during exploration]]></source>
<year>2017</year>
<conf-name><![CDATA[ IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)]]></conf-name>
<conf-loc> </conf-loc>
<page-range>6809-16</page-range></nlm-citation>
</ref>
<ref id="B14">
<label>14</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Storn]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Price]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Differential evolution &#8211; a simple and efficient heuristic for global optimization over continuous spaces]]></article-title>
<source><![CDATA[Journal of Global Optimization]]></source>
<year>1997</year>
<volume>11</volume>
<page-range>341-59</page-range></nlm-citation>
</ref>
<ref id="B15">
<label>15</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Tiwari A.K.]]></surname>
<given-names><![CDATA[P.A.]]></given-names>
</name>
<name>
<surname><![CDATA[Guha]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Dynamic motion planning for autonomous wheeled robot using minimum fuzzy rule-based controller with avoidance of moving obstacles]]></article-title>
<source><![CDATA[International Journal of Innovative Technology and Exploring Engineering]]></source>
<year>2019</year>
<volume>9</volume>
<page-range>4192-8</page-range></nlm-citation>
</ref>
<ref id="B16">
<label>16</label><nlm-citation citation-type="">
<collab>Tom</collab>
<source><![CDATA[Lipo voltage chart: Show the relationship of voltage and capacity]]></source>
<year>2019</year>
</nlm-citation>
</ref>
<ref id="B17">
<label>17</label><nlm-citation citation-type="confpro">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Tomy]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Lacerda]]></surname>
<given-names><![CDATA[B]]></given-names>
</name>
<name>
<surname><![CDATA[Hawes]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Watt]]></surname>
<given-names><![CDATA[J.L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Battery charge scheduling in long-life autonomous mobile robots]]></source>
<year>2019</year>
<conf-name><![CDATA[ European Conference on Mobile Robots (ECMR)]]></conf-name>
<conf-loc> </conf-loc>
<page-range>1-6</page-range></nlm-citation>
</ref>
<ref id="B18">
<label>18</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wang]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Elfwing]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Uchibe]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Modular deep reinforcement learning from reward and punishment for robot navigation]]></article-title>
<source><![CDATA[Neural Networks]]></source>
<year>2021</year>
<volume>135</volume>
<page-range>115-26</page-range></nlm-citation>
</ref>
<ref id="B19">
<label>19</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wei]]></surname>
<given-names><![CDATA[P.-A]]></given-names>
</name>
<name>
<surname><![CDATA[Tsai]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Tai]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Autonomous navigation of an indoor mecanum-wheeled omnidirectional robot using segnet]]></article-title>
<source><![CDATA[iRobotics]]></source>
<year>2019</year>
<volume>2</volume>
</nlm-citation>
</ref>
</ref-list>
</back>
</article>
