RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Capítulo o parte de un libro (BookPart)
Learning with con gurable operators and RL-based heuristics
In this paper, we push forward the idea of machine learning
systems for which the operators can be modi ed and netuned for each
problem. This allows us to propose a learning paradigm where users can
write (or adapt) their operators, according to the problem, data representation
and the way the information should be navigated. To achieve
this goal, data instances, background knowledge, rules, programs and
operators are all written in the same functional language, Erlang. Since
changing operators a ect how the search space needs to be explored,
heuristics are learnt as a result of a decision process based on reinforcement
learning where each action is de ned as a choice of operator and
rule. As a result, the architecture can be seen as a `system for writing
machine learning systems' or to explore new operators., This work was supported by the MEC projects CONSOLIDER-INGENIO 26706 and
TIN 2010-21062-C02-02, GVA project PROMETEO/2008/051, and the REFRAME
project granted by the European Coordinated Research on Long-term Challenges in
Information and Communication Sciences & Technologies ERA-Net (CHIST-ERA),
and funded by the Ministerio de Econom´ıa y Competitividad in Spain. Also, F.
Mart´ınez-Plumed is supported by FPI-ME grant BES-2011-045099