DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication
Contribución de congreso (ConferenceOutput)
Contextual policy search for micro-data robot motion learning through covariate Gaussian process latent variable models
Trabajo presentado para la International Conference on Intelligent Robots and Systems (IRos), en Las Vegas, Nevada (Estados Unidos) del 25 al 29 de octubre de 2020, In the next few years, the amount and variety of
context-aware robotic manipulator applications is expected to
increase significantly, especially in household environments. In
such spaces, thanks to programming by demonstration, nonexpert people will be able to teach robots how to perform
specific tasks, for which the adaptation to the environment is
imperative, for the sake of effectiveness and users safety. These
robot motion learning procedures allow the encoding of such
tasks by means of parameterized trajectory generators, usually
a Movement Primitive (MP) conditioned on contextual variables. However, naively sampled solutions from these MPs are
generally suboptimal/inefficient, according to a given reward
function. Hence, Policy Search (PS) algorithms leverage the
information of the experienced rewards to improve the robot
performance over executions, even for new context configurations. Given the complexity of the aforementioned tasks, PS
methods face the challenge of exploring in high-dimensional
parameter search spaces. In this work, a solution combining
Bayesian Optimization, a data-efficient PS algorithm, with
covariate Gaussian Process Latent Variable Models, a recent
Dimensionality Reduction technique, is presented. It enables
reducing dimensionality and exploiting prior demonstrations
to converge in few iterations, while also being compliant with
context requirements. Thus, contextual variables are considered
in the latent search space, from which a surrogate model
for the reward function is built. Then, samples are generated
in a low-dimensional latent space, and mapped to a contextdependent trajectory. This allows us to drastically reduce the
search space with the covariate GPLVM, e.g. from 105 to 2
parameters, plus a few contextual features. Experimentation in
two different scenarios proves the data-efficiency and the power
of dimensionality reduction of our approach., This work has been developed in the context of the project CLOTHILDE
("CLOTH manIpulation Learning from DEmonstrations"), which has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Advanced
Grant agreement No 741930). This work is also supported by the Spanish
State Research Agency through the María de Maeztu Seal of Excellence to
IRI MDM-2016-0656, Peer reviewed