Pasar al contenido principal

VISION ARTIFICIAL Y ROBOTICA COLABORATIVA EN PULIDO DE SUPERFICIES EN LA INDUSTRIA

DPI2017-87656-C2-1-R

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2017
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITÈCNICA DE VALÈNCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 29
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Robust auto tool change for industrial robots using visual servoing

  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This work presents an automated solution for tool changing in industrial robots using visual servoing and sliding mode control. The robustness of the proposed method is due to the control law of the visual servoing, which uses the information acquired by a vision system to close a feedback control loop. Furthermore, sliding mode control is simultaneously used in a prioritised level to satisfy the constraints typically present in a robot system: joint range limits, maximum joint speeds and allowed workspace. Thus, the global control accurately places the tool in the warehouse, but satisfying the robot constraints. The feasibility and effectiveness of the proposed approach is substantiated by simulation results for a complex 3D case study. Moreover, real experimentation with a 6R industrial manipulator is also presented to demonstrate the applicability of the method for tool changing., This work was supported in part by the Ministerio de Economia, Industria y Competitividad, Gobierno de Espana under Grant BES-2010-038486 and Project DPI2017-87656-C2-1-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback

  • González, Claudia
  • Girbés-Juan, Vicent
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] There are some industrial tasks that are still mainly performed manually by human workers due to their complexity, which is the case of surface treatment operations (such as sanding, deburring, finishing, grinding, polishing, etc.) used to repair defects. This work develops an advanced teleoperation and control system for industrial robots in order to assist the human operator to perform the mentioned tasks. On the one hand, the controlled robotic system provides strength and accuracy, holding the tool, keeping the right tool orientation and guaranteeing a smooth approach to the workpiece. On the other hand, the advanced teleoperation provides security and comfort to the user when performing the task. In particular, the proposed teleoperation uses augmented virtuality (i.e., a virtual world that includes non-modeled real-world data) and haptic feedback to provide the user an immersive virtual experience when remotely teleoperating the tool of the robot system to treat arbitrary regions of the workpiece surface. The method is illustrated with a car body surface treatment operation, although it can be easily extended to other surface treatment applications or even to other industrial tasks where the human operator may benefit from robotic assistance. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm. Moreover, a comparison of the performance obtained manually by an expert and that obtained with the proposed method has also been conducted in order to show the suitability of the proposed approach., This research was founded by the Spanish Government and the Generalitat Valenciana under Grants PID2020-117421RB-C21 and GV/2021/005
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Sliding mode control for robust and smooth reference tracking in robot visual servoing

  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Esparza Peidro, Alicia|||0000-0002-7471-8686
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] An approach based on sliding mode is proposed in this work for reference tracking in robot visual servoing. In particular, 2 sliding mode controls are obtained depending on whether joint accelerations or joint jerks are considered as the discontinuous control action. Both sliding mode controls are extensively compared in a 3D-simulated environment with their equivalent well-known continuous controls, which can be found in the literature, to highlight their similarities and differences. The main advantages of the proposed method are smoothness, robustness, and low computational cost. The applicability and robustness of the proposed approach are substantiated by experimental results using a conventional 6R industrial manipulator (KUKA KR 6 R900 sixx [AGILUS]) for positioning and tracking tasks., Spanish Government, Grant/Award Number: BES-2010-038486; Generalitat Valenciana, Grant/Award Number: BEST/2017/029 and APOSTD/2016/044
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

  • Girbés-Juan, Vicent
  • Schettino, Vinicius
  • Demiris, Yiannis
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method., This research was funded by Generalitat Valenciana (Grants GV/2021/074 and GV/2021/181) and by the SpanishGovernment (Grants PID2020-118071GB-I00 and PID2020-117421RBC21 funded by MCIN/AEI/10.13039/501100011033). This work was also supported byCoordenacao de Aperfeiaoamento de Pessoal de Nivel Superior (CAPES Brasil) under Finance Code 001, by CEFET-MG, and by a Royal Academy of Engineering Chair in Emerging Technologies to YD.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Human-robot cooperation for robust surface treatment using non-conventional sliding mode control

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
  • Girbés, Vicent
[EN] This work presents a human-robot closely collaborative solution to cooperatively perform surface treatment tasks such as polishing, grinding, deburring, etc. The method considers two force sensors attached to the manipulator end-effector and tool: one sensor is used to properly accomplish the surface treatment task, while the second one is used by the operator to guide the robot tool. The proposed scheme is based on task priority and adaptive non-conventional sliding mode control. The applicability of the proposed approach is substantiated by experimental results using a redundant 7R manipulator: the Sawyer cobot., This work was supported in part by the Spanish Government under the project DPI2017-87656-C2-1-R and the Generalitat Valenciana under Grants VALi + d APOSTD/2016/044 and APOSTD/2017/055.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Cooperative human-robot polishing for the task of patina growing on high-quality leather shoes

  • Borrell, Jorge
  • González, Alejandra
  • Pérez-Vidal, Carlos
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
[EN] A patina is essentially the weathered look a piece of leather takes on as it ages. The patina finishing aspect can be also generated or grown artificially by scrubbing the leather surface with specific products. These kinds of manual finishing operations on small objects are delicate and regularly need slight corrections carried out by skilled artisans, which adds complexity to the process automation and implies various key aspects to consider. This research presents a novel approach for automatic and semiautomatic shoe patina growing in the footwear industry using a new co-creative method based on cooperative robotics. The system automates the process in pursuit of operator time-saving without reducing the work finishing quality. For this purpose, the use of a collaborative robot with a built-in constant contact force control and a collaborative tool are used in this research. The use of both tools in complementarity with the knowledge of the craftsman leads the robot end-effector adaptation to the inherent curved surfaces over the shoe. Besides, some orientation corrections are applied based on the CAD model for the task to be accurately accomplished. The solution has been successfully integrated in a real production line, and it is currently in use., The authors want to thank Bespoke Factory Group (bespokefactory.com) for funding this project, CFZ Cobots (cfzcobots. com) for their technical support on robotics and mechanical design, and DESINOPE (desinope.com) for their technical support on process design related with the shoe industry. Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Bespoke Factory Group bespokefactory.com.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Human-robot collaboration for safe object transportation using force feedback

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
  • Carmichael, Marc G.
[EN] This work presents an approach based on multi-task, non-conventional sliding mode control and admittance control for human-robot collaboration aimed at handling applications using force feedback. The proposed robot controller is based on three tasks with different priority levels in order to cooperatively perform the safe transportation of an object with a human operator. In particular, a high-priority task is developed using non-conventional sliding mode control to guarantee safe reference parameters imposed by the task, e.g., keeping a load at a desired orientation (to prevent spill out in the case of liquids, or to reduce undue stresses that may compromise fragile items). Moreover, a second task based on a hybrid admittance control algorithm is used for the human operator to guide the robot by means of a force sensor located at the robot tool. Finally, a third low-priority task is considered for redundant robots in order to use the remaining degrees of freedom of the robot to achieve a pre-set secondary goal (e.g., singularity avoidance, remaining close to a homing configuration for increased safety, etc.) by means of the gradient projection method. The main advantages of the proposed method are robustness and low computational cost. The applicability and effectiveness of the proposed approach are substantiated by experimental results using a redundant 7R manipulator: the Sawyer collaborative robot. (C) 2018 Elsevier B.V. All rights reserved., This work was supported in part by the Spanish Government under Project DPI2017-87656-C2-1-R, and the Generalitat Valenciana under Grants VALi+d APOSTD/2016/044 and BEST/2017/029.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Advanced mathematical methods for collaborative robotics

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Cooperative transport tasks with robots using adaptive non-conventional sliding mode control

  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Esparza Peidro, Alicia|||0000-0002-7471-8686
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
[EN] This work presents a hybrid position/force control of robots aimed at handling applications using multi-task and sliding mode ideas. The proposed robot control is based on a novel adaptive non-conventional sliding mode control used to robustly satisfy a set of inequality constraints defined to accomplish the cooperative transport task. In particular, these constraints are used to guarantee the reference parameters imposed by the task (e.g., keeping the load at a desired orientation) and to guide the robot using the human operator's forces detected by a force sensor located at the robot tool. Another feature of the proposal is the multi-layered nature of the strategy, where a set of four tasks are defined with different priorities. The effectiveness of the proposed adaptive non-conventional sliding mode control is illustrated by simulation results. Furthermore, the applicability and feasibility of the proposed robot control for transport tasks are substantiated by experimental results using a redundant 7R manipulator., This work was supported in part by the Spanish Government under Project DPI2017-87656-C2-1-R, and the Generalitat Valenciana under Grants VALi + d APOSTD/2016/044 and BEST/2017/029.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Bimanual robot control for surface treatment tasks

  • García-Fernández, Alberto
  • Girbés-Juan, Vicent
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This work develops a method to perform surface treatment tasks using a bimanual robotic system, i.e. two robot arms cooperatively performing the task. In particular, one robot arm holds the work-piece while the other robot arm has the treatment tool attached to its end-effector. Moreover, the human user teleoperates all the six coordinates of the former robot arm and two coordinates of the latter robot arm, i.e. the teleoperator can move the treatment tool on the plane given by the work- piece surface. Furthermore, a force sensor attached to the treatment tool is used to automatically attain the desired pressure between the tool and the workpiece and to automatically keep the tool orientation orthogonal to the workpiece surface. In addition, to assist the human user during the teleoperation, several constraints are defined for both robot arms in order to avoid exceeding the allowed workspace, e.g. to avoid collisions with other objects in the environment. The theory used in this work to develop the bimanual robot control relies on sliding mode control and task prioritisation. Finally, the feasibility and effectiveness of the method are shown through experimental results using two robot arms., This work was supported by Generalitat Valenciana [grant numbers ACIF/2019/007 and GV/2021/181] and Spanish Ministry of Science and Innovation [grant number PID2020117421RB-C21].
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Camera 3D positioning mixed reality-based interface to improve worker safety, ergonomics and productivity

  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Mahiques, Xavier
[EN] This research develops a new mixed reality-based worker interface for industrial camera 3D positioning, which is intuitive and easy to manage, in order to enhance the worker safety, ergonomics and productivity. An experimental prototype to be used in the car body quality control is developed in the paper. The benefits and drawbacks of the proposed interface are discussed along the paper and sustained through several usability tests conducted with users familiar and not-familiar with mixed reality devices. Furthermore, the feasibility of the proposed approach is demonstrated by tests made in an industrial environment with skilled workers from Alfatec Sistemas company., This work was supported in part by the Spanish Government under the Project DPI2017-87656-C2-1-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Human-robot collaboration for surface treatment tasks

  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
  • Perez-Vidal, Carlos
[EN] This paper presents a human-robot closely collaborative solution to cooperatively perform surface treatment tasks such as polishing, grinding, finishing, deburring, etc. The proposed scheme is based on task priority and non-conventional sliding mode control. Furthermore, the proposal includes two force sensors attached to the manipulator end-effector and tool: one sensor is used to properly accomplish the surface treatment task, while the second one is used by the operator to guide the robot tool. The applicability and feasibility of the proposed collaborative solution for robotic surface treatment are substantiated by experimental results using a redundant 7R manipulator: the Sawyer collaborative robot., This work was supported in part by the Spanish Government under the project DPI-201787656-C2-1-R and the Generalitat Valenciana under Grant VALi+d.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Design of a polishing tool for collaborative robotics using minimum viable product approach

  • Perez-Vidal, Carlos
  • Saccon, Alessandro
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Sanchez-Caballero, Samuel|||0000-0001-5322-8082
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] A collaborative tool for robotic polishing is developed in this work in order to allow the simultaneous operation of the robot system and human operator to cooperatively carry out the polishing task. For this purpose, the collaborative environment is detailed and the polishing application is designed. Moreover, the polishing tool is developed and its implementation using the minimum viable product approach is obtained. Furthermore, a robust hybrid position-force control is proposed to use the developed tool attached to a robot system and some experiments are given to show its performance., This work was supported in part by the Ministerio de Ciencia e Innovacion (Spanish Government) under project [DPI2017-87656-C2-1-R] and the Generalitat Valenciana under Grant [VALi+ d APOSTD/2016/044].
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Adaptive Sliding Mode Control for Robotic Surface Treatment Using Force Feedback

  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
  • Perez-Vidal, Carlos
[EN] This work presents a hybrid position-force control of robots in order to apply surface treatments such as polishing, grinding, finishing, deburring, etc. The robot force control is designed using sliding mode concepts to benefit from robustness. In particular, the sliding mode force task is defined using equality constraints to attain the desired tool pressure on the surface, as well as to keep the tool orientation perpendicular to the surface. In order to deal with sudden changes in material stiffness, which are ultimately transferred to the polishing tool and can produce instability and compromise polishing performance, several adaptive switching gain laws are considered and compared. Moreover, a lower priority tracking controller is defined to follow the desired reference trajectory on the surface being polished. Hence, deviations from the reference trajectory are allowed if such deviations are required to satisfy the constraints mentioned above. Finally, a third-level task is also considered for the case of redundant robots in order to use the remaining degrees of freedom to keep the manipulator close to the home configuration with safety in mind. The main advantages of the method are increased robustness and low computational cost. The applicability and effectiveness of the proposed approach are substantiated by experimental results using a redundant 7R manipulator: the Rethink Robotics Sawyer collaborative robot., This work was supported in part by the Spanish Government under the project DPI2017-87656-C2-1-R and the Generalitat Valenciana under Grants VALi + d APOSTD/2016/044 and BEST/2017/029.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Adaptive robust control and admittance control for contact-driven robotic surface conditioning

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Esparza Peidro, Alicia|||0000-0002-7471-8686
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
[EN] This work presents a hybrid position/force control of robots for surface contact conditioning tasks such as polishing, profiling, deburring, etc. The robot force control is designed using sliding mode ideas to benefit from robustness. On the one hand, a set of equality constraints are defined to attain the desired tool pressure on the surface, as well as to keep the tool orientation perpendicular to the surface. On the other hand, inequality constraints are defined to adapt the tool position to unmodeled features present in the surface, e.g., a protruding window frame. Conventional and non-conventional sliding mode controls are used to fulfill the equality and inequality constraints, respectively. Furthermore, in order to deal with sudden changes of the material stiffness, which are forwarded to the robot tool and can produce instability and bad performance, adaptive switching gain laws are considered not only for the conventional sliding mode control but also for the non-conventional sliding mode control. A lower priority tracking controller is also defined to follow the desired reference trajectory on the target surface. Moreover, the classical admittance control typically used in force control tasks is adapted for the proposed surface contact application in order to experimentally compare the performance of both control approaches. The effectiveness of the proposed method is substantiated by experimental results using a redundant 7R manipulator, whereas its advantages over the classical admittance control approach are experimentally shown., This work was supported in part by the Spanish Government under the Project DPI2017-87656-C2-1-R and the Generalitat Valenciana under Grants VALi+d APOSTD/2016/044 and BEST/2017/029.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Development of a collaborative robotic system to polish leather surfaces

  • González, Alejandra
  • Perez-Vidal, Carlos
  • Borrell, Jorge
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] Patina is the natural aging process that gives leather a unique, worn appearance. However, this patina effect can also be created artificially by using specific products to rub the leather surface. This research presents a new and innovative method to automate the process of creating patina on leather footwear using collaborative robots. These types of finishing tasks on medium size objects are delicate and often require adjustments by skilled craftsmen, adding complexity to the automation process. This new solution involves designing and implementing a collaborative tool specifically created to cultivate a patina finish on shoe surfaces. The system aims to speed up the process without compromising the quality of the finished product. In order to accomplish this task, a collaborative robot that can regulate contact force and a preexisting software feature for recording manual paths are utilized together with the skills of an expert craftsman. This enables the robot¿s end effector to conform to the curved contours of the shoe. Furthermore, the tool¿s path and position are modified based on the data from the CAD model to ensure precise outcomes. This study introduces a novel technique for automated and partially automated patina development in the shoe industry. This work presents a system integrated into a productive facility and it is currently being used., This research has been partly funded by project CPP2021-008593, funded by CIN/AEI/10.13039/501100011033 and by the European Union-NextGenerationEU/PRTR. This research has been partly funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033)
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Robotic assistance for industrial sanding with a smooth approach to the surface and boundary constraints

  • García-Fernández, Alberto
  • Girbés-Juan, Vicent
  • Perez-Vidal, Carlos
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] Surface treatment operations, such as sanding, deburring, finishing, grinding, polishing, etc. are progressively becoming more automated using robotic systems. However, previous research in this field used a completely automatic operation of the robot system or considered a low degree of human-robot interaction. Therefore, to overcome this issue, this work develops a truly synergistic cooperation between the human operator and the robot system to get the best from both. In particular, in the application developed in this work the human operator provides flexibility, guiding the tool of the robot system to treat arbitrary regions of the workpiece surface; while the robot system provides strength, accuracy and security, not only holding the tool and keeping the right tool orientation, but also guaranteeing a smooth approach to the workpiece and confining the tool within the allowed area close to the workpiece. Moreover, to add more flexibility to the proposed method, when the user is not guiding the robot tool, a robot automatic operation is activated to perform the treatment in prior established regions. Furthermore, a camera network is used to get a global view of the robot workspace in order to obtain the workpiece location accurately and in real-time. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm., This research was founded by the Spanish Government and the Generalitat Valenciana under Grants PID2020-117421RB-C21, GV/2021/181 and ACIF/2019/007.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Human-Robot Cooperation for Surface Repair Combining Automatic and Manual Modes

  • García-Fernández, Alberto
  • Girbés, Vicent
  • Perez-Vidal, Carlos
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This article develops a human-robot cooperation to carry out treatments such as sanding, polishing, etc. on the surface of a known rigid object. For this purpose, a vision system is considered to get the object location to ensure not only the perpendicularity of the obot tool to the object surface but also a smooth approach of the tool to the surface. In order to add flexibility, the proposal includes the simultaneous combination of automatic and manual modes of operation. Thus, the human user can guide the robot tool to treat arbitrary areas (manual mode) and, when the operator releases the tool, the robot goes into the automatic mode to treat prior established areas. The method uses a task prioritization framework and three types of controllers: an admittance controller for the tool guidance; a hybrid controller to modify the tool orientation and, in the automatic mode, the tool position; and a sliding mode controller to limit the velocity at which the tool approaches the object surface. The applicability and efficacy of the proposed method is demonstrated experimentally using a conventional 6R robot arm., This work was supported in part by the Spanish Government, and in part by the Generalitat Valenciana under Grant DPI2017-87656-C2-1-R and Grant ACIF/2019/007.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Robust Hybrid Position-Force Control for Robotic Surface Polishing

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Valls Miro, Jaime
  • Perez-Vidal, Carlos
[EN] This work presents a hybrid position-force control of robots for surface polishing using task priority. The robot force control is designed using sliding mode ideas in order to benefit from its inherent robustness and low computational cost. In order to avoid the chattering drawback typically present in sliding mode control, several chattering-free controllers are evaluated and tested. A distinctive feature of the method is that the sliding mode force task is defined using not only equality constraints but also inequality constraints, which are satisfied using conventional and nonconventional sliding mode control, respectively. Moreover, a lower priority tracking controller is defined to follow the desired reference trajectory on the surface being polished. The applicability and the effectiveness of the proposed approach considering the mentioned chattering-free controllers are substantiated by experimental results using a redundant 7R manipulator., Spanish Government, Agencia Estatal de Investigacion (DPI2017-87656-C2-1-R). Generalitat Valenciana, Conselleria d'Educacion, Investigacion, Cultura i Esport (VALi+d APOSTD/2016/044).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Mixed reality-based user interface for quality control inspection of car body surfaces

  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Mahiques, Xavier
[EN] In recent years, the quality control of car body surfaces production lines have been put in the context of Industry 4.0. The emergence of automatic defect detection systems have helped to standardize the brand quality and gather information about all quality control tasks performed by workers. However, current worker interfaces used to indicate the location and other characteristics of the defects found by these systems have overcome the ergonomics of workers and increased their stress at work. This paper presents a novel mixed reality-based user interface for quality control inspection which is more intuitive, in order to improve the ergonomics of workers, reduce their stress at work and improve the productivity of current quality control production lines. An experimental prototype is shown in the paper in order to demonstrate the benefits of the proposed interface. In addition, the paper shows the results of several usability tests that compare the proposed mixed reality-based user interface with current interfaces used in important factories such as Mercedes-Benz, analyzing the benefits and drawbacks of each interface., This work was supported by the Spanish Government under the Project DPI2017-87656-C2-1-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

A Methodology to Produce Augmented-Reality Guided Tours in Museums for Mixed-Reality Headsets

  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] In recent years, the use of technology in the museum context has changed radically. It has switched from the display of information to offering emotive, immersive, and rich experiences with heritage. Virtual interactive media have the potential to put museums back into a relevant place in our increasingly digital society. The emergence of augmented-reality glasses offers the possibility to test and implement new methodologies compatible with this aim. However, most of the first examples developed in recent years did not take advantage of the possibilities of this new medium. This paper presents a novel methodology for producing mixed-reality applications for museums and heritage sites, with an intuitive, immersive, and natural way of operating. An experimental prototype designed for the archaeological museum of the Almoina is shown in the paper to demonstrate the benefits of the proposed system and methodology of production. In addition, the paper shows the results of several tests., This research was founded by the Generalitat Valenciana (Grant GV/2021/181) and by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Generalization of reference filtering control strategy for 2D/3D visual feedback control of industrial robot manipulators

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Leopoldo Armesto|||0000-0003-0979-4428
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This paper develops the application of the Dual Rate Dual Sampling Reference Filtering Control Strategy to 2D and 3D visual feedback control. This strategy allows to overcome the problem of sensor latency and to address the problem of control task failure due to visual features leaving the camera field of view. In particular, a Dual Rate Kalman Filter is used to generate inter-sample estimations of the visual features to deal with the problem of vision sensor latency, whereas a Dual Rate Extended Kalman Filter Smoother is used to generate more convenient visual features trajectories in the image plane. Both 2D and 3D visual feedback control approaches are widely analyzed throughout the paper, as well as the overall system performance using different visual feedback controllers, providing a set of results that highlight the improvements in terms of solution reachability, robustness, and time domain response. The proposed control strategy has been validated on an industrial system with hard real-time limitations, consisting of a 6 DOF industrial manipulator, a 5 MP camera, and a PLC as controller., This work was supported in part by the Spanish Government under the projects PID2020-117421RB-C21 and PID2020116585GB-I00, and in part by the Generalitat Valenciana under the project GV/2021/181.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Identification and control of a multiplace hyperbaric chamber

  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Perez-Vidal, Carlos
  • de Paco, Jose M.
  • de Paco, Luis M.
[EN] This work presents the automation of a multiplace hyperbaric chamber. It includes the system modeling, identification, controller calculation and system validation. With the proposed approach a good pressure profile tracking and repeatability are achieved. Moreover, the proposed automation includes the implementation of powerful treatment tools such as Pause and Alleviation procedures. The control system implemented is based on a special zero-pole cancellation regulator. Experimental results are provided to illustrate the behavior of the automated chamber. It is important to remark that the chamber automated in this work is being successfully used in a real hospital since 2015 treating more than 40 patients per day, five days a week., The authors would like to thanks MEDIBAROX (unit of the Perpetuo Socorro Hospital) and the "Catedra de Medicina Hiperbarica" of the Miguel Hernandez University for their support and for finally implementing the control law described in this article. The authors would also like to thank Francisco Aracil Meseguer for his help with the chamber 3D modeling.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This work proposes a new interface for the teleoperation of mobile robots based on virtual reality that allows a natural and intuitive interaction and cooperation between the human and the robot, which is useful for many situations, such as inspection tasks, the mapping of complex environments, etc. Contrary to previous works, the proposed interface does not seek the realism of the virtual environment but provides all the minimum necessary elements that allow the user to carry out the teleoperation task in a more natural and intuitive way. The teleoperation is carried out in such a way that the human user and the mobile robot cooperate in a synergistic way to properly accomplish the task: the user guides the robot through the environment in order to benefit from the intelligence and adaptability of the human, whereas the robot is able to automatically avoid collisions with the objects in the environment in order to benefit from its fast response. The latter is carried out using the well-known potential field-based navigation method. The efficacy of the proposed method is demonstrated through experimentation with the Turtlebot3 Burger mobile robot in both simulation and real-world scenarios. In addition, usability and presence questionnaires were also conducted with users of different ages and backgrounds to demonstrate the benefits of the proposed approach. In particular, the results of these questionnaires show that the proposed virtual reality based interface is intuitive, ergonomic and easy to use., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded byMCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant GV/2021/181).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Robust fulfillment of constraints in robot visual servoing

  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Esparza Peidro, Alicia|||0000-0002-7471-8686
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] In this work, an approach based on sliding mode ideas is proposed to satisfy constraints in robot visual servoing. In particular, different types of constraints are defined in order to: fulfill the visibility constraints (camera fieldof-view and occlusions) for the image features of the detected object; to avoid exceeding the joint range limits and maximum joint speeds; and to avoid forbidden areas in the robot workspace. Moreover, another task with low-priority is considered to track the target object. The main advantages of the proposed approach are low computational cost, robustness and fully utilization of the allowed space for the constraints. The applicability and effectiveness of the proposed approach is demonstrated by simulation results for a simple 2D case and a complex 3D case study. Furthermore, the feasibility and robustness of the proposed approach is substantiated by experimental results using a conventional 6R industrial manipulator., This work was supported in part by the Spanish Government under grants BES-2010-038486 and Project DPI2013-42302-R, and the Generalitat Valenciana under grants VALi+d APOSTD/2016/044 and BEST/2017/029.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Teleoperation of industrial robot manipulators based on augmented reality

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
  • Girbés, Vicent
[EN] This research develops a novel teleoperation for robot manipulators based on augmented reality. The proposed interface is equipped with full capabilities in order to replace the classical teach pendant of the robot for carrying out teleoperation tasks. The proposed interface is based on an augmented reality headset for projecting computer-generated graphics onto the real environment and a gamepad to interact with the computer-generated graphics and provide robot commands. In order to demonstrate the benefits of the proposed method, several usability tests were conducted using a 6R industrial robot manipulator in order to compare the proposed interface and the conventional teach pendant interface for teleoperation tasks. In particular,the results ofthese usabilitytests show thattheproposedapproach is more intuitive, ergonomic,and easy to use. Furthermore, the comparison results also show that the proposed method clearly improves the velocity of the teleoperation task, regardless of the user's previous experience in robotics and augmented reality technology., This work was supported by the Spanish Government under the project DPI2017-87656-C2-1-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Automation of product packaging for industrial applications

  • Perez-Vidal, C.
  • de Paco, J.M.
  • Wirkus, M.
  • Azorin, J.M.
  • de Gea, J.
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] This work presents a robotic-based solution devised to automate the product packaging in industrial environments. Although the proposed approach is illustrated for the case of the shoe industry, it applies to many other products requiring similar packaging processes. The main advantage obtained with the automated task is that productivity could be significantly increased. The key algorithms for the developed robot system are: object detection using a computer vision system; object grasping; trajectory planning with collision avoidance; and operator interaction using a force/torque sensor. All these algorithms have been experimentally tested in the laboratory to show the effectiveness and applicability of the proposed approach., This work has been partly supported by Ministerio de Economia y Competitividad of the Spanish Government [Grant No. RTC201654086 and PRI-AIBDE-2011-1219], by the Deutscher Akademischer Austauschdienst (DAAD) of the German Government (Projekt-ID 54368155) and by ROBOFOOT project [Grant No. 260159] of the European Commission.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Representation of Robots in Matlab

  • Sanchez, Antonio
  • Morales, Ricardo
  • Perez-Vidal, Carlos
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] This paper presents a new software tool, namely RoboClass, to include and manage realistic robots and elements of the environment in Matlab simulations. These elements are loaded from CAD models using an STL-file and can be as detailed as desired. All the steps involved in the process are explained in detail. Furthermore, two illustrative examples are considered to show the effectiveness and versatility of the proposed approach: the ABB-IRB120 industrial robot and the CSA research robot. The developed tool is especially useful both for robotics research and teaching.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Augmented Reality-Based Interface for Bimanual Robot Teleoperation

  • García-Fernández, Alberto
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] Teleoperation of bimanual robots is being used to carry out complex tasks such as surgeries in medicine. Despite the technological advances, current interfaces are not natural to the users, who spend long periods of time in learning how to use these interfaces. In order to mitigate this issue, this work proposes a novel augmented reality-based interface for teleoperating bimanual robots. The proposed interface is more natural to the user and reduces the interface learning process. A full description of the proposed interface is detailed in the paper, whereas its effectiveness is shown experimentally using two industrial robot manipulators. Moreover, the drawbacks and limitations of the classic teleoperation interface using joysticks are analyzed in order to highlight the benefits of the proposed augmented reality-based interface approach., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grants GV/2021/ 181 and ACIF/2019/007).