Skip to main content

APRENDIZAJE Y ANALISIS DE COMPORTAMIENTOS HUMANOS PARA MONITORIZACION, ASISTENCIA PERSONALIZADA Y DETECCION TEMPRANA DE DOLENCIAS

PID2019-104818RB-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2019
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDAD DE ALICANTE

Resultados relacionados

Resultados totales (Incluyendo duplicados): 19
Encontrada(s) 1 página(s)

RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Deep Learning-Based Multimodal Architecture to predict Signs of Dementia

  • Ortiz Pérez, David
  • Ruiz Ponce, Pablo
  • Tomás, David
  • Garcia-Rodriguez, Jose
  • Vizcaya-Moreno, M. Flores
  • Leo, Marco
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Ortiz Pérez, David|||/items/e77e67d5-78fc-4170-a005-b6d3fd3ca79e
  • Ruiz Ponce, Pablo|||/items/bf90946b-d388-45f2-bbc1-53d580a02453
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
  • Vizcaya-Moreno, M. Flores|||/items/47df53a0-4d4d-48fe-8f29-471e90417a09
This paper proposes a multimodal deep learning architecture combining text and audio information to predict dementia, a disease which affects around 55 million people all over the world and makes them in some cases dependent people. The system was evaluated on the DementiaBank Pitt Corpus dataset, which includes audio recordings as well as their transcriptions for healthy people and people with dementia. Different models have been used and tested, including Convolutional Neural Networks (CNN) for audio classification, Transformers for text classification, and a combination of both in a multimodal ensemble. These models have been evaluated on a test set, obtaining the best results by using the text modality, achieving 90.36% accuracy on the task of detecting dementia. Additionally, an analysis of the corpus has been conducted for the sake of explainability, aiming to obtain more information about how the models generate their predictions and identify patterns in the data.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

An sEMG-Controlled 3D Game for Rehabilitation Therapies: Real-Time Time Hand Gesture Recognition Using Deep Learning Techniques

  • Nasri, Nadia
  • Orts-Escolano, Sergio
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Orts-Escolano, Sergio|||/items/2222768a-df75-443a-89ea-0ca8ede0e69b
In recent years the advances in Artificial Intelligence (AI) have been seen to play an important role in human well-being, in particular enabling novel forms of human-computer interaction for people with a disability. In this paper, we propose a sEMG-controlled 3D game that leverages a deep learning-based architecture for real-time gesture recognition. The 3D game experience developed in the study is focused on rehabilitation exercises, allowing individuals with certain disabilities to use low-cost sEMG sensors to control the game experience. For this purpose, we acquired a novel dataset of seven gestures using the Myo armband device, which we utilized to train the proposed deep learning model. The signals captured were used as an input of a Conv-GRU architecture to classify the gestures. Further, we ran a live system with the participation of different individuals and analyzed the neural network’s classification for hand gestures. Finally, we also evaluated our system, testing it for 20 rounds with new participants and analyzed its results in a user study.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

MDL+ a manufacturing description language to describe and control assembling tasks in industry 4.0

  • Zamora Hernández, Mauricio Andrés
  • Chaves Ceciliano, Jose Andrez
  • Villalobos Granados, Alonso
  • Castro-Vargas, John Alejandro
  • Garcia-Rodriguez, Jose
  • Azorin-Lopez, Jorge
  • Azorin-Lopez, Jorge|||/items/d43d029b-14bf-4dac-9bda-ed08e213bb1d
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
The assembly of products or components by operators in industries is a complex task with recurring problems. In these processes, operators often make errors that can lead to defective products. Therefore, they need to be inspected later to verify their correct assembly. The main problems are caused by several reasons including high employee turnover, lack of experience in manufacturing specific products or confusion in interpreting instructions to assemble similar components. In this paper, a novel structured language aimed to describe the required actions to manufacture a product in industrial assembly environments is presented. The main contribution is to provide a formal language to feed automatic systems that can verify through visual control whether the actions performed by the operator are carried out following the standard described by this language. In general, the use of this formal language will allow to minimize the negative impact of errors during assembly and to reduce waste in many forms in the industry.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Anomaly detection and virtual reality visualisation in supercomputers

  • Mulero Pérez, David
  • Benavent-Lledó, Manuel
  • Azorin-Lopez, Jorge
  • Marcos-Jorquera, Diego
  • Garcia-Rodriguez, Jose
  • Azorin-Lopez, Jorge|||/items/d43d029b-14bf-4dac-9bda-ed08e213bb1d
  • Benavent-Lledó, Manuel|||/items/0d1bda20-de83-4080-97c9-1820faf481da
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Marcos-Jorquera, Diego|||/items/2c3ce5b7-d5f7-4ac5-a499-b9a23904b744
  • Mulero Pérez, David|||/items/e3a342d3-f8d6-4010-bf87-a509394c0d36
Anomaly detection is the identification of events or observations that deviate from the expected behaviour of a given set of data. Its main application is the prediction of possible technical failures. In particular, anomaly detection on supercomputers is a difficult problem to solve due to the large scale of the systems and the large number of components. Most research works in this field employ machine learning methods and regression models in a supervised fashion, which implies the need for a large amount of labelled data to train such systems. This work proposes the use of autoencoder models, allowing the problem to be approached with semi-supervised learning techniques. Two different model training approaches are compared. The former is a model trained with data from all the nodes of a supercomputer. In the latter approach, observing significant differences between nodes, one model is trained for each node. The results are analysed by evaluating the positive and negative aspects of each approach. On the other hand, a replica of the Marconi 100 supercomputer is developed in a virtual reality environment that allows the data from each node to be visualised at the same time.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Voxelized Fractal Descriptor for 3D Object Recognition

  • Domenech, Jose Francisco
  • Escalona, Félix
  • Gomez-Donoso, Francisco
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Escalona, Félix|||/items/3a399699-a063-4b05-a69e-694d9594a036
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
Currently, state-of-the-art methods for 3D object recognition rely in a deep learning-pipeline. Nonetheless, these methods require a large amount of data that is not easy to obtain. In addition to that, the majority of them exploit features of the datasets, like the fact of being CAD models to create rendered representation which will not work in real life because the 3D sensors provide point clouds. We propose a novel global descriptor for point clouds which takes advantage of the fractal dimension of the objects. Our approach introduces many benefits, such as being agnostic to the density of points of the sample, number of points in the input cloud, sensor of choice, and noise up to a level, and it works on real life point cloud data provided by commercial sensors. We tested our descriptor for 3D object recognition using ModelNet, which is a well-known dataset for that task. Our approach achieves 92.84% accuracy on the ModelNet10, and 88.74% accuracy on the ModelNet40.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Survey of Alzheimer’s Disease Early Diagnosis Methods for Cognitive Assessment

  • Fernández Montenegro, Juan Manuel
  • Villarini, Barbara
  • Angelopoulou, Anastassia
  • Kapetanios, Epaminondas
  • Garcia-Rodriguez, Jose
  • Argyriou, Vasileios
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
Dementia is a syndrome that is characterised by the decline of different cognitive abilities. A high rate of deaths and high cost for detection, treatments, and patients care count amongst its consequences. Although there is no cure for dementia, a timely diagnosis helps in obtaining necessary support, appropriate medication, and maintenance, as far as possible, of engagement in intellectual, social, and physical activities. The early detection of Alzheimer Disease (AD) is considered to be of high importance for improving the quality of life of patients and their families. In particular, Virtual Reality (VR) is an expanding tool that can be used in order to assess cognitive abilities while navigating through a Virtual Environment (VE). The paper summarises common AD screening and diagnosis techniques focusing on the latest approaches that are based on Virtual Environments, behaviour analysis, and emotions recognition, aiming to provide more reliable and non-invasive diagnostics at home or in a clinical environment. Furthermore, different AD diagnosis evaluation methods and metrics are presented and discussed together with an overview of the different datasets.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Visual analysis of fatigue in Industry 4.0

  • Alfavo-Viquez, David
  • Zamora Hernández, Mauricio Andrés
  • Azorin-Lopez, Jorge
  • Garcia-Rodriguez, Jose
  • Azorin-Lopez, Jorge|||/items/d43d029b-14bf-4dac-9bda-ed08e213bb1d
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
The performance of manufacturing operations relies heavily on the operators’ performance. When operators begin to exhibit signs of fatigue, both their individual performance and the overall performance of the manufacturing plant tend to decline. This research presents a methodology for analyzing fatigue in assembly operations, considering indicators such as the EAR (Eye Aspect Ratio) indicator, operator pose, and elapsed operating time. To facilitate the analysis, a dataset of assembly operations was generated and recorded from three different perspectives: frontal, lateral, and top views. The top view enables the analysis of the operator’s face and posture to identify hand positions. By labeling the actions in our dataset, we train a deep learning system to recognize the sequence of operator actions required to complete the operation. Additionally, we propose a model for determining the level of fatigue by processing multimodal information acquired from various sources, including eye blink rate, operator pose, and task duration during assembly operations.
RUA. Repositorio Institucional de la Universidad de Alicante
Research software Software (Software)

H-GAN: the power of GANs in your Hands

  • Oprea, Sergiu
  • Karvounas, Giorgos
  • Martínez González, Pablo
  • Kyriazis, Nikolaos
  • Orts-Escolano, Sergio
  • Oikonomidis, Iason
  • Garcia-Garcia, Alberto
  • Tsoli, Aggeliki
  • Garcia-Rodriguez, Jose
  • Argyros, Antonis
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Orts-Escolano, Sergio|||/items/2222768a-df75-443a-89ea-0ca8ede0e69b
We present HandGAN (H-GAN), a cycle-consistent adversarial learning approach implementing multi-scale perceptual discriminators. It is designed to translate synthetic images of hands to the real domain. Synthetic hands provide complete ground-truth annotations, yet they are not representative of the target distribution of real-world data. We strive to provide the perfect blend of a realistic hand appearance with synthetic annotations. Relying on image-to-image translation, we improve the appearance of synthetic hands to approximate the statistical distribution underlying a collection of real images of hands. H-GAN tackles not only the cross-domain tone mapping but also structural differences in localized areas such as shading discontinuities. Results are evaluated on a qualitative and quantitative basis improving previous works. Furthermore, we relied on the hand classification task to claim our generated hands are statistically similar to the real domain of hand.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A low-cost AR application to control arm prosthesis

  • Sanchez-Rocamora, Alvaro
  • Martinez-Martin, Ester
  • Costa, Angelo
  • Costa, Angelo|||/items/f4ecad24-bcc1-47f6-a263-6b525558ae6c
  • Martinez-Martin, Ester|||/items/74a8fa4f-d7ad-4df1-9b91-355b474a0cd2
This paper presents an augmented reality application to assist with myoelectric prostheses control for people with limb amputations. For that, we use the low-cost Myo armband coupled with low-level signal processing methods specifically built to control filters’ levels and processing chain. In particular, we use deep learning techniques to process the signals and to accurately identify seven different hand gestures. From that, we have built an augmented reality projection of a hand based on AprilTag markers that displays the gesture identified by the deep learning techniques. With the aim to properly train the gesture recognition system, we have built our own dataset with nine subjects. This dataset was combined with one publicly available to work with the data of 24 subjects in total. Finally, three different deep learning architectures have been comparatively studied, achieving high accuracy values (being 95.56% the best one). This validates our hypothesis that it is possible to have an adaptive platform able to fast learn personalized hand/arm gestures while projecting a virtual hand in real-time. This can reduce the adaptation time to myoelectric prostheses and improve the acceptance levels.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Review on Deep Learning Techniques for Video Prediction

  • Oprea, Sergiu
  • Martínez González, Pablo
  • Garcia-Garcia, Alberto
  • Castro-Vargas, John Alejandro
  • Orts-Escolano, Sergio
  • Garcia-Rodriguez, Jose
  • Argyros, Antonis
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Orts-Escolano, Sergio|||/items/2222768a-df75-443a-89ea-0ca8ede0e69b
The ability to predict, anticipate and reason about future outcomes is a key component of intelligent decision-making systems. In light of the success of deep learning in computer vision, deep-learning-based video prediction emerged as a promising research direction. Defined as a self-supervised learning task, video prediction represents a suitable framework for representation learning, as it demonstrated potential capabilities for extracting meaningful representations of the underlying patterns in natural videos. Motivated by the increasing interest in this task, we provide a review on the deep learning methods for prediction in video sequences. We firstly define the video prediction fundamentals, as well as mandatory background concepts and the most used datasets. Next, we carefully analyze existing video prediction models organized according to a proposed taxonomy, highlighting their contributions and their significance in the field. The summary of the datasets and methods is accompanied with experimental results that facilitate the assessment of the state of the art on a quantitative basis. The paper is summarized by drawing some general conclusions, identifying open research challenges and by pointing out future research directions.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Automatic Understanding and Mapping of Regions in Cities Using Google Street View Images

  • Rangel, José Carlos
  • Cruz, Edmanuel
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
The use of semantic representations to achieve place understanding has been widely studied using indoor information. This kind of data can then be used for navigation, localization, and place identification using mobile devices. Nevertheless, applying this approach to outdoor data involves certain non-trivial procedures, such as gathering the information. This problem can be solved by using map APIs which allow images to be taken from the dataset captured to add to the map of a city. In this paper, we seek to leverage such APIs that collect images of city streets to generate a semantic representation of the city, built using a clustering algorithm and semantic descriptors. The main contribution of this work is to provide a new approach to generate a map with semantic information for each area of the city. The proposed method can automatically assign a semantic label for the cluster on the map. This method can be useful in smart cities and autonomous driving approaches due to the categorization of the zones in a city. The results show the robustness of the proposed pipeline and the advantages of using Google Street View images, semantic descriptors, and machine learning algorithms to generate semantic maps of outdoor places. These maps properly encode the zones existing in the selected city and are able to provide new zones between current ones.
RUA. Repositorio Institucional de la Universidad de Alicante
Research software Software (Software)

UnrealROX+: An Improved Tool for Acquiring Synthetic Data from Virtual 3D Environments

  • Martínez González, Pablo
  • Oprea, Sergiu
  • Castro-Vargas, John Alejandro
  • Garcia-Garcia, Alberto
  • Orts-Escolano, Sergio
  • Garcia-Rodriguez, Jose
  • Vincze, Markus
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Orts-Escolano, Sergio|||/items/2222768a-df75-443a-89ea-0ca8ede0e69b
Synthetic data generation has become essential in last years for feeding data-driven algorithms, which surpassed traditional techniques performance in almost every computer vision problem. Gathering and labelling the amount of data needed for these data-hungry models in the real world may become unfeasible and error-prone, while synthetic data give us the possibility of generating huge amounts of data with pixel-perfect annotations. However, most synthetic datasets lack from enough realism in their rendered images. In that context UnrealROX generation tool was presented in 2019, allowing to generate highly realistic data, at high resolutions and framerates, with an efficient pipeline based on Unreal Engine, a cutting-edge videogame engine. UnrealROX enabled robotic vision researchers to generate realistic and visually plausible data with full ground truth for a wide variety of problems such as class and instance semantic segmentation, object detection, depth estimation, visual grasping, and navigation. Nevertheless, its workflow was very tied to generate image sequences from a robotic on-board camera, making hard to generate data for other purposes. In this work, we present UnrealROX+, an improved version of UnrealROX where its decoupled and easy-to-use data acquisition system allows to quickly design and generate data in a much more flexible and customizable way. Moreover, it is packaged as an Unreal plug-in, which makes it more comfortable to use with already existing Unreal projects, and it also includes new features such as generating albedo or a Python API for interacting with the virtual environment from Deep Learning frameworks.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A kinematic, imaging and electromyography dataset for human muscular manipulability index prediction

  • Hernández, Óscar G.
  • Lopez-Castellanos, Jose M.
  • Jara, Carlos A.
  • Garcia, Gabriel J.
  • Úbeda, Andrés
  • Morell, Vicente
  • Gomez-Donoso, Francisco
  • Garcia, Gabriel J.|||/items/2b8f4866-a3e0-4391-adb2-de533e354ac1
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
  • Jara, Carlos A.|||/items/387c7e81-c049-4b46-b137-71b2825b3d93
  • Morell, Vicente|||/items/a1826a44-be50-4f9a-b418-dbd1c3e55ddc
  • Úbeda, Andrés|||/items/8962ce22-d9b2-4394-bf1a-beead95d4208
Human Muscular Manipulability is a metric that measures the comfort of an specific pose and it can be used for a variety of applications related to healthcare. For this reason, we introduce KIMHu: a Kinematic, Imaging and electroMyography dataset for Human muscular manipulability index prediction. The dataset is comprised of images, depth maps, skeleton tracking data, electromyography recordings and 3 different Human Muscular Manipulability indexes of 20 participants performing different physical exercises with their arm. The methodology followed to acquire and process the data is also presented for future replication. A specific analysis framework for Human Muscular Manipulability is proposed in order to provide benchmarking tools based on this dataset.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Hand Motor Skills Rehabilitation for the Injured Implemented on a Social Robot

  • Gomez-Donoso, Francisco
  • Escalona, Félix
  • Nasri, Nadia
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Escalona, Félix|||/items/3a399699-a063-4b05-a69e-694d9594a036
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
In this work, we introduce HaReS, a hand rehabilitation system. Our proposal integrates a series of exercises, jointly developed with a foundation for those with motor and cognitive injuries, that are aimed at improving the skills of patients and the adherence to the rehabilitation plan. Our system takes advantage of a low-cost hand-tracking device to provide a quantitative analysis of the performance of the patient. It also integrates a low-cost surface electromyography (sEMG) sensor in order to provide insight about which muscles are being activated while completing the exercises. It is also modular and can be deployed on a social robot. We tested our proposal in two different facilities for rehabilitation with high success. The therapists and patients felt more motivation while using HaReS, which improved the adherence to the rehabilitation plan. In addition, the therapists were able to provide services to more patients than when they used their traditional methodology.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

UrOAC: Urban Objects in Any-light Conditions

  • Gomez-Donoso, Francisco
  • Moreno Martínez, Marcos
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
In the past years, several works on urban object detection from the point of view of a person have been made. These works are intended to provide an enhanced understanding of the environ- ment for blind and visually challenged people. The mentioned approaches mostly rely in deep learning and machine learning methods. Nonetheless, these approaches only work with direct and bright light, namely, they will only perform correctly on daylight conditions. This is because deep learning algorithms require large amounts of data and the currently available datasets do not address this matter. In this work, we propose UrOAC, a dataset of urban objects captured in a range of different lightning conditions, from bright daylight to low and poor night-time lighting conditions. In the latter, the objects are only lit by low ambient light, street lamps and headlights of passing-by vehicles. The dataset depicts the following objects: pedestrian crosswalks, green traffic lights and red traffic lights. The annotations include the category and the bounding-box of each object. This dataset could be used for improve the performance at night-time and under low-light conditions of any vision-based method that involves urban objects. For instance, guidance and object detection devices for the visually challenged or self-driving and intelligent vehicles.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

3DSliceLeNet: Recognizing 3D Objects using a Slice-Representation

  • Gomez-Donoso, Francisco
  • Escalona, Félix
  • Orts-Escolano, Sergio
  • Garcia-Garcia, Alberto
  • Garcia-Rodriguez, Jose
  • Cazorla, Miguel
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Escalona, Félix|||/items/3a399699-a063-4b05-a69e-694d9594a036
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
  • Orts-Escolano, Sergio|||/items/2222768a-df75-443a-89ea-0ca8ede0e69b
Convolutional Neural Networks (CNNs) have become the default paradigm for addressing classification problems, especially, but not only, in image recognition. This is mainly due to the high success rate they provide. Although there are currently approaches that apply deep learning to the 3D shape recognition problem, they are either too slow for online use or too error-prone. To fill this gap, we propose 3DSliceLeNet, a deep learning architecture for point cloud classification. Our proposal converts the input point clouds into a two-dimensional representation by performing a slicing process and projecting the points to the principal planes, thus generating images that are used by the convolutional architecture. 3DSliceLeNet successfully achieves both high accuracy and low computational cost. A dense set of experiments has been conducted to validate our system under the ModelNet challenge, a large-scale 3D Computer Aided Design (CAD) model dataset. Our proposal achieves a success rate of 94.37% and an Area Under Curve (AUC) of 0.978 on the ModelNet-10 classification task.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

IA-CPS: Intelligent architecture for cyber-physical systems management

  • Duque Gómez, Henry
  • Garcia-Rodriguez, Jose
  • Azorin-Lopez, Jorge
  • Tomás, David
  • Fuster-Guilló, Andrés
  • Mora, Higinio
  • Azorin-Lopez, Jorge|||/items/d43d029b-14bf-4dac-9bda-ed08e213bb1d
  • Fuster-Guilló, Andrés|||/items/0d96ca87-a50d-4788-b5d3-456c44f8a6b6
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
  • Mora, Higinio|||/items/77871521-ed51-42c5-9240-dca1930db8e5
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
Nowadays, the emergence of large-scale and highly distributed cyber-physical systems (CPSs) in applications including Internet of things (IoT), cloud computing, mobility, Big Data, and sensor networks involves that architecture models have to work in an open and highly dynamic world. This fact increasingly highlights the importance of designing real-time and intelligent CPSs that are capable of decision making. In this paper, an Intelligent Architecture model for CPS management (IA-CPS) based on online processing is proposed for this purpose. Specifically, it can manage simple and complex events based on a service-oriented architecture and directed by an event-driven architecture, using event processing technology as Complex Event Processing (CEP). The novelty of our approach relies on the fact that the proposed architecture is service-oriented, which models the functionalities of the event-driven system. This gives us the possibility to offer a flexible service catalog, allowing us to connect to the system on any kind of device and interact in different scenarios. The model has been applied to two use cases: processing images from video surveillance cameras, and processing of consumption data captured by water and energy sensors installed in end-user environments.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Three-dimensional reconstruction using SFM for actual pedestrian classification

  • Gomez-Donoso, Francisco
  • Castaño Amorós, Julio
  • Escalona, Félix
  • Cazorla, Miguel
  • Castaño Amorós, Julio|||/items/773d394b-045e-42fe-8326-a8cbd3d8d5b7
  • Cazorla, Miguel|||/items/bd003579-c106-4ca8-814b-000fe9d1b9a1
  • Escalona, Félix|||/items/3a399699-a063-4b05-a69e-694d9594a036
  • Gomez-Donoso, Francisco|||/items/13200984-24ea-4064-a994-a6defdc16d58
In recent years, the popularity of intelligent and autonomous vehicles has grown notably. In fact, there already exist commercial models with a high degree of autonomy as regards self-driving capabilities. A key feature for this kind of vehicle is object detection, which is commonly performed in 2D space. This has some inherent issues as an object and the depiction of such an object would be classified as the actual object, which is inadequate since urban environments are full of billboards, printed adverts and posters that would likely make these systems fail. In order to overcome this problem, a 3D sensor could be leveraged, although this would make the platform more expensive, energy inefficient and computationally complex. Thus, we propose the use of structure from motion to reconstruct the three-dimensional information of the scene from a set of images, and merge the 2D and 3D data to differentiate actual objects from depictions. As expected, our approach is able to work with a regular color camera. No 3D sensors whatsoever are required. As the experiments confirm, our approach is able to distinguish between actual pedestrians and depictions of them more than 87% of times in synthetic and real-world tests in the worst scenarios, while the accuracy is of almost 98% in the best case.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Deep learning-based visual control assistant for assembly in Industry 4.0

  • Zamora Hernández, Mauricio Andrés
  • Castro-Vargas, John Alejandro
  • Azorin-Lopez, Jorge
  • Garcia-Rodriguez, Jose
  • Azorin-Lopez, Jorge|||/items/d43d029b-14bf-4dac-9bda-ed08e213bb1d
  • Garcia-Rodriguez, Jose|||/items/d5bc18f8-44db-4723-b291-5849321e9e69
Product assembly is a crucial process in manufacturing plants. In Industry 4.0, the offer of mass-customized products is expanded, thereby increasing the complexity of the assembling phase. This implies that operators should pay close attention to small details, potentially resulting in errors during the manufacturing process owing to its high level of complexity. To mitigate this, we propose a novel architecture that evaluates the activities of an operator during manual assembly in a production cell so that errors in the manufacturing process can be identified, thus avoiding low quality in the final product and reducing rework and waste of raw materials or time. To perform this assessment, it is necessary to use state-of-the-art computer vision techniques, such as deep learning, so that tools, components, and actions may be identified by visual control systems. We develop a deep-learning-based visual control assembly assistant that enables real-time evaluation of the activities in the assembly process so that errors can be identified. A general-use language is developed to describe the actions in assembly processes, which can also be used independently of the proposed architecture. Finally, we generate two datasets with annotated data to be fed to the deep learning methods, the first for the recognition of tools and accessories and the second for the identification of basic actions in manufacturing processes. To validate the proposed method, a set of experiments are conducted, and high accuracy is obtained.