Title: Mobile robotics for surveillance using deep learning techniques

Funded by: Agencia Estatal de Investigación - Ministerio de Ciencia, Innovación y Universidades

Duration: Desde 01/09/2024 hasta 31/12/2027

Description: The project proposes the use of mobile robots for the automatic surveillance of premises, including indoor and outdoor areas and for the identification of risk situations in challenging operation conditions, with the common philosophy of using AI tools for the robust approach to these issues. Currently, these tasks are carried out by specialized personnel, with the help of cameras located in fixed positions. We propose to achieve much more effective surveillance through mobile robots that can patrol the areas to be monitored and use different types of sensors (visible spectrum cameras, infrared cameras, laser range sensors, etc.) to detect both risk elements and situations. It is expected that the results of this project can be relevant both for security companies and for the State security forces and bodies.

To achieve this goal, the project is structured into two main objectives. The first one consists in the development of algorithms for the navigation of mobile robots in large social environments and in challenging operation conditions. The second will address the perception and integration of technologies for interpretation of the environment and the resolution of security and surveillance tasks with mobile robots. Both objectives are fully aligned with current research trends in mobile robotics and sensory perception and the research team plans to contribute to the generation of knowledge in these areas.

In addition, the proposal also provides solutions to specific problems in the thematic priority "Digital world, industry, space and defense", since it pursues the digitalization of tasks related to improving the security of venues, infrastructures, buildings and industrial facilities. The fact of using mobile robots gives the proposal great capacity and versatility to detect risk situations. However, this requires that the methods developed within the framework of the two objectives expressly take into account the specificities of this kind of applications. In this way, the project addresses, among other tasks: (a) the creation of maps of extensive environments, indoors and outdoors, with useful semantic information for security and surveillance tasks, including the systematic exploration of a priori unknown environments, (b) the location of the robot itself (both indoors and outdoors, including adverse lighting conditions) and the alarms or risk situations detected from the fusion of sensory information, (c) the planning of trajectories for surveillance, carrying out sweeps of the assigned areas, paying special attention to critical points and boundaries of the enclosure and in collaboration with the human operator, (d) the interpretation of the environment based on sensory data, with special attention to critical elements for security tasks and to the risk situations detected, such as fire outbreaks or people falling. In addition to the development of these algorithms designed to address the specificities of this type of applications, the work plan contemplates the integration and implementation of a common graphical interface that shows the created map, the estimated position of the robot and the alarms, intrusions or elements potentially dangerous detected and that will allow interaction with the operator, so that he of she can influence the task carried out by the mobile robot.

Grant funded by Agencia Estatal de Investigación - Ministerio de Ciencia, Innovación y Universidades and by the European Union.

This website is part of the project PID2023-149575OB-I00, funded by MICIU/AEI/10.13039/501100011033 and by FEDER, UE.

Keywords: Mobile robot, visual perception, point cloud, deep learning, sensor fusion, localization, mapping, environment interpretation

Head Researcher: A. Gil, L. Payá

More Information...     

Title: Development of an intelligent surveillance and security infrastructure system based on mobile robots

Funded by: AVI (Agència Valenciana de la Innovació)

Duration: 01/2023 - 12/2025

Description: The project focuses on the use of terrestrial mobile robots for the surveillance of indoor and outdoor environments, access control and people identification. It is proposed the realization of technological developments that digitize and automate the tasks of surveillance of buildings and infrastructures by means of mobile robots aided by artificial intelligence techniques. The project considers the development of a complete surveillance system that will integrate: a set of intelligent mobile robots equipped with sensors, a human-machine interface software system that will allow efficient interaction between operators and robots and, finally, a wireless communications system that will allow the exchange of information in the system.

The developed system can be exploited by security companies for the surveillance of indoor or outdoor environments or by law enforcement agencies. During the course of the project, a demonstration system will be created to validate this application and make it ready for a level close to the market. In this way, the aim is to reduce uncertainties about the technical and commercial viability of this technology. The demonstrators will make it possible to test the operation of the monitoring system under real operating conditions and will also make it possible to present the product to companies interested in its commercial exploitation.

This project with reference INNVA1/2023/61 has been funded by the Valencian Innovation Agency.

Keywords: Mobile robots, visual perception, multisensory fusion, infrastructure surveillance

Head Researcher: Arturo Gil, Luis Payá

More Information...     

Title: Hybrid Robots and Multisensory Reconstruction for Applications in Lattice Structures (HyReBot)

Funded by: Ministerio de Ciencia e Innovación

Duration: 09/2021 - 08/2024

Description: The use of reticular structures, which are composed of a number of beams or bars closely intertwined, is widespread nowadays in the construction of all types of fastening and support components for different infrastructures. They are especially indicated in metal bridges but also in roofs of hangars and spacious industrial buildings. They are generally formed by a set of highly interlinked and interconnected bars, joined together by nodes (either rigid or articulated), forming a three-dimensional structural mesh. The execution of both inspection and maintenance tasks on this type of reticular structures is especially challenging owing to (a) the access problems because of the high interconnection of the bars through the nodes and (b) the complexity of going through paths that permit moving from one starting point to a target point while traversing these structural nodes.

Aerial vehicles have been considered along the past few years as a possible solution to automate these inspection and maintenance tasks on reticular three-dimensional structures. However, the high complexity of such structures (often including narrow gaps between nodes and bars and with a strongly heterogeneous distribution) limits the use of this type of aerial vehicles, since they could not enter the different internal locations of the structure that are not easily accessible. Another of the limitations of this type of vehicles is their limited manipulation capacity while they are in the air.

The present research project focuses on this field. The project will explore the possibility of using robotic units that can move along these reticular structures in such a way that they can navigate through them with 6 degrees of freedom and traverse the reticular nodes present in them, regardless of their arrangement, layout and 3D configuration of the mesh. To address these inspection and / or maintenance tasks, this research project proposes the analysis, design and implementation of hybrid robots. They will consist of simple modules with few degrees of freedom, either with serial or parallel structure, designed in such a way that, when combined into hybrid robots, they can effectively navigate through these reticular structures despite all the challenging issues they present. In addition to analyzing these robots in depth, both from the kinematic and dynamic point of view, we propose to analyze and demonstrate their ability to navigate through such reticular workspaces, negotiating any possible arrangement of reticular nodes present in such structures.

Finally, it is essential to have a sufficiently precise model of the reticular structure in which these modular robots have to operate and to estimate efficiently their position and orientation in this environment. Considering the experience of the members of the research team in previous projects, the present project also proposes performing the reconstruction of these environments (three-dimensional grid structures), based on the fusion of the information provided by both range and visual sensors in a 360o field of perception around the robot. To achieve this objective, deep learning techniques will be used to efficiently process the high amount of data provided by the sensors.


Project PID2020-116418RB-I00 funded by MCIN/AEI/10.13039/501100011033.

Keywords: Hybrid robots, visual perception, sensor fusion, reticular structures

Head Researcher: L. Payá, O. Reinoso

More Information...     

Title: Towards Further Integration of Intelligent Robots in Society: Navigate, Recognize and Manipulate

Funded by: GENERALITAT VALENCIANA

Duration: 01/2021 - 12/2024

Description:

In recent years, the number of robots used to perform tasks autonomously in multiple fields and sectors has gradually increased. Today, we can find robots performing repetitive tasks in controlled environments, addressing complex and sometimes dangerous tasks. However, having robots perform tasks in uncontrolled environments with the presence of objects and moving elements (such as people and other robots) and requiring the need to move between different points in the scene presents notable challenges that need to be addressed to enable greater integration of robots in such scenarios.

This research project aims to tackle activities within this scope in three specific lines: navigation, recognition, and manipulation, in order to advance the integration of robots and the performance of tasks in these environments. On one hand, it is necessary to consider the presence of humans in these social environments, as their possible movements and behavior will affect how robots should move and, ultimately, navigate within these scenarios. Additionally, there is a need to advance in the tasks of environment recognition, identifying the scenarios to make the localization of robots within them more robust and precise. Finally, the problem of object manipulation by these robots will be addressed, considering both the flexibility in shape and the deformability of these objects.

Project PROMETEO 075/2021 is funded by the Consellería de Innovación, Universidades, Ciencia y Sociedad Digital de la Generalitat Valenciana

Head Researcher: Oscar Reinoso

More Information...     

Title: Development of intelligent mobile technologies to address security tasks and surveillance indoors and outdoors

Funded by: Agencia Estatal de Investigación. Ministerio de Ciencia e Innovación

Duration: 12/2022 - 11/2024

Description: This project proposes using mobile robots and machine learning technologies to carry out surveillance and security tasks in indoor and outdoor environments. During the course of the project, it is expected to generate scientific knowledge and carry out technological developments that digitize and automate the tasks of surveillance of buildings, infrastructures and industry. Such developments are expected to have potential of technology transfer to security companies, State security forces and emergency units.

Currently, these tasks are carried out by specialized personnel, with the aid mainly of cameras located in fixed positions and cctv systems. In this project, it is proposed to perform this surveillance in a much more effective way and more safely for these personnel, with the support of cooperating mobile robots that can patrol the areas to be monitored and use different types of sensors (omnidirectional vision cameras, infrared cameras, laser range and proximity sensors) and sensor fusion technologies to address two major problems: (a) robot navigation through the environment to be monitored, including building a model or map, localization and trajectory planning and (b) interpretation of the environment so that suspicious objects, intrusions by unauthorized personnel and other potentially dangerous situations such as fire sources and overheating in facilities can be detected. The project includes the creation of an intuitive graphical interface that allows the user to interact with the robots and maps created, know the alarms that have been generated and influence the task carried out by the robots.

Both the cooperation between the robots themselves and the cooperation between the potential remote operator and the robots is critical to effective surveillance. It is a cutting-edge technological aspect with great development in current international research works. Other technologies involved in the project, such as object and person recognition, deep learning and autonomous robot navigation, are also among the most developed today. The proposing research group has a consolidated track record and extensive experience in the fields of mobile robotics, machine learning, image processing and sensor fusion.

Therefore, the proposed idea is framed within the field of digital transition and seeks to improve and enhance technology to apply it to security and surveillance tasks in buildings, infrastructures and facilities. The main goal of the project is to ameliorate the quality of the work of security employees and improve the competitiveness of security companies. In particular, the use of mobile robots is proposed in situations in which the use of static security cameras is inappropriate or insufficient, or to serve as support and assistance to existing security personnel. A use case will be, for example, the surveillance of large areas of land in adverse conditions (cold, extreme heat). In addition, the mobile robots will be equipped with sensors that will allow the detection of intrusions or security failures in low or no lighting conditions. The proposal also aims to have a minimum ecological impact, as it will use highly efficient electric mobile robots.


This project has been founded by Agencia Estatal de Investigación. Ministerio de Ciencia e Innovación

  

Keywords: Mobile robot, computer vision, image processing, sensor fusion, robot navigation, deep learning

Head Researcher: A. Gil, L. Payá

More Information...     

Title: Análisis inicial de herramientas de IA para la predicción de la malignización de las gammapatías de significado incierto a mieloma múltiple u otras patologías linfoproliferativas

Funded by: Generalitat Valenciana

Duration: 01/2023 - 12/2023

Description: Existe el riesgo de progresión de pacientes con gammapatía monoclonal de significado incierto a Mieloma Múltiple. Aunque se conocen clasificaciones basadas en el riesgo de evolución a cáncer, hay que realizar controles médicos de por vida para detectar la evolución hacia la malignización de las gammapatías. Se explorarán los datos existentes y se realizará un análisis inicial del funcionamiento de diversas herramientas de IA, para establecer la capacidad de predicción de cada una de ellas.


Proyecto financiado por la Consellería de Innovación, Universidades, Ciencia y Sociedad Digital de la Generalitat Valenciana

Head Researcher: L. Payá

More Information...     

Title: Securing manipulator robots with free-swinging joint failures by extinguishing their uncontrolled self-movements

Funded by: CONSELLERIA DE INNOVACIÓN, UNIVERSIDADES, CIENCIA Y SOCIEDAD DIGITAL

Duration: 1/1/22-31/12/23

Description:

In this project we propose to develop a method to control robots that have suffered such free swing failure, in order to lock the underactuated robot without using redundant actuators or brakes, safely suppressing its uncontrolled free swing movements. The proposed method consists of varying the healthy actuated joints until the self-motion motions of the underactuated robot degenerate to a point. Such self-motion varieties are higher-dimensional curves, surfaces, and analogs, and their shape and size change as the healthy actuated joints move. Since uncontrolled motions of an underactuated robot occur along such self-motion moieties, making such moieties degenerate at a point effectively suppresses such uncontrolled motions, since the range of uncontrolled motion of the robot is reduced to a single point.

Keywords: Parallel robot, underactuated, redundant, self-moving varieties, free swing failure, torque failure

Head Researcher: Adrián Peidró

More Information...     

Title: Planning of robotic movements in metallic structures

Funded by: Universidad Miguel Hernández de Elche

Duration: 01/01/2021 - 31/12/2022

Description:

Nowadays, we encounter three-dimensional metallic lattice structures in numerous artificial constructions, such as stadiums, high-voltage or telecommunications towers, airports, construction sites, pipeline networks in refineries, nuclear power plants, and aerospace constructions. These structures, composed of interconnected bars forming genuine metallic networks, require periodic inspection and maintenance to preserve their good condition and functionality and to prevent their structural stability from being compromised by deterioration. Examples of the required tasks include coating the metallic bars of the structure with protective paints to prevent corrosion, non-destructive inspection to detect possible cracks and welding defects, and tightening threaded joints, among others.

Traditionally, these tasks have been performed by human operators who, equipped with safety mechanisms such as harnesses, have to climb the structure and carry out the aforementioned operations. Despite the possible safety measures that can be adopted, performing these operations is dangerous for humans, who are subjected to significant safety and health risks. In order to avoid these dangers to human operators, the possibility of performing these hazardous tasks at height using robots (autonomous or teleoperated) has been pursued over the past three decades. In this project, the objective is to plan movements that a hybrid robot can perform so that it can navigate through these structures and pass through the structural nodes, attaching itself appropriately to carry out inspection and maintenance tasks.

Head Researcher: Oscar Reinoso Garcia

More Information...     

Title: Recognition and modeling of lattice structures (ModRet)

Funded by: Universidad Miguel Hernández de Elche

Duration: 2 años

Description:

The project focuses on the creation of models of lattice structures. These types of structures are found in numerous constructions and require continuous maintenance. This maintenance can be automated using a mobile robot capable of moving through the structure. However, to undertake this task, the robot must have a model of the structure that allows it to know its position and plan the appropriate trajectory and sequence of movements to reach the target point. To create this model, the robot will collect information as it moves along the structure for the first time, using its equipped sensors (primarily omnidirectional vision systems).

Modeling these types of structures presents several differential aspects compared to other environments, such as their symmetry and the presence of repetitive visual structures, the wide variety of viewpoints from which they can be observed depending on the robot's trajectory, and the changes their appearance may undergo due to repairs carried out by the robot. Considering these characteristics, the model will be given a hierarchical structure, with a high-level layer containing information about the topology of the structure, and one or more low-level layers with data about the bars and nodes, such as their shape, width, planes that compose the bars, and node topology. Artificial intelligence and deep learning techniques will be used for scene description and extraction of relevant information. These tools will separate the information surrounding the structure and its conditions (such as lighting conditions) from the information of the lattice surrounding the robot (bars and nodes). Additionally, algorithms will be implemented for incremental model creation, updating it as the robot advances and captures new information about the structure.

Head Researcher: L. Payá

More Information...     

Title: Control of parallel robots that have suffered torque failure

Funded by: Universidad Miguel Hernández, Vdo. de Investigación

Duration: 1/1/22-31/12/22

Description:

Keywords: variety of self-motion, parallel, underactuated robot

Head Researcher: Adrián Peidró

More Information...     

Title: Design and study of computational torque regulators for traversing singularities in parallel robots

Funded by: CONSELLERIA DE INNOVACIÓN, UNIVERSIDADES, CIENCIA Y SOCIEDAD DIGITAL, Generalitat Valenciana

Duration: 01/01/2021-31/12/2021

Description:

Parallel robots control the movement of their end-effector or gripper through multiple kinematic chains connected in parallel, forming closed kinematic chains. This provides them with greater structural rigidity and dynamic performance, but it also limits their workspace and divides it into different regions separated by parallel-type singularities (also known as type 2 singularities) that do not exist in serial or open kinematic chain robots. When the robot crosses one of these singularities, it is not possible to control the movement of its end-effector in any arbitrary direction, requiring infinitely large actuation torques in the actuators. This makes it difficult to cross such singularities to fully utilize the robot's workspace.

In previous works, other researchers have avoided the divergence of actuation torques by designing the end-effector's trajectory so that, when crossing the singularity, the robot's dynamic model does not degenerate, satisfying a non-degeneration condition derived by other researchers in the past. The drawback is that the trajectory used to cross the singularity cannot be arbitrary; it must be designed to meet the mentioned non-degeneration condition.

In this project, we propose the design of new Computed-Torque Control laws that allow crossing the mentioned parallel singularities while avoiding the divergence of the actuation torques, so that they remain finite during the crossing of the singularity, and additionally avoiding the need to design the trajectory to achieve this, thus allowing arbitrary trajectories. To achieve this in the present project, we propose considering the small modeling errors that always occur when modeling the dynamics of the robot to be controlled. These small errors cause the tracking of the desired trajectory to be imperfect, which provides some margin to meet the non-degeneration condition simply by adjusting the proportional and derivative gains of the regulator, leaving the trajectory completely free. The proposed control will be tested in this project through simulation with example parallel robots, and also through testing on real parallel robots.

Project funded by the Department of Innovation, Universities, Science, and Digital Society of the Generalitat Valenciana.

Keywords: parallel robot, singularity, computational torque control

Head Researcher: Adrián Peidró

More Information...     

Title: Scene Reconstruction from Omnidirectional Cameras Using Visual Appearance Techniques and Deep Learning

Funded by: Generalitat Valenciana

Duration: 01/2020 - 12/2020

Description:

Keywords: Deep learning, scene reconstruction, localization, omnidirectional vision

Head Researcher: M. Ballesta

More Information...     

Title: Hierarchical model creation and robust localization of mobile robots in social environments

Funded by: Generalitat Valenciana

Duration: 01/01/2019 a 31/12/2020

Description: The project focuses on the field of map construction and localization using omnidirectional vision, advancing towards a hybrid topological-metric paradigm, which allows (a) the incremental construction of a semantic map as the robot explores the unknown environment and (b) the estimation of the robot's position and orientation with precision, with 6 degrees of freedom and at a reasonable computational cost. Additionally, to improve the integration of the mobile robot in real social environments, where it must interact with people, some features will be included in the model to make it compatible with human perception.

Thus, the proposal aims to go beyond the concept of multi-level hierarchical localization, adapting it to extensive and complex social environments, and including collaboration with users through high-level commands. This proposal is organized around two main lines of research:

- Line A: Incremental creation of hybrid metric-topological maps from the global appearan ce of a set of scenes.
- Line B: Construction of environment models that allow localization with 6 degrees of freedom from visual information.

Keywords: Mobile robot; omnidirectional vision; hybrid map; hierarchical localization; social environments

Head Researcher: L. Payá

More Information...     

Title: Map Building by Means of Appearance Visual Systems for Robot Navigation

Funded by: CICYT Ministerio de Ciencia e Innovación

Duration: 01/01/2017 al 31/12/2019

Description: In order to be truly autonomous, a mobile robot should be capable of navigating through any kind of environment while carrying out a task. In order to do that it is considered necessary that the robot possesses the ability to create a model of its workspace that allows to estimate its position inside it and navigate along a trajectory.
 
Map building and navigation is currently a very active research area, in which a large number of researchers focus on and where very different approaches have emerged based on diverse algorithms and using various kind of sensorial information. To the present days, most of the efforts have been focusing on construction of models of the environment based on a set of significant points extracted from it without considering the global appearance of the scene.
 
Considering the concepts posed above, we propose the improvement and development of new mechanisms that allow an efficient, robust and precise modelling of the environment by making use of omnidirectional vision systems. The research group has experience in the mentioned areas and during the last years has developed different approaches in the areas of map building, localization, exploration and SLAM by means of information gathered by different kind of vision systems installed on the robots. In order to carry out these approaches, an extensive study of the different description methods has been performed, both based on the extraction of significant points and local descriptors and also those methods based on the global appearance of the image, with remarkable results.

Keywords: Mobile robots, autonomous navigation, computer vision, omnidirectional systems

Head Researcher: L. Payá, O. Reinoso

More Information...     

Title: Design and development of a hybrid structure robot with binary-operated hydraulic actuators.

Funded by: Generalitat Valenciana

Duration: Del 01/01/2018 al 31/12/2019

Description:

Steel structures require inspection, maintenance, and repair tasks to ensure their proper functioning, stability, structural integrity, longevity, and aesthetic quality. Such structures are present in numerous constructions such as bridges, ports, airports, telecommunications towers, stadiums, power lines, power plants, and industrial plants, as well as forming part of the framework of most buildings. Typically, the maintenance tasks for these vertical structures are performed by human operators who must climb the structures to carry out these tasks, subjecting them to serious risks, including falling from considerable heights or electrocution. To avoid exposing human operators to such risks, for the past couple of decades, numerous researchers worldwide have been studying the possibility of using climbing robots to perform these dangerous tasks at height.

The main objective we propose in this project is to develop a new articulated climbing robot for the exploration and maintenance of vertical steel structures, with the ability to move in three-dimensional space. The main innovation of the robot to be developed in this project, compared to other climbing robots developed to date, is that the proposed robot will have binary actuation (all-or-nothing actuators), which greatly simplifies the planning and control of its movements. Additionally, the robot to be developed will have a moderately high degree of kinematic redundancy (between 10 and 12 degrees of freedom), allowing it to enjoy sufficiently high mobility to explore three-dimensional structures despite having only binary actuators. In this way, by combining binary actuation and kinematic redundancy, we aim to achieve a balance between simplicity and freedom of movement, thereby addressing the main complexity issues that currently prevent climbing robots from being used more extensively.

Keywords: climbing robot, binary operation

Head Researcher: M. Ballesta

More Information...     

Title: Robotic Navigation in Dynamic Environments by means of Compact Maps with Global Appearance Visual Information

Funded by: CICYT Ministerio de Ciencia e Innovación

Duration: 01/09/2014 al 31/05/2017

Description: Carrying out a task by a team of mobile robots that move across an unknown environment is one of the open research lines with a higher scope for a large development in the mid-term. In order to accomplish this task it has been proved necessary to possess a highly detailed map of the environment that will allow the localization of the robots as they execute a particular task. During the last years the proposer research team has worked with remarkable results in the field of SLAM (Simultaneous Localization and Mapping) with teams of mobile robots. The work has considered the use of robots equipped with cameras and the inclusion of the visual information gathered in order to build map models. So far, different kind of maps have been built, including metric maps based on visual landmarks, as well as topological maps base on global appearance-based information extracted from images.
These maps have allowed the navigation of the robots in these maps as well as the performance of high level tasks in the environment. Nonetheless, there exists space for improvement in several areas related to the research carried out so far. Currently, one of the important problems consists in the treatment of the visual information and the updating of this information as the environment changes gradually. In addition, the maps should be created considering the dynamic and static part of the environment (for example when other mobile robots or people move in the environment), thus leading to the creation of more realistic models, as well as strategies to update the maps as changes are detected. A different research line considers the creation of maps that combine simultaneously the information about the topology of the environment, as well as semantic and metric information that will allow a more effective localization of the robot in large environments and, in addition, will enable a hierarchical localization in these maps. The proposed research project considers to tackle the aforementioned lines, thus considering the task of developing dynamic visual maps that will incorporate the semantic and topological structure of the environment, as well as the metric information when the robots perform trajectories with 6 degrees of freedom.

Keywords: Mobile Robots, Visual Maps, Topological and Compact Navigation, Visual SLAM

Head Researcher: A. Gil, O. Reinoso

More Information...     

Title: Localization and Visual Map Creation for Robot Navigation with 6 DOF

Funded by: Generalitat Valenciana

Duration: Enero 2015 - Dic 2016

Description:

Keywords: Visual SLAM, Robotics

Head Researcher: L.M. Jiménez

More Information...     

Title: Topological mapping using the global appearance of a set of images

Funded by: Generalitat Valenciana

Duration: 01/01/2015 - 31/12/2016

Description:

When a mobile robot performs a task within a given environment, it needs to have some knowledge of that environment to effectively carry out the task. Generally, the environments in which robots operate are unstructured, complex, and changing. Thus, it is crucial to create models of these environments based on the information and observations captured by the robots within them to ensure effective localization. This is the focus of the project proposal.

The main objective we propose is to solve the problem of creating maps of an unknown environment, using the information provided by a vision system installed on the robot exploring the environment. The traditional approach to solving such problems involves extracting local features from scenes and creating metric maps in which the robot's position can be estimated relative to a global reference system, with an associated error. In contrast to this approach, we propose using the global appearance information of scenes to create topological maps, which contain information about the locations that make up the environment and the connectivity relationships between them. These are more recent and computationally efficient alternatives that, however, require in-depth study in tasks of creating robust maps of extensive and dynamically characteristic environments.

Keywords: Omnidirectional vision, global appearance, topological map, hierarchical localization

Head Researcher: L. Payá

More Information...     

Title: Integrated Exploration of Enviroments by means of Cooperative Robots in order to build 3D Visual and Topological Maps intended for 6 DOF Navigation

Funded by: CICYT Ministerio de Ciencia e Innovación

Duration: 01/01/2011 al 31/12/2013

Description: While a group of mobile robots carry out a task, they need to find their location within the environment. In consequence a precise map of a general and undetermined environment has to be known by the robots. During the last decade a series of methods have been developed that allow the construction of the map by a mobile robot. These algorithms consider the case in which the vehicle moves along the environment, constructs the map while, simultaneously, computes its location within the map. As a result, this problem has been named Simultaneous Localization and Mapping (SLAM). This research project focusses thus on the construction of visual maps in 3D general unknown environments by using a team of mobile robots equipped with vision sensors. In this sense, we propose to undertake, among others, the following lines: 6 DOF cooperative visual SLAM, in which the robots move following general trajectories in the environment (with 6 degrees of freedom) instead of the classical trajectories in which it is assumed that the robots navigates on a two-dimensional plane; integrated exploration, where the exploration paths of the robots consider to maximize the knowledge of the environment and, at the same time, take into account the uncertainty in the maps created by the robot(s); map alginment and map fusion of local maps created by different robots; and finally, the creation of maps using the information based in the visual appearance that allows the construction of high-level topological maps.

Keywords: Robotics, Visual SLAM, Cooperative Exploration

Head Researcher: O. Reinoso

More Information...     

Title: Cooperative Mobile Visual Perception Systems as support for tasks performed by means Robot Networks

Funded by: CICYT Ministerio de Ciencia e Innovación

Duration: 1/10/2007 - 30/09/2010

Description: Performing tasks in a coordinated manner by means of a team of robots is a topic of great interest and allows to improve the results compared to the single-robot case. The current research project focuses on this particular field and proposes the need to use different vision systems distributed along the mobile agent network that gather a precise and complete description of the environment. To cope with the proposed goals it will be necessary to tackle with different research lines, in consequence, we are working on the following subjects: Cooperative map building and localization using particle filters, Visual landmark modelling: Improving data association in visual SLAM, development of cooperative exploration strategies using the information provided by each robot, cooperative reconstruction of environments using appearance based methods.

Keywords: Robots Cooperativos, SLAM visual, Exploración cooperativa, Reconstrucción basada en apariencia

Head Researcher: O. Reinoso

More Information...     

Title: Collaborative Teleoperation Tools. Application to cooperative robot control

Funded by: CICYT Ministerio de Educación y Ciencia

Duration: 12/2004 - 11/2007

Description: The present project is devoted to the development of advanced teleoperation tools focused in three main goals: a collaborative control scheme allowing one or more users to participate in the execution of tasks; cooperative control techniques for multiple robots so that they work simultaneously and helping each other; and a general, non-structured environment where there may be several moving objects whose dynamics may affect the execution of the task. Research is performed in several technological areas in order to cover the project objectives. The following developments are proposed: efficient dialog techniques between users, between robots and between both agents; cooperative control strategies, both generic and adapted to particular test-bed tasks; sensor fusion techniques in charge of the management of the data provided by the different sensors and the users; 3D scene recognition from the data acquired by each robot from a different point of view; and visual control to adapt the robot movements to the changing environment.

Keywords: cooperative robots, collaborative control, teleoperation

Head Researcher: O. Reinoso

More Information...     

Aidico-DISCO

Title: Study and analysis of disc-based cutting of natural stone by means monitoring the process

Funded by: Generalitat Valenciana

Duration: 1/1/2004 - 31/12/2005

Keywords: Stone Cutting

Head Researcher: O. Reinoso

Title: Modelling of Virtual enviroments for training in teleoperated systems for dynamic enviroments

Funded by: CICYT Ministerio de Educación y Ciencia

Duration: 28/12/2001 - 27/12/2004

Description: This research project is a continuation of a previous one (Automatic and Remote-Control Architectures Learning Systems) in which diverse tools were developed that let carry out tasks in a remote environment by means of advanced interfaces incorporation. From the designed architecture in the previous project, we have developed in the current one new research lines which focus on dynamic virtual environments incorporation to remote-control systems with the purpose that the operator can simulate the resultant effect of realise an specific action on the dynamic environment, before these actions really carry out in the remote environment.

Keywords: Teleoperation, robotics, learning, haptics, visual control

Head Researcher: O. Reinoso

More Information...     

Title: Multiaxial test system fort area yield improvement in the fabrication of leather, enhancing leather characteristics and diminishing enviromental impact

Funded by: U.E.CRAFT- Programa GROWTH

Duration: 8/2001 - 7/2003

Description: The goals of this project are Development of an appropriate mechanical device for stretching the leather and a watertight container, to carry out the thermal treatments and trials in order to determine the conditions of the water thermal treatment that gives maximum area yield (in many cases higher than 10%) on standard leather fabrication.

Keywords: Test, leather manufacturing

Head Researcher: L.M. Jiménez

More Information...     

Title: Climbing robot for plamtree and cilyndrical structures maintenance

Funded by: CICYT Ministerio de Educación y Ciencia

Duration: 1/1/2000 - 31/12/2001

Description: This project proposes the application of parallel plataforms as climbing robots, considering the great load capacity these mechanic structures own and the flexibility to evolve in a tight work space. A theoretical framework of analysis of kinematics and dynamics of this sort of robotic structures has been studied, and its applications as climbing robots.

Keywords: Teleoperation, robotics, learning, haptics, visual control

Head Researcher: O. Reinoso

More Information...     

Title: Automatic Learning systems in control architectures for Teleoperation

Funded by: CICYT Ministerio de Educación y Ciencia

Duration: 11/1998 - 12/2000

Description: This project proposes the development of a teleoperated system with a high degree of automatization which learns tasks previously done by an operator. The need of learning of task capabilities shows up from the consideration of operation in non-structured and unknown environments. In this way, in the first stage, will be the operator who shows the way a remote task must be done, and afterwards, the system must learn the specific relations that define such execution in order to repeat that task in similar conditions.

Keywords: Teleoperation, robotics, learning, computer vision

Head Researcher: O. Reinoso

More Information...     

Title: Robot application for automatic finishing of plastic injection products

Funded by: IMPIVA - en colaboración con INESCOOP

Duration: 9/1998 - 9/1999

Description: The process of shot casting generates remains (curls) caused by the division among tools that affect the final quality of the manufactured product. After this process is necessary to continue with a trimming that eliminates these previously generated remains. So, we use a robotized arm with visual sensors that makes the suitable treatment for the different tools in production possible.

Keywords: Robotics

Head Researcher: O. Reinoso

More Information...     

Title: Simulation Techniques for Resolution Enhancement in Digital Images with Pronounced Edges

Funded by: Generalitat Valenciana

Duration: 1/1/1999 - 31/12/1999

Description: One of the main problems in artificial vision is the need to increase the spatial resolution of the object images that are studied. We propose a system which is enable to detect zones of interest for the analysis inside an image and to increase the resolution in such areas.

Keywords: Computer vision, Subpixel

Head Researcher: O. Reinoso

More Information...     

Title: Convenio de Colaboración para el desarrollo del proyecto "Hacia la formación práctica ubicua y digital en robótica mediante laboratorios remotos”

Funded by: Centro de Inteligencia Digital de la Provincia de Alicante (CENID)

Duration: 6 meses (abril 2022 - octubre 2022)

Description: Este proyecto pretende desarrollar un laboratorio remoto, que consiste en una plataforma ciberfísica que permite al estudiantado de carreras técnicas conectarse a robots de forma remota, para hacer prácticas de laboratorio y experimentos con dichos robots, a través de Internet. Esto permitirá dotar al estudiantado de mayor flexibilidad espacial y temporal, permitiéndoles hacer prácticas de laboratorio de forma ubicua, sin limitarlos a tener que desplazarse a un laboratorio físico para realizar las prácticas únicamente en las horas en las que el acceso a dicho laboratorio está habilitado. El estudiantado se conectará a los robots reales a través de un servidor web y, a través de una interfaz, podrá comandar movimientos o experimentos para realizar con los robots remotos. El movimiento de los robots se mostrará a través de una webcam en tiempo real, y también se devolverá información relativa a los resultados del experimento remoto, información que será captada mediante sensores de posición, velocidad, y fuerza, colocados en el robot real. Los robots remotos que se implementarán para hacer prácticas a distancia serán de tipo paralelo o de cadena cinemática cerrada, ya que éstos disponen de mayor riqueza que los robots tradicionales de cadena cinemática serie, a la hora de ser estudiados en asignaturas de control y robótica.

Las actividades que abarcará este proyecto serán las siguientes cuatro: 1) construcción de dos robots paralelos con los que el estudiantado pueda realizar prácticas y experimentos a través de internet, 2) implementación del servidor web que gestione las reservas y el acceso remoto de los robots por parte del estudiantado, 3) la programación de interfaces gráficas de usuario que permitan al estudiantado comandar órdenes y experimentos a la vez que se observa el movimiento del robot en tiempo real a través de una webcam, y 4) diseño de prácticas y experimentos didácticos a realizar con la ayuda del laboratorio remoto desarrollado. El principal resultado esperado de este proyecto es la materialización del mencionado laboratorio remoto, que permitirá flexibilizar la realización ubicua de prácticas con robots reales a distancia, haciendo uso de las tecnologías digitales al servicio de la enseñanza y el aprendizaje.

Keywords: Robot paralelo, laboratorio remoto, prácticas de laboratorio, identificación, control

Head Researcher: Adrián Peidró

More Information...     

abionica1.20T

Title: Desarrollo de algoritmos de detección y seguimiento de marcas visuales artificiales para la navegación de drones en tareas de inspección de grandes terrenos

Funded by: ABIONICA SOLUTIONS S.L.

Duration: 11/2020 - 04/2021

Head Researcher: A. Gil

abionica1.21T

Title: Empleo de algoritmos para conciencia situacional en vuelo mediante visión artificial

Funded by: Abionica Solutions S.L.

Duration: 05/2021 - 11/2021

Head Researcher: A. Gil

ACN2020

Title: Aplicación de sistemas de visión artificial para el desarrollo de entornos de realidad aumentada y análisis estadístico de datos metrológicos

Funded by: AUTOMATICA Y CONTROL NUMÉRICO, S.L.

Duration: 2020

Head Researcher: O. Reinoso

Title: Desarrollo de un software para la detección y medición de los diferentes tonos de piel

Funded by: PIES CUADRADOS LEATHER S.L.

Duration: 2019 - 2020

Description: El objetivo de esta propuesta es el estudio, desarrollo e implementación de un sistema de clasificación mediante visión por computador de la tonalidad de piezas de cuero teñido atendiendo a la apariencia visual del tono de la piel.
 
La medida de color y clasificación de grandes piezas de cuero teñido para obtener una producción uniforme en la industria del calzado, es un problema técnico no resuelto debido a las dificultades impuestas por la alta variabilidad espacial de la tonalidad y de  la textura de la misma. En la percepción visual de la tonalidad de un producto influyen múltiples factores: iluminación, propiedades de absorción del material y la respuesta del sensor utilizado. Cada uno de estos factores está sujeto a variación tanto espacial como temporal. Los trabajos en el campo de la percepción de color  han dado lugar a una conjunto de modelos y herramientas para definir de forma univoca el color puntual respecto a unas referencias espectrales, pero la medida y percepción de diferencias de tonalidad  en materiales no uniformes, aplicados a la producción de elementos con múltiples piezas donde la compatibilidad de la apariencia visual  es determinante, es un problema mucho más complejo y sujeto todavía a estudio.
 
Sobre esta base, se propone el estudio y desarrollo de los diferentes aspectos y tecnologías aplicados a la clasificación de la tonalidad de pieles. Se propone la necesidad del estudio e implementación de descriptores de color uniformes  que permitan la medida de distancia de apariencia visual de forma robusta. El estudio de técnicas de calibración y corrección de color que permita observar las variaciones espaciales y temporales del sistema de captación y de iluminación. Adicionalmente se propone el estudio de descriptores texturales aplicables a imágenes en color y que tengan en cuenta no solo la tonalidad puntual sino la variabilidad espacial  del mismo debido a la textura del material. Se diseñarán y analizarán técnicas de clasificación y reconocimiento de patrones que permitan establecer reglas de decisión robustas. Por último se implementarán los resultados obtenidos en un sistema industrial de clasificación de pieles mediante visión por computador.

Head Researcher: O. Reinoso

More Information...     

QBot

Title: Contrato de desarrollo de software

Funded by: Q-BOT LIMITED

Duration: 2016

Head Researcher: O. Reinoso

IXION1

Title: Contrato para la realización de los trabajos de desarrollo experimental que forman parte del Proyecto presentado al Plan Avanza2 de título "iCOPILOT Asistente inteligente a la conducción"

Funded by: IXION INDUSTRY AND AEROSPACE, S.L.

Duration: 2014

Head Researcher: O. Reinoso

IXION2

Title: Contrato para la realización de los trabajos de desarrollo experimental que forman parte del proyecto presentado al Plan Avanza2 de título "SUPVERT Vehículo Autónomo Aéreo para Inspección de estructuras Verticales"

Funded by: IXION INDUSTRY AND AEROSPACE S.L.

Duration: 2014

Head Researcher: O. Reinoso

GRASS: Artificial Grass Pavements

Title: Criteria generation for the development of damping bases applied to artificial grass floorings

Funded by: Euro Grass 2002 S.L.

Duration: 2009

Head Researcher: O. Reinoso

Essay A&CN (I)

Title: Development of an acquisition system for impact absorption and deformation essays covering normative UNE 4158 IN

Funded by: Automatica & Control Numérico (A&CN)

Duration: 1/2007 - 1/2008

Head Researcher: O. Reinoso

Essay A&CN (II)

Title: Analysis and deployment of a Mechanical System or Sporting Pavement covering normative UNE 4158 IN

Funded by: Automática & Control Numérico (A&CN)

Duration: 4/2007 - 1/2008

Head Researcher: O. Reinoso

Title: Computer Vision System for tracking and recording of Rhynchophorus Ferrugineus

Funded by: Ayuntamiento de Elche - Estación PHOENIX

Duration: 4/2006 - 7/2007

Description: The goal of this project is to design and build a visual recording system that allows studying the behaviour of Rhynchophorus ferrugineus in the proximity of palm trees and traps. The system is designed to work in extreme conditions of humidity and lighting, night and day. The system includes a computer vision detector in order to perform automated recordings.

Keywords: Computer Vision, Surveyance

Head Researcher: O. Reinoso

More Information...     

MetaleX

Title: Design and implementation of electronic search system for normative in the metal sector: "Metalex"

Funded by: FEMPA

Duration: 2006 - 2007

Description: Contrato para actividades de apoyo tecnológico entre la Universidad Miguel Hernández y la Federación de Empresarios del Metal de la Provincia de Alicante (FEMPA) para el diseño e implementación de buscador electrónico de normativa en el sector del metal: "MetaleX"

Keywords: metalex, fempa

Head Researcher: D. Ubeda

Title: AutomatL@bs: remote laboratory network for education in Control Theory

Funded by: Red E-Automatica CICYT

Duration: 2007 - 2009

Description: The AutomatL@bs project is a network of virtual and remote laboratories for teaching and learning of control engineering. It is based on the integration of the hardware/software/human resources provided for the university groups taking part into this project. Shortly, AutomatL@bs provides to students two elements: web-based tools for booking time-slots in order to carry on the practical experiences and a working environment purposefully designed to ease the learning process. However, the network of remote laboratories in control engineering, AutomatL@bs, is not only the sum of its parts but it must be appreciated as a laboratory with a uniform structure regardless where the location of the physical processes is. To work in AutomatL@bs, all that a student needs is a Java-enabled browser and to be registered into the system. So, AutomatL@bs must not be considered just the simple juxtaposition of the different remote laboratories of each university taking part into the project. All the laboratories share a common working scheme and the learning materials have been carefully designed to allow students make the practical experiences in an autonomous way at their own pace. The project is coordinated by Professor Sebastian Dormido Bencomo of the Department of Computer Science and Automatic Control of the Spanish University of Distance Learning (UNED).

Keywords: Remote Laboratories, Control Systems, Education on Automation

Head Researcher: O. Reinoso

More Information...