Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Collaborative Judgement

  • Andrejczuk, Ewa
  • Rodríguez-Aguilar, Juan Antonio
  • Sierra, Carles
In this paper we introduce a new ranking algorithm, called Collaborative Judgement (CJ), that takes into account peer opinions of agents and/or humans on objects (e.g. products, exams, papers) as well as peer judgements over those opinions. The combination of these two types of information has not been studied in previous work in order to produce object rankings. We apply CJ to the use case of scientific paper assessment and we validate it over simulated data. The results show that the rankings produced by our algorithm improve current scientific paper ranking practice based on averages of opinions weighted by their reviewers’ self-assessments. © Springer International Publishing Switzerland 2015., The first author is supported by an Industrial PhD scholarship from the Generalitat de Catalunya. This work is also supported by the CollectiveMind project (Spanish Ministry of Economy and Competitiveness, grant number TEC2013- 49430-EXP) and the COR project (TIN2012-38876-C02-01 ), Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Personalised automated assessments

  • Gutierrez, Patricia
  • Osman, Nardine
  • Sierra, Carles
Consider an evaluator, or an assessor, who needs to assess a large amount of information. For instance, think of a tutor in a massive open online course with thousands of enrolled students, a senior program committee member in a large peer review process who needs to decide what are the final marks of reviewed papers, or a user in an e-commerce scenario where the user needs to build up its opinion about products evaluated by others. When assessing a large number of objects, sometimes it is simply unfeasible to evaluate them all and often one may need to rely on the opinions of others. In this paper we provide a model that uses peer assessments to generate expected assessments and tune them for a particular assessor. Furthermore, we are able to provide a measure of the uncertainty of our computed assessments and a ranking of the objects that should be assessed next in order to decrease the overall uncertainty of the calculated assessments., This work is supported by the CollectiveMind project (funded by the Spanish Ministry of Economy and Competitiveness, under grant number TEC2013-49430-EXP) and the PRAISE project (funded by the European Commission, under grant number 318770)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Trust, negotiations and virtual currencies for a sharing economy

  • De Jonge, Dave
  • Sierra, Carles
We propose an application that allows users to request other users for help with every-day tasks. Users can pay each other for these tasks by issuing contracts in which the requester promises to return the favor in the future by performing some task for the other. Such contracts can be seen as an alternative currency, coined by the users themselves. Trust is an essential aspect of this system, as the issuer of a contract may fail to fulfill its commitments. Therefore, the application comes with a social network where users can leave comments about other users. Furthermore, our application includes a market place where users can exchange service contracts between each other, and a negotiation algorithm that can automatically trade these contracts on behalf of the user., Supported by MILESS - Ministerio de economía y competitividad - TIN2013-45039-P, CollectiveMind - Ministerio de Economía y Competitividad, CONVOCATORIA 2013 - EXPLORA, TEC2013-49430-EXP and EU project 318770 PRAISE, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Engineering Multiuser Museum Interactives for Shared Cultural Experiences

  • Confalonieri, Roberto
  • Yee-King, Matthew
  • Hazelden, Katina
  • D'Inverno, Mark
  • De Jonge, Dave
  • Sierra, Carles
  • Osman, Nardine
  • Agmoud, Leila
  • Prade, Henri
Multiuser museum interactives are computer systems installed in museums or galleries which allow several visitors to interact together with digital representations of artefacts and information from the museum׳s collection. In this paper, we describe WeCurate, a socio-technical system that supports co-browsing across multiple devices and enables groups of users to collaboratively curate a collection of images, through negotiation, collective decision making and voting. The engineering of such a system is challenging since it requires to address several problems such as: distributed workflow control, collective decision making and multiuser synchronous interactions. The system uses a peer-to-peer Electronic Institution (EI) to manage and execute a distributed curation workflow and models community interactions into scenes, where users engage in different social activities. Social interactions are enacted by intelligent agents that interface the users participating in the curation workflow with the EI infrastructure. The multiagent system supports collective decision making, representing the actions of the users within the EI, where the agents advocate and support the desires of their users e.g. aggregating opinions for deciding which images are interesting enough to be discussed, and proposing interactions and resolutions between disagreeing group members. Throughout the paper, we describe the enabling technologies of WeCurate, the peer-to-peer EI infrastructure, the agent collective decision making capabilities and the multi-modal interface. We present a system evaluation based on data collected from cultural exhibitions in which WeCurate was used as supporting multiuser interactive., This work is supported by the Collective Mind project (Spanish Ministry of Economy and Competitiveness, under Grant number TEC2013-49430-EXP), the PRAISE project (funded by the European Commission, under Grant number 388770), and the ACE project (funded by the European framework ERA-Net CHIST-ERA, under contract CHRI-001-03), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Infrastructures to Engineer Open Agent Environments by Means of Electronic Institutions

  • De Jonge, Dave
  • Rodríguez-Aguilar, Juan Antonio
  • Rosell, Bruno
  • Sierra, Carles
Electronic institutions provide a computational analogue of human institutions to engineer open environments in which agents can interact in an autonomous way while complying with the norms of an institution. The purpose of this paper is twofold. On the one hand, we lightly survey our research on coordination infrastructures for electronic institutions in the last ten years. On the other hand, we highlight the research challenges in environment engineering that we have tackled during this journey as well as promising research paths for future research on the engineering of open environments for multi-agent systems., This paper has been partially funded by the following projects: TIN2012-38876-C02-01, PRAISE (FP7-318770), CollectiveMind (TEC2013-49430-EXP), ACE (Autonomic software engineering for online Cultural Experiences), and the Generalitat of Catalunya (2014 SGR 118), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Trust-Based Community Assessment

  • Gutierrez, Patricia
  • Osman, Nardine
  • Roig, Carme
  • Sierra, Carles
In this paper we present Community Assessment (COMAS), a trust-based assessment service that helps compute group opinion from the perspective of a specific community member. We apply COMAS in the context of communities of learners, and we compute the group opinion from the perspective of the teacher. Specifically, our model relies on \emph{teacher assessments}, aggregations of \emph{student assessments} and \emph{trust measures} derived from student assessments to suggest marks to assignments that have not been assessed by the teacher. The proposed model intends to support intelligent online learning applications by 1) encouraging students to assess one another, and 2) benefiting from students' assessments. We believe the task of assessing massive numbers of students is of special interest to online learning communities, such as Massive Open Online Courses (MOOCs). Experimental results were conducted on a real classroom datasets as well as simulated data that considers different social network topologies (where we say students assess some assignments of socially connected students). Results show that our method 1) is sound, i.e. the error of the suggested assessments decreases for increasing numbers of teacher assessments; and 2) scales for large numbers of students. 2015 Elsevier Ltd. All rights reserved, This work is supported by the CollectiveMind project (Spanish Ministry of Economy and Competitiveness, under grant number TEC2013-49430-EXP), the MILESS project (Spanish Ministry of Economy and Competitiveness, under grant num- ber TIN2013-45039-P) and the PRAISE project (funded by the European Commission, under grant number 388770), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

The composition and formation of effective teams: computer science meets psychology

  • Andrejczuk, Ewa
  • Berger, Rita
  • Rodríguez-Aguilar, Juan Antonio
  • Sierra, Carles
  • Martín-Puchades, Víctor
Nowadays the composition and formation of effective teams is highly important for both companies to assure their competitiveness and for a wide range of emerging applications exploiting multiagent collaboration (e.g. crowdsourcing, human-agent collaborations). The aim of this article is to provide an integrative perspective on team composition, team formation, and their relationship with team performance. Thus, we review the contributions in both the computer science literature and the organizational psychology literature dealing with these topics. Our purpose is twofold. First, we aim at identifying the strengths and weaknesses of the contributions made by these two diverse bodies of research. Second, we aim at identifying cross-fertilization opportunities that help both disciplines benefit from one another. Given the volume of existing literature, our review is not intended to be exhaustive. Instead, we have preferred to focus on the most significant contributions in both fields together with recent contributions that break new ground to spur innovative research., This work is supported by projects CollectiveMind (funded by the Spanish Ministry of Economy and Competitiveness, under grant number TEC2013-49430- EXP), Collectiveware (TIN2015-66863-C2-1-R MINECO/ FEDER), 2017 SGR 172, and MILESS (Ministerio de Economía y Competitividad) TIN2013-45039-P Financed by FEDER. The first author is supported by an Industrial PhD scholarship from the Generalitat de Catalunya (DI-060)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

A concise review on multiagent teams: contributions and research opportunities

  • Andrejczuk, Ewa
  • Rodríguez-Aguilar, Juan Antonio
  • Sierra, Carles
The composition and formation of effective teams is crucial for both companies, to assure their competitiveness, and for a broad range of emerging applications exploiting multiagent collaboration (e.g. human-agent teamwork, crowdsourcing). The aim of this article is to provide an integrative perspective on team composition, team formation and their relationship with team performance. Thus, we review and classify the contributions in the computer science literature dealing with these topics. Our purpose is twofold. First, we intend to identify the strengths and weaknesses of the contributions made so far. Second, we pursue to identify research gaps and opportunities. Given the volume of the existing literature, our review is not intended to be exhaustive. Instead, we focus on the most recent contributions that broke new ground to spur innovative research., Work supported by Collectiveware TIN2015-66863-C2-1-R (MINECO/FEDER), CollectiveMind (MINECO TEC2013-49430-EXP), SMA (201550E040), and Gencat 2014 SGR 118. Ewa Andrejczuk is supported by an Industrial PhD scholarship from the Generalitat de Catalunya., Peer reviewed