Vídeo divulgativo creado para el canal Youtube de Digital.CSIC: http://www.youtube.com/user/DigitalCSIC, The official presentation of the first Open Peer Review Module for Institutional Repositories, developed with the collaboration of OpenAIRE2020 and the participation of a consortium of 6 partners, will be held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid. Updated information about the project is available at:
http://www.openscholar.org.uk/institutional-repositories-start-to-offer-peer-review-services/, The purpose of the meeting is to bring together representatives from main Spanish repositories, research libraries and open access advocates, the European Commission and the OpenAIRE2020 consortium, publishers, and of course researchers across all scientific areas, to demonstrate our module and to discuss the role of institutional repositories in the future of scholarly evaluation., The Open Peer Review Module Consortium include: Open Scholar, Arvo Consultores (a DSpace registered service provider), The Artificial Intelligence Research Institute of the Spanish National Research Council (IIIA-CSIC) in Catalonia, the institutional repository of the Spanish National Research Council (DIGITAL.CSIC), the repository of the Spanish Oceanographic Institute (e-IEO) and The Multidisciplinary Laboratory of Library and Computer Sciences (SECABA) in Granada., Workshop Web: https://digital.csic.es/sites/oprm/index_eng.html, This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

Workshop held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid (RJB-CSIC)., This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

Workshop held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid (RJB-CSIC)., This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

Workshop held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid (RJB-CSIC)., This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

Workshop held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid (RJB-CSIC)., This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

English and Spanish web version available., [EN] The official presentation of the first Open Peer Review Module for Institutional Repositories, developed with the collaboration of OpenAIRE2020 and the participation of a consortium of 6 partners, will be held on the 27th of Abril at CSIC Royal Botanic Garden in Madrid. The purpose of the meeting is to bring together representatives from main Spanish repositories, research libraries and open access advocates, the European Commission and the OpenAIRE2020 consortium, publishers, and of course researchers across all scientific areas, to demonstrate our module and to discuss the role of institutional repositories in the future of scholarly evaluation., [ES] Web elaborada para la presentación oficial del primer Módulo de Revisiones Abiertas para Repositorios Institucionales, desarrollado gracias al apoyo de OpenAIRE2020 y a la participación de un consorcio de 6 miembros. El objetivo de la convocatoria fue reunir a los principales repositorios institucionales de España, representantes de las bibliotecas de investigación y comunidad nacional de acceso abierto, de la Comisión Europea y de la iniciativa OpenAIRE2020, así como de editores e investigadores de todas las áreas científicas para presentar el módulo y debatir sobre el papel de los repositorios institucionales en el futuro de la evaluación científica., This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., No

Presentation at Open Repositories Conference 2016, Dublin, June 13-16, 2016. Site of the conference: http://or2016.net/., We present the first open peer review module for open access repositories. The module, designed in this first stage for integration with DSpace repositories, enables any scholar to offer a qualitative and quantitative evaluation of any research object hosted in a compliant repository. Weighted reputation metrics are calculated for individual articles, reviews, authors and reviewers. An advanced search function allows repository users to filter or sort research objects based on their reputation or the number of positive reviews. The integration of peer review in repositories promotes open scholarship by enabling a direct and transparent collaboration between authors and reviewers, and produces novel metrics directly reflecting the perceived quality of a research work by expert peers, contrary to current available metrics that only indirectly account for quality through usage statistics. The open peer review module has already been installed in two major Spanish repositories (DIGITAL.CSIC, e-IEO) with promising initial results., Peer reviewed

This work was funded by OpenAIRE 2020, EU-Horizon2020 Grant ID 643410., Peer reviewed

With the support of OpenAIRE, Open Scholar has coordinated a consortium of five partners to develop the first Open Peer Review Module (OPRM) for open access repositories. The consortium includes: 1. The institutional repository of the Spanish National Research Council (DIGITAL.CSIC); 2. The institutional repository of the Spanish Oceanographic Institute (e-IEO); 3. The Artificial Intelligence Research Institute (IIIA) in Catalonia; 4. The Multidisciplinary Laboratory of Library and Computer Sciences (SECABA) in Granada, and 5. The company of DSpace professional development and services ARVO. The project envisions the gradual conversion of existing open access repositories into fully-functional evaluation platforms that will provide the capacity needed to bring back research quality control to the community of scholars and help bridge the gap between academic institutions and publishers. The OPRM has been initially developed as a plugin for repositories using the DSpace software package, but is designed in a way that will facilitate subsequent adaptation to other repository software suites such as EPrints and Invenio. Installation of the OPRM on an institutional or other open access repository will enable the formal review of any digital research work hosted in this repository by an unlimited number of peers. Importantly, this evaluation system is open and transparent. Open means that the full text of the reviews will be publicly available along with the original research work. Transparent means that the identity of the reviewers will be disclosed to the authors and to the public. Weighted reputation metrics are calculated for individual articles, reviews, authors and reviewers. In summary, the OPRM aims to capitalize on the existing infrastructure offered by open access repositories and to enable their conversion into fully-functional evaluation platforms with associated quality metrics. This repository-based evaluation process can run in parallel to traditional journal peer review and will: 1. Enable the peer review of any research work deposited in a repository, including data, code and monographs; 2. Provide novel metrics for the quantitative assessment of research quality; 3. Create a sophisticated reputation system for reviewers; 4. Allow the weighting of reviews based on the quality of previous reviewer contributions; 5. Facilitate the selection of relevant content from digital repositories by distinguishing material that has been validated by reviewers using tags and advanced search filters, and 6. Engage the research community in an open and transparent dialogue over the soundness and usefulness of research material. The open peer review module will be tested in two major Spanish repositories: e-IEO and DIGITAL.CSIC., Con el apoyo de OpenAIRE, Open Scholar ha coordinado un consorcio de cinco entidades para desarrollar el primer módulo de evaluación para repositorios de acceso abierto (OPRM). En el consorcio participan: 1. El repositorio institucional del Consejo Superior de Investigaciones Científicas (DIGITAL.CSIC); 2. El repositorio institucional del Instituto Español de Oceanografía (e-IEO); 3. El Instituto de Investigación en Inteligencia Artificial de Cataluña (IIIA); 4. El Laboratorio Multidisciplinario de Biblioteconomía y Ciencias de la Computación en Granada (SECABA) y la empresa de desarrollo y servicios profesionales con DSpace ARVO. El proyecto prevé la conversión gradual de los repositorios de acceso abierto existentes en plataformas de evaluación totalmente funcionales que proporcionen la capacidad necesaria para recuperar el control de calidad de la investigación en favor de la comunidad de investigadores y de este modo ayudar a minimizar la brecha entre las instituciones académicas y editoriales. El OPRM se ha desarrollado, inicialmente, como un plugin para repositorios utilizando el paquete de software DSpace, pero está diseñado de forma que es fácil la adaptación a otros paquetes de software de repositorios como EPrints o Invenio. La instalación del OPRM en un repositorio de acceso abierto institucional o de otro tipo permitirá la revisión formal, por un número ilimitado de pares, de cualquier trabajo de investigación alojado en el repositorio. Es importante destacar que este sistema de evaluación es abierto y transparente. Abierto significa que el texto completo de los comentarios está disponible para el público junto con el trabajo de investigación original. Transparente significa que se proporciona, a los autores y al público, la identidad de los revisores. Se calculan métricas de reputación ponderadas para los artículos, las evaluaciones, los autores y los revisores. En resumen, el OPRM pretende capitalizar la infraestructura existente ofrecida por los repositorios de acceso abierto y permitir su conversión en plataformas de evaluación totalmente funcionales con métricas de calidad asociadas. Este proceso de evaluación basado en repositorios se puede ejecutar en paralelo al proceso tradicional de revisión por pares de cualquier revista y sus objetivos son: 1. Permitir la revisión por pares de cualquier trabajo de investigación depositado en un repositorio, incluyendo datos, software y monografías; 2. Proporcionar nuevas métricas para la evaluación cuantitativa de la calidad de la investigación; 3. Crear un sistema de reputación sofisticado de los evaluadores; 4. Permitir la ponderación de las evaluaciones basándose en la calidad de las contribuciones anteriores de los revisores; 5. Facilitar la selección del contenido relevante de los repositorios digitales distinguiendo lo que ha sido evaluado mediante etiquetas y filtros de búsqueda avanzada, y 6. Involucrar a la comunidad de investigadores en un diálogo abierto y transparente sobre la solidez y utilidad del material de investigación. El módulo de revisión por pares en abierto se va a testar en dos grandes repositorios españoles: e-IEO y DIGITAL.CSIC., OpenAIRE, Peer reviewed

Research productivity is increasing at an unprecedented rate. Technological innovations, a
surge in available computing power, and the ease with which digital information is stored and
communicated is helping researchers to cross experimentation boundaries, to increase data
availability, and to facilitate the transfer of knowledge. As a result, traditional research is being
transformed into a dynamic and globally interconnected effort where ideas, tools and results
can be made instantly accessible to the entire academic community. Institutional and
multidisciplinary open access repositories play a crucial role in this emerging landscape by
enabling immediate accessibility to all kinds of research output.
One important element still missing from open access repositories, however, is a quantitative
assessment of the hosted research items that will facilitate the process of selecting the most
relevant and distinguished content. Common currently available metrics, such as number of
visits and downloads, do not reflect the quality of a research work, which can only be assessed
directly by peers offering their expert opinion together with quantitative ratings based on
specific criteria.
To address this issue we developed an Open Peer Review Module (OPRM) to be installed
on existing open access repositories and offered as an overlay service. Any digital research
work hosted in a compliant repository can then be evaluated by an unlimited number of
peers who offer not only a qualitative assessment in the form of text, but also quantitative
measures that are used to build the reputation of the research work and its authors. Crucially,
this evaluation system is open and transparent. By open we mean that the full text of the
peer reviews are publicly available along with the original research work. By transparent we
mean that the identity of the reviewers is disclosed to the authors and to the public. In our
model, openness and transparency are two elemental aspects we consider necessary to address
the issue of biased or non-expert opinions, which is inherent in the anonymous peer review
model, characterized by the unaccountability of reviewers.
Importantly, our open peer review module includes a reviewer reputation system based
on the assessment of reviews themselves by other peer reviewers. This allows a sophisticated
scaling of the importance of each review on the overall assessment of a research work, based
on the reputation of the reviewer.
The implementation of a peer review layer on top of institutional repositories could have the
potential to transform the current academic publication landscape by introducing new
scholarly workflows where a research item can be openly evaluated by the world’s experts
right at the institutional repository of its authors, before being submitted to an academic
journal. This workflow challenges the current practices of peer review research evaluation. In
most cases, journals, acting as brands in a competitive market, foster academic competition
for a limited number of publication slots, instead of promoting open scholarship and
collaboration. The integration of peer review in repositories will enable direct and
transparent academic collaboration between authors and reviewers. In addition, the use
of the OPRM will produce novel metrics directly reflecting the perceived quality of a
research work by expert peers, contrary to current available altmetrics that only indirectly
account for quality through usage statistics., This work was funded by OpenAIRE 2020. EU-Horizon2020 Grant ID 643410. http://www.repositorio.ieo.es/e-ieo/handle/10508/10508, Peer reviewed

One important element missing from open access repositories is a quantitative assessment of the hosted research items that will facilitate the process of selecting the most relevant and distinguished content. Common currently available metrics, such as number of visits and downloads, do not reflect the quality of a research product, which can only be assessed directly by peers offering their expert opinion together with quantitative ratings based on specific criteria.

To address the aforementioned situation, the open peer review module, OPRM, can be installed to existing Dspace institutional or other repositories and offered as an overlay service. Digital research works hosted in these repositories could then be evaluated by an unlimited number of peers that would offer not only a qualitative assessment in the form of text, but also quantitative measures that will be used to build the work’s reputation. Importantly, this evaluation system will be open and transparent. By open we mean that the full text of the peer reviews will be publicly available along with the original research work. By transparent we mean that the identity of the reviewers will be disclosed to the authors and to the public. In our model, openness and transparency are two elemental aspects we consider necessary to address the issue of biased or non-expert opinions, which is inherent in the anonymous peer review model, characterized by the unaccountability of reviewers.

Important to notice, OPRM includes a reviewer reputation system based on the assessment of reviews themselves by other peer reviewers. This allows a sophisticated scaling of the importance of each review on the overall assessment of a research work, based on the reputation of the reviewer, OpenAIRE, Peer reviewed

Nota de prensa, Para convertir gradualmente los repositorios de acceso abierto en plataformas de evaluación abiertas y transparentes, el consorcio del que forma parte e-IEO (Open Scholar, e-IEO, DIGITAL.CSIC, IIIA, SECABA y ARVO) ha desarrollado, con el apoyo de OpenAIRE, el Open Peer Review Module (OPRM), el primer módulo de evaluación científica por pares en abierto para repositorios institucionales de acceso abierto. El OPRM cuenta con métricas de calidad asociadas, se va a testar en e-IEO y DIGITAL.CSIC y será presentado a la comunidad científica en el mes de abril., To gradually convert the open access repositories into open and transparent evaluation platforms, the consortium which the e-IEO is part of (Open Scholar, e-IEO, DIGITAL.CSIC, IIIA, SECABA and ARVO) has developed, together with the support of OpenAIRE, the Open Peer Review Module (OPRM), the first scientific assessment by peers module for institutional open access repositories. The OPRM has associated quality metrics, will be tested in e-IEO and DIGITAL.CSIC and will be presented to the scientific community in April., Peer reviewed