INVESTIGACION PUBLICITADA: NUEVOS INDICADORES PARA MEDIR LOS EFECTOS DEL MARKETING OPORTUNO EN LA EVALUACION ACADEMICA

PID2022-142569NA-I00

Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+I (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2022
Unidad de gestión Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023
Centro beneficiario UNIVERSITAT POLITÈCNICA DE VALÈNCIA
Identificador persistente http://dx.doi.org/10.13039/501100011033

Publicaciones

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

How do Citizens Engage with Science. Challenges and Recommendations

Digital.CSIC. Repositorio Institucional del CSIC
  • Bautista-Puig, Nuria
  • Orduña-Malea, Enrique
Citizen science (CS) has become a crucial form of public participation in science, helping to address global challenges and contribute to more democratic knowledge production. Despite its increasing presence (including literature reviews), uncertainties persist regarding the quality of data collected, the level of citizen participation, and ethical concerns. This editorial explores CS participation, aiming to provide a comprehensive analysis of engagement patterns, and challenges, and offering recommendations to enhance citizen involvement in scientific initiatives. A systematic review of existing literature indexed on Web of Science is conducted, following the PRISMA framework. The review covered 1,613 selected studies examining ‘participation’ across various scientific fields, identifying the methodologies used and the factors influencing engagement, such as benefits, challenges, and ethical concerns. The results reveal a growing trend in CS, particularly in the natural sciences, with citizen involvement mostly limited to data collection rather than higher-level engagement like analysis or decision-making. The study also highlights the underrepresentation of social sciences and the need for more interdisciplinary approaches. In conclusion, the article calls for increased interdisciplinarity, greater integration of citizens in decision-making processes, diversification of participatory methods, and context-specific strategies for participation. It emphasizes the importance of fostering public trust and awareness in science and proposes that these actions will improve the inclusivity and impact of citizen science initiatives., This work has been supported by a Ramón y Cajal grant funded by the Spanish Ministry of Science (Ref: RYC2022-037076-I), and by the PRIME TIMEproject (PID2022-142569NA-I00), funded by MCIN/AEI/10.13039/501100011033, and by “ERDF A way of making Europe”, Peer reviewed




ResearchGate DOIs dataset [Dataset]

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Orduña Malea, Enrique
[EN] This dataset includes the scripts used to collect and analyze ResearchGate DOIs on the one hand, and the raw data collected on the other hand., Grant PID2022-142569NA-I00 funded by MCIN/AEI/10.13039/501100011033 and, by “ERDF A way of making Europe”, by the “European Union”.




ChatGPT Search as a tool for scholarly tasks: evolution or devolution?

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Font Julián, Cristina Isabel
  • Orduña Malea, Enrique
  • Codina, Lluís
[EN] ChatGPT Search was launched on October 31 by OpenAI as a new AI-powered
search engine. Among its features, it stands out for its ability to retrieve
information from various online sources, including scholarly databases, which
potentially allows the use of this tool for academic tasks, both quantitative and
qualitative. To test its features, five academic tasks are designed: two
quantitative (collecting hit count estimates from Google Search and scraping
bibliometric indicators from ResearchGate); two qualitative tasks (performing a
narrative synthesis of an academic topic and generating a brief academic
author profile), and a mixed task (identifying, collecting and describing a list of
publications from Google Scholar Profiles). The results show the inability of
ChatGPT Search to conduct quantitative tasks correctly, fabricating the results
(hallucination). Qualitative tasks are performed with better results; however,
errors are detected, which prevent recommending the tool without manual
analysis and refinement. Finally, the ability to generate links to scientific
publications can open up competition among academic sites to be mentioned
in the ChatGPT Search responses, giving rise to Academic Generative Engine
Optimization (A-GEO)., Study supported by project Publicized research: new indicators to measure the effects of timely marketing on scholarly evaluation (PRIME TIME) (PID2022-142569NA-I00), funded by MCIN/AEI/10.13039/501100011033, and by ERDF A way of making Europe , and by Project Parameters and strategies to increase the relevance of media and digital communication in society: curation, visualization and visibility (CUVICOM) , funded by MICIN/AEI/PID2021-123579OB-I00 and by FEDER/EU.




How do citizens engage with Science. Challenges and recommendations

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Bautista-Puig, Núria
  • Orduña Malea, Enrique
[EN] Citizen science (CS) has become a crucial form of public participation in science, helping to address global challenges and contribute to more democratic knowledge production. Despite its increasing presence (including literature reviews), uncertainties persist regarding the quality of data collected, the level of citizen participation, and ethical concerns. This editorial explores CS participation, aiming to provide a comprehensive analysis of engagement patterns, and challenges, and offering recommendations to enhance citizen involvement in scientific initiatives. A systematic review of existing literature indexed on Web of Science is conducted, following the PRISMA framework. The review covered 1,613 selected studies examining `participation¿ across various scientific fields, identifying the methodologies used and the factors influencing engagement, such as benefits, challenges, and ethical concerns. The results reveal a growing trend in CS, particularly in the natural sciences, with citizen involvement mostly limited to data collection rather than higher-level engagement like analysis or decision-making. The study also highlights the underrepresentation of social sciences and the need for more interdisciplinary approaches. In conclusion, the article calls for increased interdisciplinarity, greater integration of citizens in decision-making processes, diversification of participatory methods, and context specific strategies for participation. It emphasizes the importance of fostering public trust and awareness in science and proposes that these actions will improve the inclusivity and impact of citizen science initiatives., This work has been supported by a Ramón y Cajal grant funded by the Spanish Ministry of Science (Ref: RYC2022-
037076-I), and by the PRIME TIME project (PID2022-142569NA-I00), funded by MCIN/AEI/10.13039/501100011033,
and by ERDF A way of making Europe .




Sharing gray academic literature with ResearchGate DOIs: Increased discoverability but inaccurate metadata

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Orduña Malea, Enrique
[EN] Purpose To describe the characteristics of research outputs using persistent identifiers generated by ResearchGate to gain insight into what publications are shared and disseminated through this functionality, revealing their academic and non-academic impact.Design/methodology/approach A total of 1,092,934 RG-DOIs were collected, using the DataCite API, along with bibliographic metadata for the associated registered output (RG-DOI publications). The subsequent analysis evaluated the publication date, document type, and language. These values were crossreferenced against the full text of a random sample of 666 records to verify accuracy.Findings RG-DOIs have served primarily to identify and make accessible scholarly gray literature, including posters, presentations, conference papers, and theses, with notable emphasis on publications in Spanish and Portuguese. Around 41,000 citations from Web of Science indexed publications to RG publications are evidence of their infrequent but perceptible use in scholarly discourse. The declining number of registrations of RG-DOIs observed may indicate a shift in researcher preferences to alternative platforms for DOI generation.Research limitations The study uncovered substantial inconsistencies in DataCite metadata, which can be attributed to the automated DOI registration process and internal changes in the available document types on ResearchGate.Practical implications The study encountered challenges in conducting a quantitative analysis due to inconsistencies in the metadata. These have potential implications for researchers, practitioners, and librarians relying on RG-DOIs to conduct bibliometric or bibliographic analysis.Originality/value This study is the first comprehensive analysis of RG-DOIs and, as such, provides a unique perspective into academic gray literature. It also sheds light on the quality of ResearchGate data transmitted to DataCite when registering DOIs., This study was supported by Grant PID2022-142569NA-I00, funded by MCIN/AEI/10.13039/501100011033 and by the European Union through "ERDF A way of making Europe."




Open access publications drive few visits from Google Search results to institutional repositories

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Orduña Malea, Enrique
  • Font Julián, Cristina Isabel
  • Serrano Cobos, Jorge Ignacio
[EN] Given the importance of Google Search in generating visits to institutional repositories (IR), a lack of visibility in search engine results pages can hinder the possibility of their publications being found, read, downloaded, and, eventually, cited. To address this, institutions need to evaluate the visibility of their repositories to determine what actions might be implemented to enhance them. However, measuring the search engine optimization (SEO) visibility of IRs requires a highly accurate, technically feasible method. This study constitutes the first attempt to design such a method, specifically applied here to measuring the IR visibility of Spain's national university system in Google Search based on a set of SEO-based metrics derived from the Ubersuggest SEO tool. A comprehensive dataset spanning three months and comprising 217,589 bibliographic records and 316,899 organic keywords is used as a baseline. Our findings show that many records deposited in these repositories are not ranked among the top positions in Google Search results, and that the most visible records are mainly academic works (theses and dissertations) written in Spanish in the Humanities and Social Sciences. However, most visits are generated by a small number of records. All in all, our results call into question the role played by IRs in attracting readers via Google Search to the institutions' scientific heritage and serve to underscore the prevailing emphasis within IRs on preservation as opposed to online dissemination. Potential improvements might be achieved using enhanced metadata schemes and normalized description practices, as well as by adopting other actionable insights that can strengthen the online visibility of IRs. This study increases understanding of the role played by web indicators in assessing the web-based impact of research outputs deposited in IRs, and should be of particular interest for a range of stakeholders, including open access and open science advocates, research agencies, library practitioners, repository developers, and website administrators., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Research funded by Grant GV/2021/141 (Regional Government of Valencia, Spain) and Grant PID2022-142569NA-I00, funded by MCIN/AEI/10.13039/501100011033 and by "ERDF A way of making Europe".




Comparison of Academic SEO Metrics Across Different Tools: Search Terms, Traffic and URLs Indexed [Dataset]

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Font Julián, Cristina Isabel
  • Orduña Malea, Enrique
  • Lopezosa García, Carlos
  • Aguillo, Isidro F.
This dataset includes the raw data collected from two Open Access megapublisher websites (mdpi.com and frontiersin.org) across several SEO tools (Ahrefs, Semrush, SERPstats, Ubersuggest, Sistrix). From each domain name, SEO-level metrics (e.g., organic keywords, global traffic, traffic by country) were collected and structured.




Research on Research Visibility

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Orduña Malea, Enrique
  • Font Julián, Cristina Isabel
[EN] This editorial explores the significance of research visibility within the evolving landscape of academic communication, mainly focusing on the role of search engines as online meta-markets shaping the impact of research. With the rapid expansion of scientific output and the increasing reliance
on algorithm-driven platforms such as Google and Google Scholar, the online visibility of scholarly
work has become an essential factor in determining its reach and influence. The need for more rigorous research into academic search engine optimization (A-SEO), a field still in its infancy despite
its growing relevance, is also discussed, highlighting key challenges in the field, including the lack
of robust research methodologies, the skepticism within the academic community regarding the
commercialization of science, and the need for standardization in reporting and measurement techniques. This editorial thus invites a multidisciplinary dialogue on the future of research visibility,
with significant implications for academic publishing, science communication, research evaluation,
and the global scientific ecosystem., Grant PID2022-142569NA-I00, funded by MCIN/AEI/10.13039/501100011033 and by ERDF A way of making Europe .




Spanish Institutional repositories: An A-SEO data collection

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
  • Orduña Malea, Enrique
  • Font Julián, Cristina Isabel
  • Serrano Cobos, Jorge Ignacio
This dataset includes supplementary material (code, raw data) created and collected to support a study on the visibility of Spanish Institutional Repositories on Google Search results.