{"id":1053,"date":"2014-05-14T08:14:07","date_gmt":"2014-05-14T11:14:07","guid":{"rendered":"http:\/\/blog.scielo.org\/en\/?p=1053"},"modified":"2015-11-25T14:06:20","modified_gmt":"2015-11-25T16:06:20","slug":"scientometrics-of-peer-reviewers-will-they-be-finally-recognized","status":"publish","type":"post","link":"https:\/\/blog.scielo.org\/en\/2014\/05\/14\/scientometrics-of-peer-reviewers-will-they-be-finally-recognized\/","title":{"rendered":"Scientometrics of peer-reviewers \u2013 will they be finally recognized?"},"content":{"rendered":"<p>Since bibliometrics and scientometrics began to be studied as disciplines in their own right, concerns have surfaced about how to measure and evaluate the role of the peer-reviewer as well as the expressions of thanks and acknowledgements which are all part of the process which goes towards the preparation of a paper which is submitted for publication in a learned journal.<\/p>\n<p>On 7<sup>th<\/sup> April, it was announced that ORCID (Open Researcher and Contributor ID) had commissioned CASRAI (Consortia Advancing Standards in Research Administration Information) to undertake a project to establish a standard methodology for acknowledging the work of peer-reviewers in the form of persistent identifiers which will allow retrieval and measurement. But before describing the project in detail, it is necessary to present the key players and outline the importance of this project.<\/p>\n<h3>Key Players<b><\/b><\/h3>\n<p>ORCID is a not-for-profit institution whose objective is the creation and maintenance of an international database of researchers in all subject areas, assigning them each a unique digital identifier. In this way it is possible to link research outputs with authors, grant agencies and the professional activities undertaken by authors. The ORCID identifier, in the same way as the ResearchID, can be integrated into a Web of Science\u00b9 record, and many scientific journals are beginning to request that authors register with ORCID and include their personal identifier when submitting papers for publication.<\/p>\n<p>CASRAI (Consortia Advancing Standards in Research Administration Information) is a not-for-profit organization established in Ontario, Canada, whose goal is the standardization of the data that researchers and funding institutions produce, with the objective of facilitating the interchange of information throughout the life-cycle of research activities.<\/p>\n<h3>The Project<b><\/b><\/h3>\n<p>The project owes its origin to the age-old problem of how to acknowledge peer-review activities in the ORCID database and how the data should also incorporate grant applications and workflows that occur as papers submitted for publication go through the peer-review process. To address this need, ORCID requested that CASRAI develop a standardization project, and this led to the creation of a working group which invited various members representing learned societies, publishers and international funding agencies. This working group must deliver a draft document for external assessment this coming June.<\/p>\n<p>Among the major issues to be resolved by the working group are the following: (i) the evaluation of technology suitable for the identification and definition of the data elements which allow acknowledgement, (ii) the identification of options for the assignment of a persistent document identifier for the revision per se, and (iii) recommendations for the metadata structure that the citation should have.<\/p>\n<p>These discussions are important because the peer-review community has always been concerned about how its role and the impact on professional development of the service it provides can be better recognized. A key problem requiring resolution is what should be the best way to accommodate the wide variety of peer-review activities, such as reviewing a conventional journal article, a grant request for a project, etc., and then how to register these activities under a common citation standard. Moreover, information relating to this activity should be registered by means of a persistent identifier which will allow the peer-reviewer to be linked with the documents worked on. In the future, this will permit the retrieval and compilation of scientometric or altmetric statistics, or similar ones by combining different variables with the names of the peer-reviewers.<\/p>\n<p><i>F1000Research <\/i>is an open access journal that is jointly managing the project with ORCID and which has begun to include the reviewer identifier in the articles published on its site. It should also be noted that the review process is completely open, with the names and reports of the peer-reviewers being published along with the article. The reports of the peer-reviewers are also assigned a DOI (Digital Object Identifier) so that they receive the credit they deserve for their work.<\/p>\n<p style=\"text-align: center;\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1054 aligncenter\" src=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/05\/cienciometria.png\" alt=\"\" width=\"508\" height=\"262\" srcset=\"https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/05\/cienciometria.png 508w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/05\/cienciometria-300x154.png 300w\" sizes=\"auto, (max-width: 508px) 100vw, 508px\" \/><\/p>\n<p>Source: <a href=\"http:\/\/blog.f1000research.com\/2014\/04\/07\/project-to-include-referee-reports-in-orcid-profiles\/\" target=\"_blank\">http:\/\/blog.f1000research.com\/2014\/04\/07\/project-to-include-referee-reports-in-orcid-profiles\/<\/a><\/p>\n<h3>The importance of the project<\/h3>\n<p>Peer-review demands many hours of work that, by and large, is not publicly recognized. The quality of the peer-review service is fundamental to the process of research, especially as it relates to establishing reliability in scholarly communication. As Alice Meados states (2014), this is because in the last decade the scientific community, which has been witness to rapid changes with no end in sight, has not changed its perception of trust in the peer-review procedures, regardless of whether the journals are open access or commercial, or if the peer-review is double blind or open, if altmetric values are complied, or if plagiarism detection software is used.<\/p>\n<p>A recent study undertaken by the University of Tennessee\u00b2 concludes that peer-review journals continue to be the most reliable and preferred vehicle for scholarly communication within the research community. The supposed lack of peer-review was one of the arguments of the researchers surveyed, who stated not wanting to publish in open access journals unless there was a rigorous peer-review process.<\/p>\n<p>Increasingly, the community asks itself how this work of peer-review can be better recognized, both to encourage the participation of reviewers and to evaluate impact on professional development. And it is with these long standing requirements that the working group organized by CASRAI will have many things to consider.<\/p>\n<p>If the ORCID-CASRAI project is successful, then the important work of peer-review, which is almost always anonymous, with no recognition other than being included in the lists that the journals publish every year or two, will now be able to be included in the lists of acknowledgments.<\/p>\n<p>But to be successful, as stated by Pablo de Castro y Tom\u00e1s Baiget\u00b3 in the INCYT list, the project must have sufficient application and acceptance. It will require the collaboration of the stakeholders, that is, institutions, publishers and companies, regardless of whether publications are open access or commercial. Finally, the great challenge for ORCID is to get authors to systematically maintain the information that will be collected from their accounts, and if this work will be done in a synchronized and automatic manner with other institutional systems.<\/p>\n<p>As reported to us, the SciELO Program will incorporate a similar initiative in the course of this year. It would be good if the journals published in the SciELO network were to begin asking authors and reviewers to register in ORCID and include this data in the papers that they send for publication.<\/p>\n<h3>Notes<b><\/b><\/h3>\n<p>\u00b9 ResearchID and ORCID integration &#8211; <a href=\"http:\/\/wokinfo.com\/researcherid\/integration\/\" target=\"_blank\">http:\/\/wokinfo.com\/researcherid\/integration\/<\/a><\/p>\n<p>\u00b2 <i>Trust an authority in scholarly communications in the light of the digital transition<\/i>: Final report\u00a0University of Tennessee and CIBER Research Ltd. December 2013. <a href=\"http:\/\/ciber-research.eu\/download\/20140115-trust_final_report.pdf\" target=\"_blank\">http:\/\/ciber-research.eu\/download\/20140115-Trust_Final_Report.pdf<\/a><\/p>\n<p>\u00b3 <i>Buscan poder reconocer el trabajo de los evaluadores<\/i>. 9 de abril 2014. Comunicaciones de Pablo de Castro y Tom\u00e1s Baiget en la lista de Indicadores en Ciencia y Tecnolog\u00eda\u00a0<a href=\"http:\/\/listserv.rediris.es\/cgi-bin\/wa?a0=incyt\" target=\"_blank\">http:\/\/listserv.rediris.es\/cgi-bin\/wa?A0=INCYT<\/a><\/p>\n<h3>References<\/h3>\n<p>LAW, A. ORCID &amp; CASRAI Kick-off New Standards Project on \u2018Peer Review Services\u2019. <i>CASRAI<\/i>. 7 April 2014. Available from: <a href=\"http:\/\/casrai.org\/about\/announcements\/orcid-%2526-casrai-kick-off-new-standards-project-on-%25e2%2580%2598peer-review-services%25e2%2580%2599\" target=\"_blank\">http:\/\/casrai.org\/about\/announcements\/orcid-%26-casrai-kick-off-new-standards-project-on-%E2%80%98peer-review-services%E2%80%99<\/a><\/p>\n<p>HAAK, L. Acknowledging Peer Review Activities. ORCID. 8 April 2014. Available from: <a href=\"http:\/\/orcid.org\/blog\/2014\/04\/08\/orcid-and-casrai-acknowledging-peer-review-activities\" target=\"_blank\">http:\/\/orcid.org\/blog\/2014\/04\/08\/orcid-and-casrai-acknowledging-peer-review-activities<\/a><\/p>\n<p>LAWRENCE, R. Project to include referee reports in ORCID profiles. <i>F1000Research<\/i>. 7 April 2014. Available from: <a href=\"http:\/\/blog.f1000research.com\/2014\/04\/07\/project-to-include-referee-reports-in-orcid-profiles\/\" target=\"_blank\">http:\/\/blog.f1000research.com\/2014\/04\/07\/project-to-include-referee-reports-in-orcid-profiles\/<\/a><\/p>\n<p>MEADOWS, A. In (Digital) Scholarly Communications We Trust?. the scholarly kitchen. 7 April 2014. Available from: <a href=\"http:\/\/scholarlykitchen.sspnet.org\/2014\/04\/07\/in-digital-scholarly-communications-we-trust\/?utm_source=feedburner&amp;utm_medium=email&amp;utm_campaign=feed%253a+scholarlykitchen+%2528the+scholarly+kitchen%2529\" target=\"_blank\">http:\/\/scholarlykitchen.sspnet.org\/2014\/04\/07\/in-digital-scholarly-communications-we-trust\/?utm_source=feedburner&amp;utm_medium=email&amp;utm_campaign=Feed%3 A+ScholarlyKitchen+%28The+Scholarly+Kitchen%29<\/a><\/p>\n<h3>External Links<b><\/b><\/h3>\n<p>ORCID &#8211; <a href=\"http:\/\/orcid.org\/\" target=\"_blank\">http:\/\/orcid.org\/<\/a><\/p>\n<p>CASRAI &#8211; <a href=\"http:\/\/casrai.org\/about\" target=\"_blank\">http:\/\/casrai.org\/about<\/a><\/p>\n<p>&nbsp;<\/p>\n<h3><a href=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-640\" title=\"Ernesto Spinak\" src=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-300x271.jpg\" alt=\"Ernesto Spinak\" width=\"180\" height=\"163\" srcset=\"https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-300x271.jpg 300w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-768x694.jpg 768w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-1024x926.jpg 1024w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-150x136.jpg 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/a>About Ernesto Spinak<\/h3>\n<p>Collaborator on the SciELO program, a Systems Engineer with a Bachelor\u2019s degree in Library Science, and a Diploma of Advanced Studies from the Universitat Oberta de Catalunya (Barcelona, Spain) and a Master\u2019s in \u201cSociedad de la Informaci\u00f3n\u201d (Information Society) from the same university. Currently has a consulting company that provides services in information projects to 14 government institutions and universities in Uruguay.<\/p>\n<p>&nbsp;<\/p>\n<p>Translated from the original in\u00a0<a href=\"http:\/\/blog.scielo.org\/es\/2014\/05\/14\/cienciometria-de-evaluadores-seran-finalmente-reconocidos\/\">Spanish<\/a>\u00a0by\u00a0<a href=\"http:\/\/www.nicholascopconsulting.com\/\" target=\"_blank\">Nicholas Cop Consulting<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ORCID and CASRAI have initiated a project to establish a set of standard procedures to recognize the work of peer-reviewers. In this way the important work of peer-review, almost always anonymous, will be counted in the acknowledgments and be incorporated into scientometric indicators and altmetrics. But this will depend upon a sufficient level of adoption and acceptance of the procedures. <span class=\"ellipsis\">&hellip;<\/span> <span class=\"more-link-wrap\"><a href=\"https:\/\/blog.scielo.org\/en\/2014\/05\/14\/scientometrics-of-peer-reviewers-will-they-be-finally-recognized\/\" class=\"more-link\"><span>Read More &rarr;<\/span><\/a><\/span><\/p>\n","protected":false},"author":8,"featured_media":1056,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[3],"tags":[29,7,9],"class_list":["post-1053","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analysis","tag-bibliometrics","tag-scholarly-communication","tag-scielo-program"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1053","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=1053"}],"version-history":[{"count":7,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1053\/revisions"}],"predecessor-version":[{"id":1676,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1053\/revisions\/1676"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/1056"}],"wp:attachment":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=1053"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=1053"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=1053"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}