{"id":51,"date":"2013-07-16T08:43:37","date_gmt":"2013-07-16T11:43:37","guid":{"rendered":"http:\/\/blog.scielo.org\/en\/?p=51"},"modified":"2016-03-16T11:00:48","modified_gmt":"2016-03-16T14:00:48","slug":"declaration-recommends-eliminate-the-use-of-impact-factor-for-research-evaluation","status":"publish","type":"post","link":"https:\/\/blog.scielo.org\/en\/2013\/07\/16\/declaration-recommends-eliminate-the-use-of-impact-factor-for-research-evaluation\/","title":{"rendered":"Declaration recommends eliminate the use of Impact factor for research evaluation"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-76\" src=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/07\/dora.png\" alt=\"dora\" width=\"230\" height=\"107\" srcset=\"https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/07\/dora.png 319w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/07\/dora-300x140.png 300w\" sizes=\"auto, (max-width: 230px) 100vw, 230px\" \/>The San Francisco Declaration on Research Assessment (DORA) from December 2012 makes a critical call against the use of the Impact Factor (IF) in the evaluation of research.<\/p>\n<p>The IF was conceived by Eugene Garfield, the founder of the Institute for Scientific Information (ISI) in 1975. His concept, however, has been designed by the author in 1955 when the publication of the <a href=\"http:\/\/ip-science.thomsonreuters.com\/cgi-bin\/jrnlst\/jloptions.cgi?PC=K\">Science Citation Index (SCI)<\/a> started. The indicator was initially created to assist the selection of journals to be indexed in SCI and showed that even journals with a small number of papers, but that were highly cited could be selected. It is thus born the first and most popular and controversial impact ranking of scientific journals ever created. The ISI was incorporated into the international news agency Thomson Reuters in 1992, and since then, the IF and the source database of the indicator, the <a href=\"http:\/\/thomsonreuters.com\/journal-citation-reports\/\">Journal Citation Reports (JCR)<\/a>, are an integral part of the <a href=\"http:\/\/wokinfo.com\/\">Web of Knowledge<\/a> product.<\/p>\n<p>The use of IF to measure the impact of journals has become universal since its inception. The reasons range from the facility to calculate it, the fact of being for many years the only bibliometric indicator available, being available to a large number of journals, mainly from developed countries, and serve as a ranking and to compare journals. However, as the use of the IF overstepped the scope of journals and became popular in academic circles as a direct and indirect source for research quality and for promotions in the career, granting of funds for research, evaluation of post-graduate programs and ranking of universities and research institutions, many criticism regarding its usability and limitations arose. The most common are:<\/p>\n<ul>\n<li>What is taken into account in the numerator not always is in the denominator;<\/li>\n<li>It is the citation rate of the articles that determines the journal\u2019s IF, and not otherwise; a low correlation between the number of citations of individual articles with the IF of the journal has been observed;<\/li>\n<li>The indicator focuses on areas that have short half-life citations (life sciences and hard sciences) and hinders other areas;<\/li>\n<li>Review articles receive more citations than original articles and some editors tend to prefer the former in their journals;<\/li>\n<li>There is a clear predominance of English-language journals in the database, despite recent efforts to boost journals that depict science from local regions through its inclusion in JCR.<\/li>\n<\/ul>\n<p>The <a href=\"http:\/\/am.ascb.org\/dora\/\">San Francisco Declaration on Research Assessment (DORA)<\/a> is an initiative of scientists from the <a href=\"http:\/\/ascb.org\/\">American Society for Cell Biology<\/a> aiming to stop the use of IF for evaluation of scientific research. The Declaration, which has been receiving wide support, recommends that IF should not be used in assessments for research funding, career promotions and hiring of academics. The document was signed by over 150 prominent scientists and 75 academic organizations, including the <a href=\"http:\/\/www.aaas.org\/\">American Association for the Advancement of Science<\/a>.<\/p>\n<p>The isolated use of IF academic evaluation is highly destructive, according to the signatories of <a href=\"http:\/\/am.ascb.org\/dora\/\">DORA<\/a>, since\u00a0 it can prevent journals from publishing articles from less cited areas or subjects, besides burdening\u00a0 high-impact journals with often inadequate submissions. However, the most pernicious consequence to science is to prevent the natural progress of research, which, in the search for new approaches, may lead to relatively long periods without generating publications. Researchers should be able to &#8220;employ&#8221; this period with no publications and\/or citations without being penalized for it.<\/p>\n<p>It should surprise the fact that the use of an indicator makes eligible one or either author because he has published in a high IF journal, that it is more important to know where he published than reading his work. <a href=\"http:\/\/am.ascb.org\/dora\/\">DORA<\/a> emphasizes the need to assess research on its own merits and not by the journal where it has been published.<\/p>\n<h3>Refer\u00eancias<\/h3>\n<p>ALBERTS, B. Impact factor distortions.\u00a0Science, 17 May 2013, vol. 340, n\u00ba 6134, p. 787.<\/p>\n<p>BREMBS, B., BUTTON, K. and MUNAF\u00d2, M. Deep impact: unintended consequences of journal rank.\u00a0<i>Front. <\/i><i>Hum. Neurosci<\/i>., 2013, vol. 7, n\u00ba 291. [cited 13 July 2013]. Available from:\u00a0 <a href=\"http:\/\/www.frontiersin.org\/human_neuroscience\/10.3389\/fnhum.2013.00291\/full\">http:\/\/www.frontiersin.org\/human_neuroscience\/10.3389\/fnhum.2013.00291\/full<\/a><\/p>\n<p>GARFIELD, E. The history and meaning of the journal impact fator.\u00a0JAMA, 2006, vol. 295, p. 90-93.<\/p>\n<p>HORTON, R. Science: a new generation.\u00a0Lancet, February\u00a0\u00a02013, vol. 381, suppl . 1, p. S2-3. Available from:\u00a0\u00a0doi:10.1016\/S0140-6736(13)60445-6.<\/p>\n<p><i>Impact Factor Shifting from Journal to Article<\/i>. Just Publics @ 360. [viewed 13 July 2013]. Available from: <a href=\"http:\/\/justpublics365.commons.gc.cuny.edu\/2013\/07\/05\/impact-factor-shifting-from-journal-to-article\/\">http:\/\/justpublics365.commons.gc.cuny.edu\/2013\/07\/05\/impact-factor-shifting-from-journal-to-article\/<\/a><\/p>\n<p>LEE, C.H. Journal impact factor and individual article impact.\u00a0Am J Emerg Med, March 2013, vol. 31, n\u00ba 3, p. 624-625.<\/p>\n<p>MURPHY, E.J. Impact factor and science publishing: what impact should it have on selecting journals in which we publish?\u00a0Lipids, May 2013, vol. 48, n\u00ba 5, p. 431-3.<\/p>\n<p>SEGLEN, P.O.\u00a0\u00a0Why the impact factor of journals should not be used for evaluating research.\u00a0BMJ, February 1997, p. 314-497.<\/p>\n<p>&nbsp;<\/p>\n<h3><a href=\"http:\/\/blog.scielo.org\/wp-content\/uploads\/2015\/10\/Lilian.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-907\" src=\"http:\/\/blog.scielo.org\/wp-content\/uploads\/2015\/10\/Lilian.jpg\" alt=\"lilian\" width=\"180\" height=\"163\" \/><\/a>About\u00a0Lilian Nassi-Cal\u00f2<\/h3>\n<p>Lilian Nassi-Cal\u00f2 studied chemistry at <em>Instituto de Qu\u00edmica <\/em>\u2013 USP, holds a doctorate in Biochemistry by the same institution and a post-doctorate as an Alexander von Humboldt fellow in Wuerzburg, Germany. After her studies, she was a professor and researcher at IQ-USP. She also worked as an industrial chemist and presently she is Coordinator of Scientific Communication at BIREME\/PAHO\/WHO and a collaborator of SciELO.<\/p>\n<p>&nbsp;<\/p>\n<p>Translated from the\u00a0original in <a href=\"http:\/\/blog.scielo.org\/blog\/2013\/07\/16\/declaracao-recomenda-eliminar-o-uso-do-fator-de-impacto-na-avaliacao-de-pesquisa\/\" target=\"_blank\">portuguese<\/a>\u00a0by Lilian Nassi-Cal\u00f2.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The use of the Impact Factor (IF) beyond the scope of journal ranking as a direct or indirect proxy for the evaluation of research quality, career promotions, granting of funds, ranking of graduate programs, etc. has been questioned for quite some time. The San Francisco Declaration on Research Assessment makes a new and critical call against the use of the IF in the evaluation of research. <span class=\"ellipsis\">&hellip;<\/span> <span class=\"more-link-wrap\"><a href=\"https:\/\/blog.scielo.org\/en\/2013\/07\/16\/declaration-recommends-eliminate-the-use-of-impact-factor-for-research-evaluation\/\" class=\"more-link\"><span>Read More &rarr;<\/span><\/a><\/span><\/p>\n","protected":false},"author":22,"featured_media":77,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[3],"tags":[10,31],"class_list":["post-51","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analysis","tag-impact-factor","tag-research-evaluation"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/51","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=51"}],"version-history":[{"count":19,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/51\/revisions"}],"predecessor-version":[{"id":2178,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/51\/revisions\/2178"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/77"}],"wp:attachment":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=51"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=51"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=51"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}