{"id":3089,"date":"2018-08-27T14:00:41","date_gmt":"2018-08-27T17:00:41","guid":{"rendered":"http:\/\/blog.scielo.org\/en\/?p=3089"},"modified":"2018-08-27T16:01:53","modified_gmt":"2018-08-27T19:01:53","slug":"output-and-impact-of-brazilian-research-confronting-international-and-national-contexts","status":"publish","type":"post","link":"https:\/\/blog.scielo.org\/en\/2018\/08\/27\/output-and-impact-of-brazilian-research-confronting-international-and-national-contexts\/","title":{"rendered":"Output and impact of Brazilian research: confronting international and national contexts"},"content":{"rendered":"

By Rog\u00e9rio Mugnaini<\/strong><\/p>\n

\"\"<\/a>

Image: dashu83<\/a>.<\/i><\/p><\/div>\n

For at least 30 years, it is possible to observe warnings in the literature on the limitation of the coverage of international information sources when it comes to scientific output indicators from countries excluded from mainstream science, such as Latin American countries. Should the absence of a significant part of the local literature in global sources not be enough, Beigel1<\/sup> notes that the very design of the evaluation systems around the world, on which research funding and the researcher\u2019s performance depend on, exclude the knowledge generated in the peripheral circuits by reinforcing the pressure to publish in mainstream journals.<\/p>\n

To measure the amount of information, let us take the Brazilian case described by Mugnaini, Digiampietri and Mena-Chalco2<\/sup>, by identifying about 400,000 original and review articles published between 1998 and 2012 in journals indexed in the Web of Science (WoS) and\/or SciELO. The study showed that, while at the beginning of the time period the journals indexed only in WoS published 73.1% of the national production, in 2012 this percentage decreased to 54.7%, thus, revealing the growing increase of SciELO coverage \u2013 even considering its selectivity, which means that a large number of national journals are not considered.<\/p>\n

Looking more closely at the core journals (according to Bradford\u2019s Zones) to the publications in each area, the Mugnaini, Digiampietri, and Mena-Chalco2<\/sup> study shows that Agrarian Sciences, Human Sciences, and the various Social Sciences publish fully in SciELO journals. Considering the intermediate Bradford\u2019s Zone, it was noted that of these areas, only Agrarian Sciences presented a recent internationalization effort, which resulted in 14% of articles in WoS journals. In the peripheral Bradford\u2019s Area, one can observe the greater internationalization, meaning that the percentage of publication occurs in a dispersed set of journals, increasing significantly for each of these areas. On the other hand, in the hard sciences, internationalization is a phenomenon that can be observed already in the core Bradford\u2019s Zone, signaling that there is a more restricted set of WoS journals used with significant publication frequency.<\/p>\n

While these findings reinforce the importance of evaluations covering national scientific output to be carried out as exhaustively as possible, it should be borne in mind that impact indicators (based on citation) are designed to be complementary. This consensus, established in the specialized literature in bibliometric studies, and assimilated by a large part of the international evaluation processes \u2013 which led, for example, to the Leiden Manifesto \u2013 has also been established in Brazil about two decades ago.<\/p>\n

However, when it comes to the use of impact indicators in large-scale evaluation exercises, it is limited exclusively to qualifying scientific production according to the Impact Factor of the journal where it was published, i.e., what is at stake is not Brazilian research\u2019s impact. Moreover, an observed consequence is the consolidation of citation indexes of worldwide scope, such as Web of Science (WoS), which is the pioneering and most used initiative, and more recently Scopus, whose use has been gradually increasing. Thus, SciELO, created in the 1990s, has become an important complementary source, whose potential for impact assessment begins to show its potential. This potential was envisioned by the very creator of the Science Citation Index, who at the time warned that scientists from these countries would still send their best work to international journals3<\/sup>.<\/p>\n

In this sense, analyzing the role of national journals in the dissemination of applied science in Spain, Sanz, Arag\u00f3n and Mendez4<\/sup>\u00a0found that these journals usually served as a warning to researchers and engineers on recent advances in the field, often through state of-art reviews and reports. The authors also found that some Spaniards went so far as to avoid publishing in them, because they felt it would weigh negatively in the evaluation of their curricula. They came to inquire about a possible lack of citation to these journals, because they were devoted to local problems, but rejected the idea that they should therefore be discarded, since the citation flow in the world literature concentrates in a small portion of core international journals.<\/p>\n

The graph below makes it possible to verify that, as observed in the Spanish case, the scientific output of Engineering in Brazil shows that only a third of its articles in SciELO journals (dark red) are cited, in contrast to articles published in WoS journals, whose percentage of cited articles is 69%. Areas in which these percentages present a very similar profile are Computer Science, Economics and Business, and Mathematics. However, Human Sciences presents a low percentage of articles cited in both contexts (29% for SciELO and 14% for WoS).<\/p>\n

Another important observation is that the volume of articles cited in the international context (dark blue) is significantly larger, as a reflection of the publication effort, but also of the greater number of foreign journals<\/p>\n

\"\"<\/a>

Source: Mugnaini, Noyons e Packer5<\/sup><\/p><\/div>\n

Distribution of cited and not cited articles in the corpus of SciELO and WoS journals (citation window of up to two years), according to area of the cited article.<\/strong><\/p>\n

However, a slightly different scenario is shown when one observes the volume of citations received by articles published only in SciELO journals: the percentage of citations originating from the domestic flow (Brazilian articles in SciELO journals, in dark red) is quite significant not only for the Social and Human Sciences, but for Agrarian and Biological Sciences areas; and differently from what could be expected, the international impact of articles in SciELO journals not only has a significant international impact (mainstream flow, blue tones), but most come from foreign authors (observed in areas such as Exact Sciences in general, and many areas of Health Sciences and Biology).<\/p>\n

These findings allow us to inquire whether it still makes sense to speak about “Lost science in the third world”6<\/sup>\u00a0and to envisage a reality in which we no longer must qualify the science produced according to the journal in which it was published, but rather assess it by itself.<\/p>\n

\"\"<\/a>

Source: Mugnaini, Noyons e Packer5<\/sup><\/p><\/div>\n

Distribution of citations (citation window of up to two years) to Brazilian articles published in SciELO journals, according to the area of the cited article, indexing database and presence of Brazilian author(s) on the citing article.
\n<\/strong><\/p>\n

Notes<\/h3>\n

1. BEIGEL, F. Publishing from the periphery: Structural heterogeneity and segmented circuits. The evaluation of scientific publications for tenure in Argentina\u2019s CONICET. Current Sociology<\/em> [online]. 2014, vol. 62, no. 5, pp. 743-765, ISSN: 1461-7064. DOI: 10.1177\/0011392114533977<\/a>. Available from: http:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0011392114533977?journalCode=csia<\/a><\/p>\n

2. MUGNAINI, R., DIGIAMPIETRI, L.A. and MENA-CHALCO, J.P. Comunica\u00e7\u00e3o cient\u00edfica no Brasil (1998-2012): indexa\u00e7\u00e3o, crescimento, fluxo e dispers\u00e3o. Transinforma\u00e7\u00e3o<\/em>. 2014, vol. 26, no. 3, ISSN: 0103-3786. DOI: 10.1590\/0103-3786201400030002<\/a>. Available from: http:\/\/ref.scielo.org\/v23s7m<\/a><\/p>\n

3. SANZ, E., ARAGON, I. and MENDEZ, A. The function of national journals in disseminating applied science. Journal of Information Science<\/em> [online]. 1995, vol.21, no.4, pp. 319-323. DOI: 10.1177\/016555159502100408<\/a>. Available from: http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555159502100408<\/a><\/p>\n

4.\u00a0GARFIELD E. Quantitative analysis of the scientific literature and its implications for science policymaking in Latin America and the Caribbean. Bulletin of PAHO<\/em>. 1995, vol. 29, no.1, pp.87-95.<\/p>\n

5. MUGNAINI, R., NOYONS, E. and PACKER, A.L. Fluxo de cita\u00e7\u00f5es inter-nacional: fontes de informa\u00e7\u00e3o para avalia\u00e7\u00e3o de impacto cient\u00edfico no Brasil. In: Encontro Brasileiro de Bibliometria e Cientometria, Rio de Janeiro, 2018.<\/p>\n

6. GIBBS, W.W. Lost science in the third world. Scientific American. 1995, vol. 273, no. 2, pp. 92-99.<\/p>\n

References<\/h3>\n

BEIGEL, F. Publishing from the periphery: Structural heterogeneity and segmented circuits. The evaluation of scientific publications for tenure in Argentina\u2019s CONICET. Current Sociology<\/em> [online]. 2014, vol. 62, no. 5, pp. 743-765, ISSN: 1461-7064. DOI: 10.1177\/0011392114533977<\/a>. Available from: http:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0011392114533977?journalCode=csia<\/a><\/p>\n

FONSECA, C. Avalia\u00e7\u00e3o dos programas de p\u00f3s-gradua\u00e7\u00e3o: do ponto de vista de um nativo. Horiz. antropol.<\/em> [online]. 2001, vol. 7, no. 16, pp. 261-275, ISSN: 1806-9983. DOI: 10.1590\/S0104-71832001000200014<\/a>. Available from: http:\/\/ref.scielo.org\/9dpqcy<\/a><\/p>\n

FRAME, D. Problems in the use of literature-based S&T indicators in developing countries<\/em>. In: MORITA-LOU, H. (ed.) Science and technology indicators for development. Boulder: Westview Press, 1985.<\/p>\n

GARFIELD E. Quantitative analysis of the scientific literature and its implications for science policymaking in Latin America and the Caribbean. Bulletin of PAHO<\/em>. 1995, vol. 29, no.1, pp.87-95.<\/p>\n

GIBBS, W.W. Lost science in the third world. Scientific American<\/em>. 1995, vol. 273, no. 2, pp. 92-99.<\/p>\n

HICKS, D. et al.<\/em> The Leiden Manifesto for research metrics. Nature<\/em>. 2015, vol. 520, no. 7548, pp. 429.<\/p>\n

MUGNAINI, R. and DIGIAMPIETRI, L. A. The Brazilian National Impact: Movement of Journals Between Bradford Zones of Production and Consumption. In: International Conference on Scientometrics and Informetrics, Istambul, 2015.<\/p>\n

MUGNAINI, R. Ciclo avaliativo de peri\u00f3dicos no Brasil: caminho virtuoso ou colcha de retalhos? In: ENANCIB \u2013 Encontro Nacional de Pesquisa em Ci\u00eancia da Informa\u00e7\u00e3o, Jo\u00e3o Pessoa, 2015.<\/p>\n

MUGNAINI, R., DIGIAMPIETRI, L.A. and MENA-CHALCO, J.P. Comunica\u00e7\u00e3o cient\u00edfica no Brasil (1998-2012): indexa\u00e7\u00e3o, crescimento, fluxo e dispers\u00e3o. Transinforma\u00e7\u00e3o<\/em>. 2014, vol. 26, no. 3, ISSN: 0103-3786. DOI: 10.1590\/0103-3786201400030002<\/a>. Available from: http:\/\/ref.scielo.org\/v23s7m<\/a><\/p>\n

MUGNAINI, R., NOYONS, E. and PACKER, A.L. Fluxo de cita\u00e7\u00f5es inter-nacional: fontes de informa\u00e7\u00e3o para avalia\u00e7\u00e3o de impacto cient\u00edfico no Brasil. In: Encontro Brasileiro de Bibliometria e Cientometria, Rio de Janeiro, 2018.<\/p>\n

SANZ, E., ARAGON, I. and MENDEZ, A. The function of national journals in disseminating applied science. Journal of Information Science<\/em> [online]. 1995, vol.21, no.4, pp. 319-323. DOI: 10.1177\/016555159502100408<\/a>. Available from: http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555159502100408<\/a><\/p>\n

 <\/p>\n

About Rogerio Mugnaini\"\"<\/a><\/h3>\n

With specialization in bibliometric and scientometric indicators, evaluation of national scientific output and scientific policy, he has developed research on scientific journals since 2003, when he developed the Bibliometrics Module of the SciELO Project. He is a Professor at the University of S\u00e3o Paulo, in the Department of Information and Culture of the School of Communications and Arts (Escola de Comunica\u00e7\u00f5es e Artes<\/em>, ECA), where she coordinates the Center for Research and Technology in Scientific Production. He was a member of committees, both at the university level (Vice-President of the Commission for Accreditation of the Support Program for Scientific Publications of the University of S\u00e3o Paulo between 2010 and 2016) and at the national level (Capes Triennial 2013 and Quadrennial 2017, area of Communications and Information). Member of the National Association of Research and Graduate Studies in Information Science (Associa\u00e7\u00e3o Nacional de Pesquisa e P\u00f3s-Gradua\u00e7\u00e3o em Ci\u00eancia da Informa\u00e7\u00e3o<\/em>, ANCIB) and the International Society of Scientometrics and Informetrics (ISSI).<\/p>\n

 <\/p>\n

Translated from the original in Portuguese<\/a> by Lilian Nassi-Cal\u00f2.<\/p>\n","protected":false},"excerpt":{"rendered":"

Brazilian scientific research, seen through its articles and their impact reveals a scenario that 30 years ago could not have been described. SciELO concretizes what Garfield envisioned for Latin America in the 1990s, allowing to delineate the citation flow, as in many countries, as yet unseen, and allowing to question the pertinence of Gibbs’s expression: \u201clost science in the third world\u201d. …<\/span> Read More →<\/span><\/a><\/span><\/p>\n","protected":false},"author":5,"featured_media":3095,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[3],"tags":[29,66,31,7,67,9],"class_list":["post-3089","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analysis","tag-bibliometrics","tag-internationalization","tag-research-evaluation","tag-scholarly-communication","tag-scielo-20-years","tag-scielo-program"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/3089","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=3089"}],"version-history":[{"count":7,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/3089\/revisions"}],"predecessor-version":[{"id":3101,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/3089\/revisions\/3101"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/3095"}],"wp:attachment":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=3089"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=3089"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=3089"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}