Tag: Research Evaluation

Openness is the only quality of an academic article that can be objectively measured

Quality of scientific research articles is a widespread preoccupation in academic circles. The most used proxy is based on citation counts, not of the article itself, but of the averages of articles appearing in the same journal during a given time window. This is known as the Journal Impact Factor, which may be objective within its own definition, but utterly lacks objectivity with regard to scientific quality of individual articles. Only some technical qualities of articles can be assessed at the time of their publication, and, significantly, their openness, the degree to which the research results they describe can be immediately and universally shared. Read More →

Plain-language summaries of research: Something for everyone [Originally published in eLife]

More than 50 journals and scientific organizations produce a wide variety of plain-language summaries that are available for research in many different areas of science and medicine. Plain-language summaries can help biomedical science journals to reach patients and others who may benefit from the research. This diversity means that there will always be something available to all those interested in science, regardless of their scientific background. Read More →

Are we in the GSM Radar?

Google Scholar Metrics (GSM) offers alternative metrics to the JCR Impact Factor and the SJR, namely the h-5 index. To enter this world ranking that covers more than 40,000 journals it is only necessary to publish an average of 20 articles per year and be cited. However, there are hundreds of journals (our journals) that are not being indexed in GSM. They’re off Radar. Read More →

Internationalization as an indicator of journal performance in Brazil: the case of Psychology

The path to strengthening scientific publications almost always goes through internationalization. Publishing in English, however, is not enough to reach a truly global audience and indices comparable to the most prestigious journals. A study on the degree of internationalization of Brazilian psychology journals shows how to walk this path. Read More →

In memoriam: Eugene Garfield – 1925-2017

The father of Scientometrics died at 91 years old on February 27, 2017 leaving a production of more than 1.000 papers and communications over 60 years of research. Read More →

Assessment of reproducibility in research results leads to more questions than answers

The ‘Reproducibility Project: Cancer Biology’ initiative that has the purpose of assessing the reproducibility of preclinical research in Oncology was launched in 2013 as the result of a collaboration between the Center for Open Science and Science Exchange. The first results of the replication studies have just been published, however, their interpretation requires a careful approach. Read More →

Preprints – the way forward for rapid and open knowledge sharing

Preprints – versions of academic articles that have not yet been formally peer-reviewed before publication – are gaining acceptance in the academic world. They deliver open access as well as speedy publication, and their decades old success in physics has spurred on their spread in other disciplines. The development of preprints is accelerating; important funding agencies are in support of them, and also SciELO is planning to set up a preprint server for authors in Latin America and the Global South generally. Read More →

Adoption of open peer review is increasing

In analyzing how the ‘peer review’ institution has emerged and evolved, it is possible to understand the current transition the assessment process is going through towards greater openness, transparency and accountability. Read More →

SciELO and the future of journals

The joint participation of journals and SciELO in overcoming problems that affect scholarly communication in the national and global contexts was the central topic of the 2016 annual SciELO Brazil meeting. The advances in professionalization, internationalization and sustainability of SciELO journals are improving their key functions on research validation and constitute a new stage in the evolution of SciELO. Read More →

What’s the deal with preprints?

Preprints enable scholarly communication more quickly, complement traditional publication in academic journals and determine priorities. This procedure may change the peer review system and focus on the role of academic journals. Read More →

Study shows that articles published in English attract more citations

Among the many factors that influence citation practice in scholarly communication, the language of publication plays a key role. A study by Argentine researchers showed that English articles receive more citations than those published in other languages. Despite being perceived by many as of lower quality and relevance, articles in Spanish from two Latin American journals were blind evaluated and were not, in fact, underqualified. Read More →

Is it possible to normalize citation metrics?

Bibliometric indicators represent much more than an indication of the visibility, relevance and impact of an article. A researcher’s entire career profile can be summarized in one or more numerical productivity and impact indicators of his research. However, citation metrics vary considerably according to the area of knowledge, the publication age, the type of document and the coverage of the database where citations were accrued. Is it possible to normalize them? Here we discuss the challenges of this practice. Read More →

Flow of manuscripts and items processed by SciELO Brazil journals in 2014 and 2015

The improvement of manuscripts management is a key dimension in advancing the professionalization of journals promoted by SciELO. In recent years, the manuscript flow of the SciELO Brazil collection includes more than 80,000 submissions and about 20,000 articles published annually. This post looks at this flow in different thematic areas. Read More →

Theses and dissertations: pros and cons of the traditional and alternative formats

In order to expedite the writing and assessment of theses, institutions and graduate programs in several countries, including Brazil, are choosing to allow candidates who have published papers on their masters or doctorate research topics to replace the thesis chapters by these articles, headed by an introduction, conclusion and review of scientific literature. Is this format ideal and applicable to all? Read More →

On the immediate rejection of manuscripts without external peer review

Not all texts received by scientific journals are sent to external evaluation. The arbitration process in the double blind system implies a high liability for editors and reviewers, and the burden of this process ends up expressed in a lengthy evaluation process, with direct effects on authors (who wait too long to receive a decision) and on readers (that may have access to delayed data). We used some data on the management of Revista de Sociologia e Política to think about the benefits and losses by rejecting original articles based on preliminary analysis by the editors (desk review evaluation), without requiring reviews issued by referees external to the editorial board. Read More →