{"id":1231,"date":"2014-08-07T09:49:15","date_gmt":"2014-08-07T12:49:15","guid":{"rendered":"http:\/\/blog.scielo.org\/en\/?p=1231"},"modified":"2016-01-15T17:39:19","modified_gmt":"2016-01-15T19:39:19","slug":"what-can-alternative-metrics-or-altmetrics-offer-us","status":"publish","type":"post","link":"https:\/\/blog.scielo.org\/en\/2014\/08\/07\/what-can-alternative-metrics-or-altmetrics-offer-us\/","title":{"rendered":"What can alternative metrics \u2013 or altmetrics \u2013 offer us?"},"content":{"rendered":"<p><a href=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/08\/altmetric_logo_600px.png\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-1235 size-medium\" src=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/08\/altmetric_logo_600px-300x106.png\" alt=\"\" width=\"300\" height=\"106\" srcset=\"https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/08\/altmetric_logo_600px-300x106.png 300w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2014\/08\/altmetric_logo_600px.png 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>The prestigious Spanish journal <em>El Profesional de la Informaci<\/em><em>\u00f3n<\/em> (EPI)\u00b9, has just published in its July \/ August issue four articles dedicated to the topic of \u201calternative metrics\u201d, which are also known as altmetrics.<\/p>\n<p>EPI is a specialist journal in the field of information science which has been published since 1992 in Spanish and\/or English. It falls into the category of a hybrid open access journal, and as far Spanish language journals are concerned, it is among the top journals as measured by the Impact Factor in both the Journal Citation Reports and Scopus. Three of the articles which we will look at in this post are available in open access.<\/p>\n<p>The issue begins with an introduction written by Euan Adie, the founder of Altmetric.com. The next article presents the new possibilities offered by altmetrics for data exploration, and the following articles reflect on their possible use in evaluating research. This group of articles concludes with a case study which applies altmetrics to those high impact authors writing in the journal EPI itself.<\/p>\n<p>Euan Adie\u00b2, who provides the first article in this issue \u2013\u201cTaking the alternative mainstream<em>\u201d<\/em>\u00b3\u2013was one of the invited panelists at the SciELO 15 Years Conference, where he gave a presentation entitled \u201cAltmetrics in practice\u201d. In the same way as he did in the presentation that he gave in S\u00e3o Paulo, his journal article discusses the reasons forthe useof altmetrics to measure the influence that scientific works have on society, and takes the view that altmetrics are complementary to the traditional system of counting citations, since they can be used in much broader contexts. There are many types of impact measurement, not solely bibliometric indicators, since science has repercussions upon the economy, politics, research institutions and upon the public in general.<\/p>\n<p>The main parties interested in these altmetrics are authors themselves, which makes sense, since it is to be hoped that they will want some indication as to whether what they have written has caught the attention of the public and to what extent. From a practical point of view, the editors of academic journals who provide these altmetrics are giving authors a personal service.<\/p>\n<p>The challenge presented by this new tool is that altmetrics data is very transitory and difficult to collect and, at the present time, does not yet have clear interpretations. It lacks a generally accepted theoretical framework.<\/p>\n<p>The following article \u201c<em>Altm<\/em><em>\u00e9<\/em><em>tricas para la evaluaci<\/em><em>\u00f3<\/em><em>n de la investigaci<\/em><em>\u00f3<\/em><em>n y el an<\/em><em>\u00e1<\/em><em>lisis de necesidades<\/em> <em>de informaci<\/em><em>\u00f3<\/em><em>n<\/em><em>\u201c<\/em><em>(Altmetrics: measuring the impact of research output and analyzing information requirements) <\/em>addresses the topic that directly concerns us, namely just how good are the tools which quantify the presence of research on the social web as a complement to the more traditional forms of evaluation by its impact. The major problem is one of the nature and limits of human knowledge. It is also necessary to standardize the procedures for the collection of data in order to guarantee the consistency of altmetrics indicators so that they can be compared, and build a conceptual framework within which to interpret them.<\/p>\n<p>The major altmetrics services providers are:<\/p>\n<ul>\n<li>altmetric.com from Macmillan Publishers; this is the major provider of altmetrics with more than 4,000 clients. This service is also used by SciELO for its Brazilian journal collection.<\/li>\n<li>Impactstory.org with the support of the Sloan Foundation.<\/li>\n<li>PlumAnalytics.com, recently acquired by Ebsco.<\/li>\n<li>There are also a number of other smaller providers in existence or in the process of being set-up.<\/li>\n<\/ul>\n<p>Impactstory.org and Altmetric.com are in the process of merging with the objective of creating a supplier with a much greater coverage.<\/p>\n<p>The \u201craw\u201ddata which is obtained can be interpreted in five levels or categories:<\/p>\n<ul>\n<li>Downloads as a measure of the dissemination of a particular article.<\/li>\n<li>The number of times a particular article is included in a social bookmark (CiteUlike, Mendeley) as a measure of interest generated.<\/li>\n<li>Comments in Twitter would be the greatest measure of interest in a particular article. They are immediate and transitory, but also of social interest.<\/li>\n<li>Interest in a particular article increases if it is recommended by specialist services, as for example the recommendations in the medical field on the site Faculty of 1000.<\/li>\n<li>Finally, the traditional way of measuring impact continues to be citation analysis.<\/li>\n<\/ul>\n<p>Mendeley is one of the principle sources of altmetric data, broken down by discipline. But unlike systems where citations are cumulative, the coverage offered by Mendeley is variable since users modify their bibliographies and delete those they consider obsolete over time. There are still no longitudinal studies that analyze the coverage of altmetric data over time. Another problem with the numbers from Mendeley is that more than half of the users are doctoral students, with graduate students and researchers a distant second. This means that the numbers from Mendeley come from a relatively small and biased group in relation to the total academic community. The representation of Mendeley users goes down sharply in the social sciences, and to less than 30% in the humanities.<\/p>\n<p>The data collection procedures of aggregators are not standardized, necessitating the establishment of standards such as those being produced by NISO (2013)\u2074. Under the umbrella term of \u201caltmetrics\u201d, a wide variety of metrics and indicators are taken into consideration which try to measure the social dissemination of scientific research on the web. Qualitative studies are needed on the use of tools such as Twitter, Facebook and others which will help us to find out how and to what extent scientists use these social tools.<\/p>\n<p>The third EPI article \u201cNew data, new possibilities: Exploring the insides of Altmetric.com<em>\u201d<\/em> reaffirms concepts discussed earlier and presents an interesting table with the 16 principle sources of information which are used by altmetric.com to gather data. They are: Blogs, News, Reddit, Facebook, Google Plus, Pinterest, Twitter, Stack Exchange, CiteUlike, Connotea, Mendeley, F1000, YouTube, LinkedinGroups, Research Highlights, and Miscellaneous.<\/p>\n<p>Altmetric.com asserts that it makes great efforts to resolve ambiguities; however the information is still far away from being exhaustive, precise and accurate. In any case, these techniques are applied only to sources in English, not to those in other languages such as Spanish. It is also important to note that social networks such as as academia.edu and ResearchGate, which are used by many researchers, are omitted. According to the EPI study being discussed here, five sources (Twitter, Mendeley, Facebook, CiteULike and blogs) account for 95% of the information gathered, leaving the remaining sources with a marginal presence.<\/p>\n<p>The final altmetrics article in EPI \u201cPresencia en redes sociales y altm\u00e9tricas de los principales autores de la revista El Profesional de la Informaci\u00f3n<em>\u201d<\/em><em> (<\/em>Presence in social networks, and altmetrics of major authors publishing in the journal El Profesional de la Informaci\u00f3n<em>)<\/em>, analyzes the presence and impact of the 47 most published authors in EPI during the period 2009-2013, and their public profiles in Google Scholar, Linkedin and Mendeley. It confirms the real difficulties involved in calculating altmetrics not only at the author level but also at the article level, without taking into account the problem of detecting affiliations, the lack of title standardization, and so on.<\/p>\n<h3>My thoughts<\/h3>\n<p>The tools of altmetrics are in an experimental phase, and which have two issues yet to be resolved. The first one is technical, referring to collection of data that has broader coverage, in various languages, and the ability to resolve ambiguities. This will be resolved once there are accepted international standards, in the same manner that other metrics such as Counter for the measurement of the use of electronic resources were accepted.<\/p>\n<p>The second problem is more complex and has to do with epistemology, that is, what theoretical base can be established to interpret the data obtained by computer algorithms, and to deduce, from that point on, consistent, credible and innovative indicators. If we analyze the history of the development of classic bibliometrics and scientometrics, we will see that it took close to 20 years of theoretical discussions by eminent specialists to arrive at a consensual set of tools and interpretations. In spite of this, the Impact Factor, the most famous indicator, still raises suspicions and resistance from the academic community.<\/p>\n<h3>Notes<\/h3>\n<p>\u00b9 El Profesional de la Informaci\u00f3n. 2014, vol. 23, n\u00ba 4, July-August. Available from: <a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/issue.asp?referrer=parent&amp;backto=journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/issue.asp?referrer=parent&amp;backto=journal,1,96;homemainpublications,1,1<\/a>;<\/p>\n<p>\u00b2 Euan Adie &#8211; <a href=\"http:\/\/www.scielo15.org\/euan-adie\/\" target=\"_blank\">http:\/\/www.scielo15.org\/euan-adie\/<\/a><\/p>\n<p>\u00b3 Taking the alternative mainstream &#8211;<a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,1,12;journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,1,12;journal,1,96;homemainpublications,1,1<\/a><\/p>\n<p>\u2074 NISO to Develop Standards and Recommended Practices for Altmetrics. 20 junio 2013 &#8211; <a href=\"http:\/\/www.niso.org\/news\/pr\/view?item_key=72efc1097d4caf7b7b5bdf9c54a165818399ec86\" target=\"_blank\">http:\/\/www.niso.org\/news\/pr\/view?item_key=72efc1097d4caf7b7b5bdf9c54a165818399ec86<\/a><\/p>\n<h3>References<\/h3>\n<p>ADIE, E. <em>Taking the alternative mainstream<\/em>. EPI. 2014, vol. 23, n\u00ba 4, pp. 349-351. Available from: <a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,1,12;journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,1,12;journal,1,96;homemainpublications,1,1<\/a>;<\/p>\n<p>BORREGO, A. <em>Altm\u00e9tricas para la evaluaci\u00f3n de la investigaci\u00f3n y el an\u00e1lisis de necesidades de informaci\u00f3n<\/em>. EPI. 2014, vol. 23, n\u00ba 4, pp. 352-358. Available from: <a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,2,12;journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,2,12;journal,1,96;homemainpublications,1,1<\/a>;<\/p>\n<p>GARC\u00cdA, NR., <em>et al. New data, new possibilities<\/em>: Exploring the insides of Altmetric.com. EPI. 2014, vol. 23, n\u00ba 4, pp. 359-366. Available from: <a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,3,12;journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,3,12;journal,1,96;homemainpublications,1,1<\/a>;<\/p>\n<p>SALINAS, DT., and GUISADO, YM. <em>Presencia en redes sociales y altm\u00e9tricas de los principales autores de la revista El profesional de la informaci\u00f3n<\/em>. EPI. 2014, vol. 23, n\u00ba 4, pp. 367-372. Available from:\u00a0<a href=\"http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,4,12;journal,1,96;homemainpublications,1,1\" target=\"_blank\">http:\/\/elprofesionaldelainformacion.metapress.com\/app\/home\/contribution.asp?referrer=parent&amp;backto=issue,4,12;journal,1,96;homemainpublications,1,1<\/a>;<\/p>\n<h3>External link<\/h3>\n<p>Faculty of 1000 &#8211; <a href=\"http:\/\/f1000.com\/\" target=\"_blank\">http:\/\/f1000.com\/<\/a><\/p>\n<p>Counter. <a href=\"http:\/\/www.projectcounter.org\/\" target=\"_blank\">http:\/\/www.projectcounter.org\/<\/a><\/p>\n<p>&nbsp;<\/p>\n<h3><a href=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-640\" title=\"Ernesto Spinak\" src=\"http:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-300x271.jpg\" alt=\"Ernesto Spinak\" width=\"180\" height=\"163\" srcset=\"https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-300x271.jpg 300w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-768x694.jpg 768w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-1024x926.jpg 1024w, https:\/\/blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2013\/10\/spinak-150x136.jpg 150w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/a>About Ernesto Spinak<\/h3>\n<p>Collaborator on the SciELO program, a Systems Engineer with a Bachelor\u2019s degree in Library Science, and a Diploma of Advanced Studies from the Universitat Oberta de Catalunya (Barcelona, Spain) and a Master\u2019s in \u201cSociedad de la Informaci\u00f3n\u201d (Information Society) from the same university. Currently has a consulting company that provides services in information projects to 14 government institutions and universities in Uruguay.<\/p>\n<p>&nbsp;<\/p>\n<p>Translated from the original in <a href=\"http:\/\/blog.scielo.org\/es\/2014\/08\/07\/que-nos-pueden-dar-las-metricas-alternativas-o-altmetrias\/\">Spanish<\/a> by <a href=\"http:\/\/www.nicholascopconsulting.com\/\" target=\"_blank\">Nicholas Cop Consulting<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The results and comments in four articles dedicated to altmetrics and published in an issue of EPI are analyzed. They show future possibilities and the real difficulties in the development of a new technique for the measurement of the impact of research based on social networks on the web. <span class=\"ellipsis\">&hellip;<\/span> <span class=\"more-link-wrap\"><a href=\"https:\/\/blog.scielo.org\/en\/2014\/08\/07\/what-can-alternative-metrics-or-altmetrics-offer-us\/\" class=\"more-link\"><span>Read More &rarr;<\/span><\/a><\/span><\/p>\n","protected":false},"author":8,"featured_media":1234,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[3],"tags":[30,31,34],"class_list":["post-1231","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analysis","tag-altmetric","tag-research-evaluation","tag-social-networks"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1231","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=1231"}],"version-history":[{"count":5,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1231\/revisions"}],"predecessor-version":[{"id":1663,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/1231\/revisions\/1663"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/1234"}],"wp:attachment":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=1231"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=1231"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=1231"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}