{"id":8101,"date":"2018-11-07T14:16:19","date_gmt":"2018-11-07T20:16:19","guid":{"rendered":"http:\/\/amelica.org\/?p=8101"},"modified":"2023-09-21T21:52:52","modified_gmt":"2023-09-21T21:52:52","slug":"the-geopolitical-games-of-research-assessment","status":"publish","type":"post","link":"https:\/\/amelica.org\/index.php\/en\/2018\/11\/07\/the-geopolitical-games-of-research-assessment\/","title":{"rendered":"The geopolitical games of research assessment"},"content":{"rendered":"

Mar\u00eda Alejandra Tejada G\u00f3mez<\/strong><\/span><\/p>\n

Research assessment has suffered transformation in the last years. One of the main tensions is corporatization by databases (Web of Science \u2014Wos\u2014 and Scopus) and the rankings mediated by the impact factor. Some have called this phenomenon commodification or corporatization<\/em> of knowledge production, where any type of knowledge or form of dissemination has had to be framed within the templates that come, mainly, from basic sciences (Tejada-G\u00f3mez, 2019).<\/span><\/span><\/p>\n

The stances to make use of these tools in science assessment are diverse. On the one hand, these tools based on information science, scientometrics and bibliometrics allow to visualize patterns of scientific output per field, institution and country (Moed, 2017)<\/span>. This has been used by multilateral organizations, rankings and scientific policies as evaluation tools with regards to quality and internationalization standards based on information science for research assessment\u00a0(Gl\u00e4ser, 2018)<\/span>.<\/span><\/p>\n

The dark side is about handing in scientific research output to commercial corporations that index knowledge\u2014funded publicly or funded by universities and research institutions\u2014and who, then, sell it back to universities. This is knowledge production with twofold taxation, losing its intellectual property.<\/span><\/p>\n

Information science has been criticized from different perspectives in social sciences Leckie, Given, & Buschman (2010)<\/span> arguing the lack of metaphorical discourses that take symbolic violence in knowledge production, Bourdieu; Democracy of knowledge, Habermas; Power-knowledge, Foucault; Resistance, Michel Ceratau; Creating spaces for the other, Jacques Derrida; Critical information, modernity, Heidegger; Documenting human and non-human associations, Laboratory life, Latour; Laws of the markets, Callon.<\/span><\/p>\n

Some responses to the scientific production movements have been given by China, the measures regulating scientific data called Data Sovereignty (Jing & Yin, 2018)<\/span>, applicable laws and regulations that regulate data privacy and State secrets, where data confidentiality agreements are priority but gathering data for the benefit of institutions and the state as well, which are indexed and generate their own metrics and indicators of knowledge production for the country’s use and benefit.\u00a0<\/span><\/p>\n

Other responses are focused on developing new models of research practice and dissemination, such as open access information movements, which stress the good practices of research assessment as well as responsible research assessment with qualitative and quantitative criteria in disciplinary and local contexts. Among the most representatives we find: Altmetrics Manifesto<\/strong><\/a><\/span>\u00a0(2010)\u00a0(J. Priem, 2010),<\/span>\u00a0DORA Declaration on Research Assesment<\/strong><\/a><\/span>\u00a0(2012)<\/span>,\u00a0Leiden Manifiesto (2015) a guide to improving research evaluation practices<\/strong><\/span>\u00a0<\/a>(Hicks, Wouters, Waltman, de Rijcke, & Rafols, 2015)<\/span>,\u00a0Research Excellence Framework (REF)<\/strong><\/a><\/span>\u00a0UK report \u201cThe Metric Tide\u2018\u00a0 Responsible metrics (2015)<\/span>,\u00a0Responsible metrics and evaluation for open science European Union (2017)<\/strong><\/a><\/span>\u00a0(Wilsdon, 2017)<\/span>.<\/span><\/p>\n

The impact measure of research has taken new meanings beyond the Impact Factor such as the social, professional, economic, technological, political, organizational, environmental, health, cultural, symbolical, educational impact (Benoit & Dor\u00e9 , 2004)<\/span>.\u00a0 Researchers in the United Kingdom report on the products of dissemination that respond to the social impact of their researches (with new ways of dissemination that allow responding to different stakeholders of interest\u2014engagement stakeholders\u2014to public policies, and be cited by professional communities and other kind of audiences) (Rafols, 2018).<\/span><\/span><\/p>\n

Technologies have generated new ways to produce knowledge, it’s the big data – data science era, we work with research data in real time “Current Research Information system.” Other forms of dissemination are tied to preprints, specialized repositories (Robinson-Garc\u00eda, Repido , & Torres-Salinas , 2018).<\/span><\/span><\/p>\n

Latin American Context <\/strong><\/span><\/p>\n

In Latin American national policies measuring groups, production and scientific journals are based on TOP products mediated by quartiles of databases, such as WoS and Scopus, which criteria are the same considered by the rankings. The indicator becomes the ends not the means, numbers are prioritized as opposed to quality of scientific content. The gist of this is the patrimonial detriment of Latin American scientific production which is not represented in such corporative systems. At the bottom of the discussion lies the incentive system that universities define for the benefit of researchers.<\/span><\/p>\n

It\u2019s urgent for the region to work on assessment indicators, appropriate to the forms and models of production developed in our contexts (Alperin & Fishman, 2015)<\/span>. These corporations are the great players of the science system, other forms of production, however, that represent, by discipline or context, a field of knowledge or a particular region shouldn\u2019t remain unacknowledged. Accordingly, opening the door to the diversification of knowledge dissemination that responds in a disciplinary and contextual way is advisable. For instance, developing manuals on good practices of scientific dissemination and production per field of knowledge that leads to appropriateness.<\/span><\/p>\n

Some countries in their models of research assessment and measurement have included other databases such as Scielo, whose scope and representation for the region is greater, however, it\u2019s still selective. Unknown is the tough work of databases such as Redalyc, repositories by disciplines or institutions, digital libraries or analyses with google scholar that represent more the knowledge of the region (Romero-Torres, 2013).<\/span><\/span><\/p>\n

In terms of research assessment it\u2019s advisable to follow the best practices with methods for research assessment in a quantitative and qualitative way, bearing in mind the reflections proposed in the Leiden manifesto (Hicks, Wouters, Waltman, de Rijcke, & Rafols, 2015)<\/span>, Altmetrics\u00a0(J. Priem, 2010)<\/span>, San Francisco DORA\u00a0Declaration on Research Assessment<\/em>\u00a0(2012), and responsible metrics UK\u00a0(Wilsdon, 2017)<\/span>.<\/span><\/p>\n

\n

REFERENCES:<\/strong><\/span><\/p>\n

Benoit , G., & Dor\u00e9 , C. (2004). Measuring the Impacts of Science: Beyond the Economic Dimension. Canada: CSIIC Working Paper, CSIIC.<\/span><\/p>\n

Gl\u00e4ser, J. (2018). Accounting for field-specific research practices in surveys. 23th International conference on Science and technology Indicadors (STI 2018) Science, technology and innovation indicators in transition. Leiden Netherlands: CTWS. Available at:\u00a0https:\/\/openaccess.leidenuniv.nl\/bitstream\/handle\/1887\/65277\/STI2018_paper_223.pdf?sequence=1<\/a><\/span><\/p>\n

Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics.\u00a0Nature<\/em>, 429 \u2013 431.<\/span><\/p>\n

Priem, D. T. (2010). Altmetrics: A manifesto. Retrieved from http:\/\/altmetrics.org\/manifesto.<\/a><\/span><\/p>\n

Jing, C., & Yin, A. (2018). Brief introduction to the new measures regulating scientific data in China. Shangai : Reed Smith Client Alerts .<\/span><\/p>\n

Leckie, G. J., Given, L. M., & Buschman, J. (2010). Critical Theory for Library and Information Science: Exploring the Social from Across the Disciplines. San Barbara California: ABC CLIO LLC.<\/span><\/p>\n

Moed, H. F. (2017). Applied Evaluative Informetrics. Springer International Publishing. Retrieved from\u00a0https:\/\/arxiv.org\/abs\/1705.06110<\/a><\/span><\/p>\n

Molas, J., & Salter, A. (2010). Measuring third stream activities. Science and Technology Policy Research \u2013SPRU-.<\/span><\/p>\n

Rafols, I. (September 10th<\/sup>, 2018). S&T indicators \u2018in the wild\u2019: contextualisation and participation for responsible metrics . Opgehaald van Blog CWTS. Retrieved from\u00a0https:\/\/www.cwts.nl\/blog?article=n-r2u254&title=st-indicators-in-the-wild-contextualisation-and-participation-for-responsible-metrics<\/a><\/span><\/p>\n

Robinson-Garc\u00eda, N., Repido , R., & Torres-Salinas , D. (May, 2018). Perspectivas y retos de los profesionales de la evaluaci\u00f3n cient\u00edfica.\u00a0El profesional de la informaci\u00f3n,<\/em>\u00a0461-466.<\/span><\/p>\n

Romero-Torres, M. A.-M.-G. (2013). Ranking de revistas cient\u00edficas en Latinoam\u00e9rica mediante el \u00edndice h: estudio de caso Colombia. Revista Espa\u00f1ola de Documentaci\u00f3n Cient\u00edfica, 36(1). Retrieved from http:\/\/redc.revistas.csic.es.<\/a><\/span><\/p>\n

Tejada-G\u00f3mez, M. A. (2019). Tejada-G\u00f3mez, M. A. (2018). University research governance, responds to the tensions of Scientific Journal Policy Publindex in Colombia (SJPPC). Thesis in process. Enschede, Twente, Netherlands: Twente University.<\/span><\/p>\n

Vinck, D. (2013). Las culturas y humanidades digitales como nuevo desaf\u00edo para el desarrollo de la ciencia y la tecnolog\u00eda en Am\u00e9rica latina.\u00a0<\/em>Universitas Human\u00edstica, 76<\/em>(76), 51-72. Retrieved from http:\/\/revistas.javeriana.edu.co\/index.php\/univhumanistic<\/a><\/span><\/p>\n

Wilsdon, J. e. (2017). Next-generation metrics: Responsible metrics and evaluation for open science. Report of the European Commission Expert Group on Altmetrics. Brussels: European Commission.<\/span><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Mar\u00eda Alejandra Tejada G\u00f3mez Research assessment has suffered transformation in the last years. One of the main tensions is corporatization by databases (Web of Science \u2014Wos\u2014 and Scopus) and the rankings mediated by the impact factor. Some have called this phenomenon commodification or corporatization of knowledge production, where any type of knowledge or form of […]<\/p>\n","protected":false},"author":33,"featured_media":4283,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[218],"tags":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/posts\/8101"}],"collection":[{"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/users\/33"}],"replies":[{"embeddable":true,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/comments?post=8101"}],"version-history":[{"count":1,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/posts\/8101\/revisions"}],"predecessor-version":[{"id":13916,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/posts\/8101\/revisions\/13916"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/media\/4283"}],"wp:attachment":[{"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/media?parent=8101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/categories?post=8101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/amelica.org\/index.php\/wp-json\/wp\/v2\/tags?post=8101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}