{"id":5612,"date":"2025-05-07T10:00:04","date_gmt":"2025-05-07T13:00:04","guid":{"rendered":"https:\/\/blog.scielo.org\/en\/?p=5612"},"modified":"2025-05-07T09:03:20","modified_gmt":"2025-05-07T12:03:20","slug":"research-integrity-and-human-agency-in-research-gen-ai","status":"publish","type":"post","link":"https:\/\/blog.scielo.org\/en\/2025\/05\/07\/research-integrity-and-human-agency-in-research-gen-ai\/","title":{"rendered":"Research Integrity and Human Agency in Research Intertwined with Generative AI"},"content":{"rendered":"

By Sonia Vasconcelos and Ana Maru\u0161i\u0107<\/strong><\/p>\n

\"Photograph<\/a>

Image: Bernd Dittrich via Unsplash<\/a>.<\/em><\/p><\/div>\n

Since the popularization of Generative Artificial Intelligence (Gen AI) models, especially OpenAI’s ChatGPT<\/a>, at the end of 2022, there has been a gradual and profound transformation in the research endeavor (Nature<\/em>, 2023<\/a>; Noorden, R.V. and Webb, R., 2023<\/a>). Underpinning this ongoing change is the ethical regulation of Gen AI use, considering its disruptive potential for science at large, with unprecedented influence on scientific communication. The increasing autonomy of these systems and their interaction with what we call human agency (Bandura, A., 1989<\/a>; Pew Research Center, 2023<\/a>) is one of the sensitive points in this process.<\/p>\n

It can be argued that scientific communication is undergoing a reconfiguration process that, from a conservative perspective, is as paradigmatic as the one triggered by the creation of the first scientific journal, Philosophical Transactions<\/em>, in 1665, in England. From a more disruptive perspective, this transformation will reconfigure the entire scientific culture, redefining the autonomy of scientists and institutions in the production and certification of knowledge\u2014an impact whose dimension is still not possible to estimate.<\/p>\n

This more radical view posits that as Gen AI becomes more integrated into research activities and society at large, it goes beyond merely being a new tool or adapting existing scientific practices to a new technical framework. The incorporation of Gen AI in science (regardless of the debates over the term) suggests a fundamental shift in the foundations of scientific activity, potentially transforming both the methods and goals of scientific research. Also, it is dual-use technology, and as such, it can serve both beneficial and harmful purposes.<\/p>\n

According to the report Generally Faster: The Economic Impact of Generative AI<\/a>1<\/a><\/sup> (McAfee, A., 2024), Gen AI constitutes a technology capable of generating original content, continuously improving through its own usage, and exhibiting widespread economic and social impacts more rapidly than previous technologies. As described by Krakowski in Human-AI agency in the Age of Generative AI<\/a>2<\/a><\/sup>(2025),<\/p>\n

unlike predictive AI, which often requires technical expertise and infrastructure to implement and use effectively, GenAI’s pretrained nature and natural-language interfaces lower adoption barriers. This allows humans without IT [Information Technology], data science, or programming skills to engage with AI systems [\u2026]. The accessibility and affordability of contemporary frontier models, such as GPT-4o for general-purpose multimodal uses, GitHub Copilot<\/a> for coding and software development, or Pi<\/a> for tasks involving social and emotional dimensions, along with open models like Llama 3<\/a> (Meta) and DeepSeek-R1<\/a> (DeepSeek AI), have made advanced AI capabilities widely available at little to no cost.2<\/a><\/sup><\/p><\/blockquote>\n

In this reshaping technological environment that intersects human and artificial intelligence (IBM IBV, 2024<\/a>), the potential autonomy of Gen AI models and systems necessitates critical anticipation of their implications, including within the scientific context (European Research Council, ECR, 2023<\/a>).<\/p>\n

Eric Schmidt, former CEO and executive director of Google, along with Henry Kissinger and Daniel Huttenlocher, advocate for proactive and strategic ethical regulation of AI applications in their book Genesis: Artificial Intelligence, Hope, and the Human Spirit<\/em>3<\/a><\/sup> (Kissinger, H., et al<\/em>., 2024), with unprecedented implications for governance in countries concerning, for example, the autonomy of Gen AI systems. As highlighted by Kissinger, et al.<\/em> (2024),<\/p>\n

AI\u2019s future faculties, operating at inhuman speeds, will render traditional regulation useless… we have very little independent ability to verify AI models\u2019 internal workings, let alone their intentions. We will need a fundamentally new form of control.3<\/a><\/sup><\/p><\/blockquote>\n

Schmidt in Eric Schmidt on AI\u2019s Future: Infinite Context, Autonomous Agents, and Global Regulation<\/em><\/a>4<\/a><\/sup>(2024) envisions a future where millions of AI agents will be capable of learning, evolving, and collaborating among themselves, comparing this scenario to a “GitHub for AI.” In his perspective, these agents would operate as autonomous systems, driving what he refers to as exponential innovations across various domains.<\/p>\n

However, Schmidt cautions that as these AI agents communicate independently, “they may develop their own protocols or languages”, creating risks that are difficult for humans to manage and understand: “At some point, they\u2019ll develop their own language. When that happens, we may not understand what they\u2019re doing, and that\u2019s when you pull the plug”.<\/p>\n

Complementing this vision, McAfee1<\/a><\/sup> (2024) emphasizes that much of the infrastructure needed for Gen AI to function is already widely available, accelerating its impact compared to previous technologies. In Gen AI, access is not restricted to developers only, but also to direct users, speeding up the transformation at an unprecedented pace.<\/p>\n

Mixed feelings about the impact of Generative AI on the research activity<\/h3>\n

In the academic realm, the uses and perceptions of its impact on scientific activity still vary widely among researchers. The ExplanAItions<\/em><\/a>5<\/a><\/sup> survey by Wiley, described about three months ago in How are Researchers Using AI? Survey Reveals Pros and Cons for Science<\/em><\/a>,6<\/a><\/sup> and published on Nature<\/em> (Nadaff, M., 2025), illustrates this observation. It involved 4,946 researchers from different fields and over 70 countries and showed that the use of Gen AI as part of the research \u00a0activity is still limited.<\/p>\n

The survey found that only 45% of respondents (1,043 researchers) used Gen AI to assist in their research, primarily focusing on translation, drafting, and manuscript review. Additionally, 81% of these researchers had used OpenAI\u2019s ChatGPT for personal or professional purposes, but only about a third were familiar with other Gen AI tools, such as Google’s Gemini<\/a> and Microsoft’s Copilot<\/a>. There were variations between countries and disciplines, with computer scientists being, naturally, more likely to use Gen AI in these activities.<\/p>\n

Based on this survey, Nadaff6<\/a><\/sup> (2025) reports that researchers remain skeptical about the capabilities of Gen AI for more complex tasks in the research process, such as identifying literature gaps or recommending reviewers. Most participants believe that these and other tasks in science are better performed by humans.<\/p>\n

“Although 64% of respondents are open to using AI for these tasks in the next two years, the majority thinks that humans still outperform AI in these areas.”6<\/a><\/sup> Besides this issue, “[r]esearchers are also concerned about the safety of using these tools 81% of respondents said they had concerns about AI\u2019s accuracy, potential , privacy risks and the lack of transparency in how these tools are trained.”6<\/a><\/sup><\/p>\n

The survey Foresight: Use and Impact of Artificial Intelligence in the Scientific Process<\/em><\/a>7<\/a><\/sup> on AI usage in scientific practice conducted by the European Research Council (2023), based on a population of researchers associated with 1,046 projects registered with the agency, identified uses of Gen AI for drafting and editing, translating texts, coding, programming, and generating images, among other uses.<\/p>\n

The ERC report (2023) describes that in the life sciences, whose participants represent 18% of the total survey respondents, “AI methods, for instance, to understand individual differences in large cohorts, and to make predictions about diagnosis or outcome of targeted therapies”7<\/a><\/sup> and that “[AI tools are seen n as an essential support to analyze datasets of genomic, epigenomic and transcriptomic data\u2026”7<\/a><\/sup> in addition to comparing different stages of a given disease, for instance.<\/p>\n

For participants in the social sciences and humanities, who account for 29% of total respondents,<\/p>\n

neural networks and natural language processing (NLP) tools are used for a wide range of applications, e.g. models for handwritten text recognition and automatic speech recognition, or the automatic classification of musical compositions… AI is used to identify vocal biomarkers of stress in voice samples, to detect extreme speech in online discussions… for model-based data analysis for decoding and comparing mental representations in the brain or predicting\/simulating human learning…7<\/a><\/sup><\/p><\/blockquote>\n

However, as in the Wiley survey reported by Nadaff6<\/a><\/sup> (2025), the ERC (2023) survey reveals that “[e]xpectations regarding the use of AI for scientific discovery, however, varied among respondents.”7<\/a><\/sup><\/p>\n

In the article Gen AI and Research Integrity: Where to Now?: The Integration of Generative AI in the Research Process Challenges Well-Established Definitions of Research Integrity<\/em><\/a>,8<\/a><\/sup> recently published in EMBO Reports<\/em> (Vasconcelos, S. and Maru\u0161i\u0107, A, 2025), we explored other aspects of the research activity involving Gen AI. We emphasize the importance of developing strategies that prioritize human agency and oversight in this collaboration between humans and Gen AI in research. An intriguing question in this context is the extent of influence to be allowed in this interaction between researchers and Gen AI models in the research process.<\/p>\n

Integration of Generative AI in the research activity\u2014questions about human agency and alignment<\/h3>\n

It is crucial for the research ecosystem, including authors, funders, and research institutions, to engage in discussions and initiatives that address alignment challenges (Russel, S., 2019<\/a>)9<\/a><\/sup> and deployment of these models. We acknowledge that transparency in using Gen AI for scientific communication is a necessary action that has been growing within the publication system.<\/p>\n

However, we also understand that a comprehensive view of the problem, which impacts the definitions of research integrity established globally, is fundamental. Inspired by David Stokes’s Diagram on Scientific Research (1997), which presents the famous Pasteur’s Quadrant, we proposed a model to represent research integrity and its relationship with human agency, both individual and collective, under different conditions. Each quadrant of the model offers a distinct perspective on this relationship and its potential implications for research governance.<\/p>\n

This framework allows us to assess integrity from a viewpoint that reflects the level of agency and autonomy that researchers possess and that they might opt to delegate when engaging in research that involves collaboration with Gen AI. The model can be accessed in Vasconcelos and Maru\u0161i\u01078<\/a><\/sup> (2025).<\/p>\n

As discussed,<\/p>\n

Gen AI is already affecting every stage of the research process from formulating a hypothesis to designing experiments, data analysis, visualization and interpretation of results, writing a research paper and even peer review (Ifargan, T., et al.<\/em><\/a>, 2024; Binz, M., et al.<\/em><\/a>, 2025; Naddaf, M., 2025). As it challenges both the notion of individual responsibility as well as community-standards of good research practices, integrating Gen AI into the research endeavor, while maintaining trustworthiness, has become an urgent demand in academia.8<\/a><\/sup><\/p><\/blockquote>\n

Citing Dua and Patel (2024)<\/a>, who detail the potentialities of Gen AI, we emphasize a growing consensus in the publication system on the urgent need to revisit ethical standards and verification processes in research permeated by these technologies. In the realm of experimental research, in Empowering Biomedical Discovery with AI Agents<\/em><\/a>,10<\/a><\/sup> Gao, et al<\/em>. (2024) envision scientific AI agents “as systems capable of skeptical learning and reasoning that empower biomedical research through collaborative agents that integrate AI models and biomedical tools with experimental platforms.”<\/p>\n

Gao, et al<\/em>.10<\/a><\/sup> (2024) note that intersections among technological, scientific, ethical, and regulatory domains have an important role for developing effective governance structures. As mentioned earlier, as these AI agents reach higher levels of autonomy, such concerns become even more relevant.<\/p>\n

As pointed out by Kissinger, et al.<\/em>3<\/a><\/sup> (2024) and also reflected in the analyses of Gao, et al.<\/em>10<\/a><\/sup> (2024), dealing with this emerging autonomy represents a challenge that requires a broad and robust debate within the scientific community, especially regarding the alignment of these systems, with the goals of preserving research integrity and public trust in science. Questions about alignment and human agency are interdependent but far from trivial.<\/p>\n

In the EMBO Reports<\/em> article,8<\/a><\/sup> we cite the 2023 report The Future of Human Agency<\/a>.11<\/a><\/sup> In this document, Pew Research Center presents an exploration of “how much control people will retain over essential decision-making as digital systems and AI spread.” As described in the article,8<\/a><\/sup> Pew and Elon University\u2019s Imagining the Internet Center invited various stakeholders, including David J. Krieger, director of the Institute for Communication and Leadership in Lucerne, Switzerland. In Krieger’s view,<\/p>\n

[i]ndividual agency is already a myth, and this will become increasingly obvious with time… Humanism attempts to preserve the myth of individual agency and enshrine it in law. Good design of socio-technical networks will need to be explicit about its post-humanist presuppositions in order to bring the issue into public debate. Humans will act in partnership\u2014that is, distributed agency\u2014with technologies of all kinds.8<\/a><\/sup><\/p><\/blockquote>\n

As detailed in the article, “Human agency and oversight are among the operational key requirements supporting ethical principles for AI systems established by the European Commission, as part of its Living Guidelines on the Responsible Use of Generative AI in Research<\/a>12<\/a><\/sup> (2024).”8<\/a><\/sup><\/p>\n

We also addressed the Ethics Guidelines for Trustworthy AI<\/em><\/a>13<\/a><\/sup> (2019). These guidelines present<\/p>\n

three levels of human agency and oversight: human-in-the-loop (HITL), human-on-the-loop (HOTL), and human-in-command (HIC) approaches. HITL entails human intervention for the whole decision cycle; HOTL involves human input during the design cycle and continuous monitoring of the system’s operations; HIC encompasses human oversight of the entire activity of the AI system, including societal and ethical impacts, as well as decision-making for when and how to use the system in various contexts.8<\/a><\/sup><\/p><\/blockquote>\n

Human agency and oversight are essential in the research activity, but not sufficient<\/h3>\n

In the EMBO Reports<\/em> article,8<\/a><\/sup> alignment in human-Gen AI collaboration is explored as a sensitive issue, reflecting concerns with the culture of scientific communication over the last decades. In Strong and Weak Alignment of Large Language Models with Human Values<\/a>,14<\/a><\/sup> Khamassi, et al<\/em>. (2024) highlight timely issues about “strong and weak value alignment” of Large Language Models (LLMs) with human values and the complexities of AI’s understanding of these values.<\/p>\n

In Training Language Models to Follow Instructions with Human Feedback<\/a>,15<\/a><\/sup> Ouyang, et al<\/em>. (2022) say that “apart from its caveats, alignment has a key role in fine-tuning LLMs to respond adequately to human intentions while mitigating harmful, toxic, or biased content.”15<\/a><\/sup> For a broader view of Gen AI model alignment, we cite Open AI, which introduced “deliberate alignment”: a training paradigm to ensure reasoning LLMs behave in a manner consistent with predefined safety criteria before generating responses to commands (Guan, M.Y., et al., 2024<\/a>).<\/p>\n

We argue that, even from the perspective of LLMs as “stochastic parrots”, a debated interpretation, adopted by Emily Bender, et al<\/em>. (2021)<\/a> “to emphasize that these systems remix patterns in their training data without true understanding, alignment remains a critical issue.”16<\/a><\/sup> It is crucial for the academic community to carefully consider the role of alignment in Gen AI systems.<\/p>\n

Given that training data is mostly derived from human-created data, it inherently reflects cultural patterns, worldviews, and social biases, along with the strengths and flaws of human knowledge production. As a result, Gen AI models risk reproducing\u2014or even amplifying\u2014biases in their outputs. When it comes to interacting with Gen AI models to formulate hypotheses, analyze data, or write a research report, how alignment shapes the output and behavior is a critical issue.8<\/a><\/sup> (Vasconcelos, S. and Maru\u0161i\u0107, A., 2025)<\/p><\/blockquote>\n

In the article, we note that many LLMs are continually trained and updated with new data in a scientific environment where the publication culture tends to favor positive or biased reports (Ghannad, M., et al<\/em>., 2019<\/a>; Boutron, I. and Ravaud, P., 2018<\/a>). This tradition does not incentivize the open exposure of errors, which limits scientific transparency and reinforces biased communication norms (Nature<\/em>, 2012<\/a>; Psychological<\/em> Science Observer<\/em>, 2021<\/a>; Nature Communications<\/em>, 2024<\/a>).<\/p>\n

These elements comprise long-term structural challenges for the alignment and responsible deployment of Gen AI models, which researchers already interact with\u2014and will continue to\u2014in their research practices.<\/p>\n

Notions of research integrity naturally incorporate human agency, but now it needs to be explicit<\/h3>\n

Research integrity is closely tied to adherence to ethical, transparent, and rigorous scientific practices, relying on individual and collective responsibility, as well described by Luiz Henrique Lopes dos Santos in Sobre a integridade \u00e9tica da pesquisa<\/em><\/a>17<\/a><\/sup> (2017).<\/p>\n

However, as we highlight in the article, the notion of research integrity cultivated over time assumes human agency as a given. Now, with the ongoing integration of Gen AI into all stages of the research process, it becomes crucial to place greater emphasis on “human agency” within the definitions of research integrity. We believe this emphasis is vital for ensuring informed decision-making in the emerging research landscape.<\/p>\n

Our proposal is that definitions of research integrity should explicitly incorporate “human agency” as an essential component for the proposal, conduct, communication, and review of research. This expanded approach should also include the development of benchmarks for research integrity in the training and deployment of Gen AI models and systems.<\/p>\n

In the biomedical sciences, these concerns are particularly pertinent to the governance of AI agents, but, as has been pointed out, their implications are far-reaching. It is crucial to address these sensitive issues in decision-making domains within the research enterprise, especially in the context of human collaboration with Gen AI systems. This necessity is justified by the increasing capabilities and potential of Gen AI to exert significant influence over research processes across all fields of knowledge.<\/p>\n

As noted in the EMBO Reports<\/em> article,8<\/a><\/sup> academia should and can take a more proactive stance in seeking an understanding of the close relationship between research integrity and human agency in times of profound transformation in knowledge production. We argue that this should not be a long-term goal, as Gen AI has the potential to redefine standards and influence the reliability and culture of scientific communication among peers and to different audiences.<\/p>\n

By explicitly integrating human agency into definitions of research integrity, researchers and policymakers acknowledge that the autonomy of Gen AI systems must be balanced with human agency and oversight, cultivating responsible use and ethical regulatory policies for research involving human and Gen AI collaboration.<\/p>\n

Notes<\/h3>\n

1. McAFEE, A. Generally Faster: The Economic Impact of Generative AI [online]. The MIT Initiative on the Digital Economy (IDE). 2024 [viewed 7 May 2025]. Available from: https:\/\/ide.mit.edu\/wp-content\/uploads\/2024\/04\/Davos-Report-Draft-XFN-Copy-01112024-Print-Version.pdf?x76181<\/a> \u21a9<\/a><\/p>\n

2. KRAKOWSKI, S. Human-AI Agency in the Age of Generative AI. Information and Organization<\/em> [online]. 2025, vol. 35, no. 1, 100560, ISSN: 1471-7727 [viewed 7 May 2025]. https:\/\/doi.org\/10.1016\/j.infoandorg.2025.100560<\/a>. Available from: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1471772725000065?via%3Dihub<\/a> \u21a9<\/a><\/p>\n

3. KISSINGER, H.A., SCHMIDT, E. and MUNDIE, C. Genesis: Artificial Intelligence, Hope, and the Human Spirit. New York: Little Brown and Company, 2024 \u21a9<\/a><\/p>\n

4. Eric Schmidt on AI\u2019s Future: Infinite Context, Autonomous Agents, and Global Regulation [online]. The National CIO Review. 2024 [viewed 7 May 2025]. Available from: https:\/\/nationalcioreview.com\/video\/eric-schmidt-on-ais-future-infinite-context-autonomous-agents-and-global-regulation\/<\/a> \u21a9<\/a><\/p>\n

5. ExplanAItions: An AI Study by Wiley [online]. Wiley. 2025 [viewed 7 May 2025]. Available from: https:\/\/www.wiley.com\/content\/dam\/wiley-dotcom\/en\/b2c\/content-fragments\/explanaitions-ai-report\/pdfs\/Wiley_ExplanAItions_AI_Study_February_2025.pdf<\/a> \u21a9<\/a><\/p>\n

6.NADDAF, M. How are Researchers Using AI? Survey Reveals Pros and Cons for Science [online]. Nature. 2025 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/d41586-025-00343-5<\/a>. Available from: https:\/\/www.nature.com\/articles\/d41586-025-00343-5<\/a> \u21a9<\/a><\/p>\n

7. EUROPEAN RESEARCH COUNCIL. Foresight: Use and Impact of Artificial Intelligence in the Scientific Process [online]. European Research Council. 2023 [viewed 7 May 2025]. Available from: https:\/\/erc.europa.eu\/sites\/default\/files\/2023-12\/AI_in_science.pdf<\/a> \u21a9<\/a><\/p>\n

8. VASCONCELOS, S. and MARU\u0160I\u0106, A. Gen AI and Research Integrity: Where to now?: The Integration of Generative AI in the Research Process Challenges Well-Established Definitions of Research Integrity. EMBO Reports<\/em> [online]. 2025, vol. 26, pp. 1923\u20131928 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/s44319-025-00424-6<\/a>. Available from: https:\/\/www.embopress.org\/doi\/full\/10.1038\/s44319-025-00424-6<\/a> \u21a9<\/a><\/p>\n

9. In the book Human compatible: artificial intelligence and the problem of control<\/a> by Stuart Russel (2019), the following is described: “Putting a purpose into a machine that optimizes its behavior according to clearly defined algorithms seems an admirable approach to ensuring that the machine\u2019s behavior furthers our own objectives. But, as Wiener warns, we need to put in the right purpose. We might call this the King Midas problem: Midas got exactly what he asked for\u2014namely, that everything he touched would turn to gold\u2014but, too late, he discovered the drawbacks of drinking liquid gold and eating solid gold. The technical term for putting in the right purpose is value alignment. When it fails, we may inadvertently imbue machines with objectives counter to our own.” \u21a9<\/a><\/p>\n

10. GAO, S., et al<\/em>. Empowering Biomedical Discovery with AI Agents. Cell<\/em> [online]. 2024, vol. 187, no. 22, pp. 6125\u20136151, ISSN: 0092-8674 [viewed 7 May 2025]. https:\/\/doi.org\/10.1016\/j.cell.2024.09.022<\/a>. Available from: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0092867424010705<\/a> \u21a9<\/a><\/p>\n

11. PEW RESEARCH CENTER. The Future of Human Agency [online]. Pew Research Center. 2023 [viewed 7 May 2025]. Available from: https:\/\/www.pewresearch.org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_2023.02.24_The-Future-of-Human-Agency_FINAL.pdf<\/a> \u21a9<\/a><\/p>\n

12. EUROPEAN COMMISSION. Living Guidelines on the Responsible Use of Generative AI in Research [online]. European Commission\u2014Research and innovation. 2025 [viewed 7 May 2025]. Available from: https:\/\/research-and-innovation.ec.europa.eu\/document\/download\/2b6cf7e5-36ac-41cb-aab5-0d32050143dc_en<\/a> \u21a9<\/a><\/p>\n

13. Ethics Guidelines for Trustworthy AI [online]. European Commission, official website. 2019 [viewed 7 May 2025]. Available from: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai<\/a> \u21a9<\/a><\/p>\n

14. KHAMASSI, M., NAHON, M. and CHATILA, R. Strong and Weak Alignment of Large Language Models with Human Values. Sci Rep<\/em> [online]. 2024, vol. 14, 19399 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/s41598-024-70031-3<\/a>. Available from: https:\/\/www.nature.com\/articles\/s41598-024-70031-3<\/a> \u21a9<\/a><\/p>\n

15. OUYANG, L., et al<\/em>. Training Language Models to Follow Instructions with Human Feedback. In: Advances in Neural Information Processing Systems 35 (NeurIPS 2022), New Orleans, 2022 [viewed 7 May 2025]. Available from: https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/hash\/b1efde53be364a73914f58805a001731-Abstract-Conference.html<\/a> \u21a9<\/a><\/p>\n

16. BENDER, E., et al<\/em>. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? In: FAccT ’21: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, 2021 [viewed 7 May 2025]. https:\/\/doi.org\/10.1145\/3442188.3445922<\/a>. Available from: https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445922<\/a> \u21a9<\/a><\/p>\n

17. SANTOS, L.H.L. Sobre a integridade \u00e9tica da pesquisa. Cienc. Cult.<\/em> [online]. 2017, vol.69, no.3, pp. 4\u20135, ISSN: 2317-6660 [viewed 7 May 2025]. http:\/\/doi.org\/10.21800\/2317-66602017000300002<\/a>. Available from: http:\/\/cienciaecultura.bvs.br\/scielo.php?script=sci_arttext&pid=S0009-67252017000300002<\/a> \u21a9<\/a><\/p>\n

References<\/h3>\n

BANDURA, A. Human Agency in Social Cognitive Theory. American Psychologist<\/em> [online]. 1989, vol. 44, no. 9, pp. 1175\u20131184 [viewed 7 May 2025]. https:\/\/doi.org\/10.1037\/0003-066X.44.9.1175<\/a>. Available from: https:\/\/psycnet.apa.org\/doiLanding?doi=10.1037%2F0003-066X.44.9.1175<\/a><\/p>\n

BENDER, E., et al<\/em>. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? In: FAccT ’21: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, 2021 [viewed 7 May 2025]. https:\/\/doi.org\/10.1145\/3442188.3445922<\/a>. Available from: https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445922<\/a><\/p>\n

BINZ, M., et al<\/em>. How Should the Advancement of Large Language Models Affect the Practice of Science? Proc. Natl. Acad. Sci. U.S.A.<\/em> [online]. 2025, vol. 122, no. 5, e2401227121 [viewed 7 May 2025]. https:\/\/doi.org\/10.1073\/pnas.240122712<\/a>. Available from: https:\/\/www.pnas.org\/doi\/10.1073\/pnas.2401227121<\/a><\/p>\n

BOUTRON, I. E RAVAUD, P. Misrepresentation and Distortion of Research in Biomedical Literature. Proc. Natl. Acad. Sci. U.S.A.<\/em> [online]. 2028, vol. 115, no. 11, pp. 2613\u20132619 [viewed 7 May 2025]. https:\/\/doi.org\/10.1073\/pnas.1710755115 <\/a>. Available from: https:\/\/www.pnas.org\/doi\/full\/10.1073\/pnas.1710755115 <\/a><\/p>\n

DUA, I.K. and PATEL, P.G. An Introduction to Generative AI<\/em>. In: DUA, I.K. and PATEL, P.G. (authors) Optimizing Generative AI Workloads for Sustainability: Balancing Performance and Environmental Impact in Generative AI. New York: Apress, 2024.<\/p>\n

Eric Schmidt on AI’s Future: Infinite Context, Autonomous Agents, and Global Regulation [online]. The National CIO Review. 2024 [viewed 7 May 2025]. Available from: https:\/\/nationalcioreview.com\/video\/eric-schmidt-on-ais-future-infinite-context-autonomous-agents-and-global-regulation\/<\/a><\/p>\n

Ethics Guidelines for Trustworthy AI [online]. European Commission, official website. 2019 [viewed 7 May 2025]. Available from: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai<\/a><\/p>\n

EUROPEAN COMMISSION. Living Guidelines on the Responsible Use of Generative AI in Research [online]. European Commission\u2014Research and innovation. 2025 [viewed 7 May 2025]. Available from: https:\/\/research-and-innovation.ec.europa.eu\/document\/download\/2b6cf7e5-36ac-41cb-aab5-0d32050143dc_en<\/a><\/p>\n

EUROPEAN RESEARCH COUNCIL. Foresight: Use and Impact of Artificial Intelligence in the Scientific Process [online]. European Research Council. 2023 [viewed 7 May 2025]. Available from: https:\/\/erc.europa.eu\/sites\/default\/files\/2023-12\/AI_in_science.pdf<\/a><\/p>\n

ExplanAItions: An AI Study by Wiley [online]. Wiley. 2025 [viewed 7 May 2025]. Available from: https:\/\/www.wiley.com\/content\/dam\/wiley-dotcom\/en\/b2c\/content-fragments\/explanaitions-ai-report\/pdfs\/Wiley_ExplanAItions_AI_Study_February_2025.pdf<\/a><\/p>\n

GAO, S., et al<\/em>. Empowering Biomedical Discovery with AI Agents. Cell<\/em> [online]. 2024, vol. 187, no. 22, pp. 6125\u20136151, ISSN: 0092-8674 [viewed 7 May 2025]. https:\/\/doi.org\/10.1016\/j.cell.2024.09.022<\/a>. Available from: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0092867424010705<\/a><\/p>\n

GHANNAD, M., et al<\/em>. A systematic review finds that spin or interpretation bias is abundant in evaluations of ovarian cancer biomarkers. Journal of Clinical Epidemiology<\/em> [online]. 2019, vol.116, pp. 9\u201317, ISSN: 0895-4356 [viewed 7 May 2025]. https:\/\/doi.org\/10.1016\/j.jclinepi.2019.07.011<\/a>. Available from: https:\/\/www.jclinepi.com\/article\/S0895-4356(18)30952-1\/fulltext<\/a><\/p>\n

GUAN, M.Y., et al<\/em>. Deliberative Alignment: Reasoning Enables Safer Language Models [online]. OpenAI. 2024 [viewed 7 May 2025]. https:\/\/openai.com\/index\/deliberative-alignment\/<\/a><\/p>\n

IBM IBV. Disruption by design: Evolving experiences in the age of generative AI [online]. IBM Institute for Business Value. 2024 [viewed 7 May 2025]. Available from: https:\/\/www.ibm.com\/thought-leadership\/institute-business-value\/en-us\/report\/generative-ai-experience-design<\/a><\/p>\n

IFARGAN, T., et al<\/em>. Autonomous LLM-Driven Research \u2014 from Data to Human-Verifiable Research Papers. NEJM AI<\/em> [online]. 2025, vol. 2, no. 1 [viewed 7 May 2025]. https:\/\/doi.org\/10.1056\/AIoa2400555<\/a>. Available from: https:\/\/ai.nejm.org\/doi\/10.1056\/AIoa2400555<\/a><\/p>\n

KHAMASSI, M., NAHON, M. and CHATILA, R. Strong and Weak Alignment of Large Language Models with Human Values. Sci Rep<\/em> [online]. 2024, vol. 14, 19399 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/s41598-024-70031-3<\/a>. Available from: https:\/\/www.nature.com\/articles\/s41598-024-70031-3<\/a><\/p>\n

KISSINGER, H.A., SCHMIDT, E. and MUNDIE, C. Genesis: Artificial Intelligence, Hope, and the Human Spirit. New York: Little Brown and Company, 2024<\/p>\n

KRAKOWSKI, S. Human-AI Agency in the Age of Generative AI. Information and Organization<\/em> [online]. 2025, vol. 35, no. 1, 100560, ISSN: 1471-7727 [viewed 7 May 2025]. https:\/\/doi.org\/10.1016\/j.infoandorg.2025.100560<\/a>. Available from: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1471772725000065?via%3Dihub<\/a><\/p>\n

McAFEE, A. Generally Faster: The Economic Impact of Generative AI [online]. The MIT Initiative on the Digital Economy (IDE). 2024 [viewed 7 May 2025]. Available from: https:\/\/ide.mit.edu\/wp-content\/uploads\/2024\/04\/Davos-Report-Draft-XFN-Copy-01112024-Print-Version.pdf?x76181<\/a><\/p>\n

NADDAF, M. How are Researchers Using AI? Survey Reveals Pros and Cons for Science [online]. Nature. 2025 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/d41586-025-00343-5<\/a>. Available from: https:\/\/www.nature.com\/articles\/d41586-025-00343-5<\/a><\/p>\n

NOORDEN, R.V. E WEBB, R. ChatGPT and Science: the AI System was a Force in 2023\u2014for Good and Bad [online]. Nature<\/em> [online]. 2023, vol. 624 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/d41586-023-03930-6<\/a>. Available from: https:\/\/www.nature.com\/articles\/d41586-023-03930-6<\/a><\/p>\n

OUYANG, L., et al<\/em>. Training Language Models to Follow Instructions with Human Feedback. In: Advances in Neural Information Processing Systems 35 (NeurIPS 2022), New Orleans, 2022 [viewed 7 May 2025]. Available from: https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/hash\/b1efde53be364a73914f58805a001731-Abstract-Conference.html<\/a><\/p>\n

PEW RESEARCH CENTER. The Future of Human Agency [online]. Pew Research Center. 2023 [viewed 7 May 2025]. Available from: https:\/\/www.pewresearch.org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_2023.02.24_The-Future-of-Human-Agency_FINAL.pdf<\/a><\/p>\n

Reproducibility and Transparency: What’s Going on and How Can We Help. Nature Communications<\/em> [online] 2025, vol. 16 [viewed 7 May 2025]. Available from: https:\/\/www.nature.com\/articles\/s41467-024-54614-2 <\/a><\/p>\n

RUSSEL, S. Human Compatible: Artificial Intelligence and the Problem of Control. Oxford: Oxford University Press, 2019 [viewed 7 May 2025]. Available from: https:\/\/people.eecs.berkeley.edu\/~russell\/papers\/mi19book-hcai.pdf<\/a><\/p>\n

SANTOS, L.H.L. Sobre a integridade \u00e9tica da pesquisa. Cienc. Cult.<\/em> [online]. 2017, vol.69, no.3, pp. 4\u20135, ISSN: 2317-6660 [viewed 7 May 2025]. http:\/\/doi.org\/10.21800\/2317-66602017000300002<\/a>. Available from: http:\/\/cienciaecultura.bvs.br\/scielo.php?script=sci_arttext&pid=S0009-67252017000300002<\/a><\/p>\n

SLEEK, S. On the Right Side of Being Wrong: the Emerging Culture of Research Transparency [online]. Association for Psychological Science. 2021 [viewed 7 May 2025]. Available from: https:\/\/www.psychologicalscience.org\/observer\/right-side-of-wrong<\/a><\/p>\n

Tools Such as Chatgpt Threaten Transparent Science; Here are Our Ground Rules for Their Use. Nature<\/em> [online]. 2023, vol. 614 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/d41586-023-00191-1<\/a>. Available from: https:\/\/www.nature.com\/articles\/d41586-023-00191-1<\/a><\/p>\n

VASCONCELOS, S. and MARU\u0160I\u0106, A. Gen AI and Research Integrity: Where to now?: The Integration of Generative AI in the Research Process Challenges Well-Established Definitions of Research Integrity. EMBO Reports<\/em> [online]. 2025, vol. 26, pp. 1923\u20131928 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/s44319-025-00424-6<\/a>. Available from: https:\/\/www.embopress.org\/doi\/full\/10.1038\/s44319-025-00424-6<\/a><\/p>\n

WOODGETT, J. We Must Be Open About Our Mistakes. Nature<\/em> [online.] 2023, vol. 489, pp. 7 [viewed 7 May 2025]. https:\/\/doi.org\/10.1038\/489007a<\/a>. Available from: https:\/\/www.nature.com\/articles\/489007a<\/a><\/p>\n

External links<\/h3>\n

ChatGPT<\/a><\/p>\n

Copilot <\/a><\/p>\n

DeepSeek-R1 <\/a><\/p>\n

Gemini <\/a><\/p>\n

GitHub Copilot<\/a><\/p>\n

Llama 3 <\/a><\/p>\n

Pi <\/a><\/p>\n

 <\/p>\n

About Sonia Vasconcelos<\/h3>\n

Sonia Vasconcelos is an Associate Professor in the Science Education Program (Educa\u00e7\u00e3o, Gest\u00e3o e Difus\u00e3o em Bioci\u00eancias<\/em>) at the Institute of Medical Biochemistry Leopoldo de Meis (IBqM), Federal University of Rio de Janeiro (UFRJ). She leads the Laboratory for Research Ethics, Science Communication, and Society (LECCS) at IBqM and chairs UFRJ\u2019s Advisory Council for Research Ethics (CTEP). Prof. Vasconcelos serves as an academic editor for\u00a0PLOS ONE<\/em>\u00a0and is a member of the Editorial Board of\u00a0Research Integrity and Peer Review<\/em>. Her research and publications focus on science communication, the ethics and regulation of scientific research, research integrity and science policy.<\/p>\n

 <\/p>\n

About Ana Maru\u0161i\u0107<\/h3>\n

Ana Maru\u0161i\u0107 is Professor of Anatomy, Chair of the Department of Research in Biomedicine and Health and Head of the Centre for Evidence-based Medicine at the University of Split School of Medicine, Split, Croatia. She is the Co-Editor in Chief of the ST-OPEN journal and editor emerita of the Journal of Global Health. Prof. Maru\u0161i\u0107 is on the Advisory Board of the EQUATOR Network and also serves on the Council of the Committee for Publication Ethics (COPE). She has more than 400 peer-reviewed articles and was heavily involved with creating the policy of mandatory registration of clinical trials in public registries which helped change the legal regulation of clinical trials worldwide.<\/p>\n","protected":false},"excerpt":{"rendered":"

Scholarly communication is amid a reconfiguration that, from a conservative perspective, should be as paradigm-shifting as the creation of the first scientific journal Philosophical Transactions<\/em>, in 1665. From a more disruptive perspective, this transformation will reshape the entire scientific culture, redefining the autonomy of researchers and institutions in producing and validating knowledge. Sustaining research integrity and rigor in projects and publications calls for strategies extending beyond transparency policies for researchers using Generative Artificial Intelligence. …<\/span> Read More →<\/span><\/a><\/span><\/p>\n","protected":false},"author":127,"featured_media":5614,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[3],"tags":[84,37,7],"class_list":["post-5612","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analysis","tag-artificial-intelligence","tag-ethics-in-scholarly-communication","tag-scholarly-communication"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/5612","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/127"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=5612"}],"version-history":[{"count":6,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/5612\/revisions"}],"predecessor-version":[{"id":5616,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/5612\/revisions\/5616"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/5614"}],"wp:attachment":[{"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=5612"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=5612"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=5612"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}