Documenting the Shift: How Researchers Report Generative AI in Search Methodologies for Evidence Synthesis
05/06/2025 , 2306/2309
Langue: English

Objective: This lightning talk will provide a brief description of a scoping review designed to identify the extent to which generative AI is being used in the search methods of evidence synthesis reviews. We will compare tools and strategies used by review authors, and extract details on the level of reporting.

Methods: The JBI scoping review methodology will guide the conduct of this review. After calibration exercises on screening and data extraction were completed, an a priori protocol was published on OSF Registries. To be eligible for inclusion, a review must be a known type of evidence synthesis, and authors must have either used a generative-AI powered tool to develop database search strategies or used an AI search engine to locate references directly. We will search from Jan 2022 to present: Ovid Medline, Ovid Embase, Ovid PsycINFO, EBSCO CINAHL, EBSCO ERIC, ProQuest Sociological Abstracts, Elsevier Scopus, and Clarivate Web of Science Core Collection. We will conduct a supplementary full-text search in EBSCO MEDLINE, EBSCO CINAHL and Lens.org. We will independently screen in two stages in Covidence; disagreements will be resolved by consensus and discussion. We will extract study characteristics; characteristics related to the method, type of chatbot or AI search engine used; description of search method; and search reporting elements. The results will be presented in tables, accompanied by descriptive summaries.

Results and Discussion: This project will provide insights into the adoption and reporting of generative AI tools in KS searches.

Kaitlin Fuller, MLIS, is a Scholarly Communications and Health Sciences Librarian at St. Francis Xavier University (StFX). Before joining StFX, she worked as a liaison librarian to the MD Program at the University of Toronto. Her research interests include exploring librarian teaching practices for knowledge synthesis (KS), examining the impact of affordable laptops on students, investigating the role of play in academic libraries, and assessing the use of AI tools in search strategies. She is passionate about empowering students, faculty, and researchers through education and fostering relationships that lead to meaningful collaborations.

Autre(s) intervention(s) de l'orateur :

Erica Nekolaichuk, MA, MLIS, is an instructional librarian with the Gerstein Science Information Centre at the University of Toronto. Prior to arriving at Gerstein, Erica worked in continuing medical education and as a solo hospital librarian at the Cross Cancer Institute in Edmonton, Alberta. Through her experience in hospital and academic health science libraries, she has been involved in a number of systematic and scoping reviews and has provided expert searching and systematic review training for clinicians, students, and researchers. Erica also teaches a course at the University of Toronto's Faculty of Information called "Evidence-Based Healthcare for Librarians."

Autre(s) intervention(s) de l'orateur :