Evaluating the Efficacy of AI Tools in Systematic Literature Reviews: A Comprehensive Analysis

Journal: Journal of Information Systems and Informatics

Publication: 2025-03-29 · Vol. 7 No. 1 · pp. 870–888

DOI: 10.51519/journalisi.v7i1.1035

Abstract

Artificial Intelligence (AI) tools can revolutionize literature review practices by transforming the research landscape towards more efficient and reliable review processes. While conducting literature can be challenging and time-consuming, there is a plethora of AI powered tools which uncover potential solutions to the challenge. AI tools may reduce the time spent on repetitive tasks, allowing scholars to focus more on critical analysis and interpretation. Due to the rising abundance of AI tools, it is difficult to decide which AI tools are best for individual research problems or projects. While concerns exist around the ethical and quality consequences of using AI. The study aims to explore the usage of AI tools on the systematics literature review process, specifically focusing on their effectiveness in various stages and ethical concerns. IEEE and MDPI Journal papers from 2020 to 2024 were reviewed using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RobotReviewer, Covidence and EPPI-Reviewer are AI tools commonly used. These AI tools are designed to support different aspects of the systematic literature review process by offering capabilities such as problem formulation, literature search, inclusion screening and quality assessment. AI tools demonstrate improved effectiveness of literature searches, screening processes and  data extraction. Language and content presentation, incorrect citation and plagiarism, grammar and spelling errors may be ren when utilizing AI. Concerns related to data quality, biases, and the need for human oversight were identified.