Research Article | Open Access | Download PDF
Volume 74 | Issue 4 | Year 2026 | Article Id. IJCTT-V74I4P107 | DOI : https://doi.org/10.14445/22312803/IJCTT-V74I4P107Evaluating Attempted Data Manipulation on Generative Artificial Intelligence Reliability
Laura Poe, Dawn Schwartz
| Received | Revised | Accepted | Published |
|---|---|---|---|
| 02 Mar 2026 | 30 Mar 2026 | 21 Apr 2026 | 30 Apr 2026 |
Citation :
Laura Poe, Dawn Schwartz, "Evaluating Attempted Data Manipulation on Generative Artificial Intelligence Reliability," International Journal of Computer Trends and Technology (IJCTT), vol. 74, no. 4, pp. 82-91, 2026. Crossref, https://doi.org/10.14445/22312803/IJCTT-V74I4P107
Abstract
Artificial Intelligence (AI) has created a pathway to retrieve and calculate data for generating business plans, performing analyses, and conducting research. The value of AI when used in research is intended to reduce the time frame for collecting data and resources. The detriment of new generative AI tools is the question of reliability. This research evaluated two commonly used tools, ChatGPT and Claude, to determine the ability of the tools to recognize (1) false or contradictory data input into the tools directly from the user prompt and (2) false or contradictory data published on the Internet. The results of the study confirm that ChatGPT and Claude have safeguards to prevent data poisoning through direct chat interactions. However, when the bad dataset was published online to a publicly available website, the generative AI tools had difficulty determining validity, introducing concerns for data reliability. This study demonstrates risks regarding the veracity of AI-generated output and its implications for both research and industry.
Keywords
Data Poisoning, Generative Artificial Intelligence, Content Verification, Data Authenticity, Ai Reliability.
References
[1] Zarif Bin Akhtar,
“Unveiling the Evolution of Generative AI (GAI): A Comprehensive and
Investigative Analysis toward LLM Models (2021–2024) and Beyond,” Journal of Electrical Systems and
Information Technology, vol. 11, pp. 1-21, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Mohammad Aljanabi et al., “Data
Poisoning: Issues, Challenges, and Needs,” The
Institution of Engineering & Technology Conference Proceedings, pp.
359-363, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Introducing Claude, Anthropic, 2023. [Online]. Available: https://www.anthropic.com/news/introducing-claude
[4] Anthropic, Does Claude have
Access to the Internet?, 2024. [Online].
Available: https://support.anthropic.com/en/articles/7996846-does-claude-have-access-to-the-internet
[5] M. Broadway, ChatGPT is a
Neural Network, here’s how it Works, 2024. [Online]. Available: https://www.pcguide.com/ai/is-chatgpt-a-neural-network/
[6] Stephanie Chan, Is Claude
AI safe? Security Measures you Need to Know, 2024. [Online]. Available:
https://tactiq.io/learn/is-claude-ai-safe#:~:text=Does%20Claude%20AI%20keep%20your,which%20it%20is%20automatically%20deleted
[7] Yogesh K. Dwivedi et al.,
“So what if ChatGPT wrote it?” Multidisciplinary Perspectives on Opportunities,
Challenges and Implications of Generative Conversational AI for Research,
Practice and Policy,” International
Journal of Information Management, vol. 71, pp. 1-63, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Gunther Eysenbach, “The
Role of Chatgpt, Generative Language Models, and Artificial Intelligence in
Medical Education: A Conversation with Chatgpt and a Call for Papers,” JMIR Medical Education, vol. 9, pp.
1-13, 2023.
[CrossRef] [Google Scholar] [Publisher
Link]
[9] Stefan Feuerriegel et al.,
“Generative AI,” Business &
Information Systems Engineering, vol. 66, no. 1, pp. 111-126, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Ahmed Abdeen Hamed,
Malgorzata Zachara-Szymanska, and Xindong Wu, “Safeguarding Authenticity for
Mitigating the Harms of Generative AI: Issues, Research Agenda, and Policies
for Detection, FactChecking, and Ethical AI,” iScience, vol. 27, no. 2,
pp. 1-6, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Ronan Hamon et al., “Three
Challenges to Secure AI Systems in the Context of AI Regulations,” IEEE Access, vol. 12, pp. 61022-61305,
2024.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Dylan J. Hayden, “Generative
AI Mining Housing Data with a Higher Powered Shovel,” Cityscape, vol. 25, no. 3, pp. 199-206, 2023.
[Google Scholar] [Publisher
Link]
[13] Declan Humphreys et al., “AI
Hype as a Cyber Security Risk: The Moral Responsibility of Implementing
Generative AI in Business,” AI and Ethics,
vol. 4, pp. 791-804, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Aysha Thahsin Zahir Ismail,
and Raj Mani Shukla, “Analyzing the Vulnerabilities in Splitfed Learning:
Assessing the Robustness against Data Poisoning Attacks,” arXiv, pp, 1-10, 2023.
[CrossRef] [Google Scholar] [Publisher
Link]
[15] Kezia Jungco, Claude AI
Review: Features, Pros, and Cons, 2025. [Online].
Available:
https://www.eweek.com/artificialintelligence/claude-ai-review/
[16] Belle Lin, “How did
Companies use Generative AI in 2023? Here’s a Look at Five Early Adopters,” Wall Street Journal, 2023. [Online]. Available: https://www.wsj.com/articles/how-did-companies-use-generative-ai-in-2023-heres-a-look-at-five-early-adopters-6e09c6b3?eafs_enabled=false
[17] Malware Bytes, 2025. [Online].
Available: https://www.malwarebytes.com/cybersecurity/bas
ics/chatgpt-ai-security
[18] B. Marr, 19 Amazing Generative AI Tools for
Everyday Tasks and Activities, Forbes.
[Online]. Available: https://www.forbes.com/sites/bernardmarr/2024/0
8/12/19-amazing-generative-ai-tools-foreveryday-tasks-and-activities/
[19] Sydney Mathiason, Retraining Strategies for Continuous
Improvement, Medium, 2025. [Online].
Available: https://medium.com/@sydneymathiason/retraining-strategies-for-continuous-improvement-82348f44174e
[20] Aprill Miller, 16 Companies
using Generative AI for Business Efficiency, InData Labs, 2025. [Online].
Available: https://indatalabs.com/blog/companiesusing-generative-ai
[21] Fiona
Fui-Hoon Nah et al., “Generative AI and ChatGPT: Applications, Challenges, and AI-Human
Collaboration,” Journal of Information
Technology Case and Application Research, vol. 25, no. 3, pp. 277-304, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[22] OpenAI, How Your Data is
Used to Improve Model Performance. [Online]. Available: https://help.openai.com/en/articles/5722486-howyour-data-is-used-to-improve-model-performance
[23] Nino Paoli, Deloitte Allegedly Cited AI-Generated
Research in a Million-Dollar Report for a Canadian Provincial Government,
Fortune, 2025.
[Online].
Available: https://fortune.com/2025/11/25/deloitte-caught-fabricated-ai-generated-research-million-dollar-report-canada-government/
[24] Precedence Research, Artificial Intelligence (AI) Market Size to Achieve
USD 3,680.47 Bn by 2034, Yahoo! Finance, 2024. [Online]. Available: https://finance.yahoo.com/news/artificialintelligence-ai-market-size-150000159.html
[25] Henrik Skaug Sætra, “Generative
AI: Here to Stay, but for Good?,” Technology
in Society, vol. 75, pp. 1-5,
2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Scott Amyx, ChatGPT and
Natural Language Understanding: Building Intelligent Chatbots, 2023. [Online]. Available: https://scottamyx.com/2023/05/23/chatgpt-andnatural-language-understanding-buildingintelligent-chatbots/
[27] SentinelOne, What is Data
Poisoning? Types and Best Practices, 2025.
[Online]. Available: https://www.sentinelone.com/cybersecurity-101/cybersecurity/data-poisoning/
[28] Andrea Taloni et al., “GPT
Wars: Creating and Detecting Fake Data Sets with Generative Artificial Intelligence,”
Investigative Ophthalmology & Visual
Science, vol. 65, no. 360, pp. 1-34, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Laura Verde, Fiammetta
Marulli, and Stefano Marrone, “Exploring the Impact of Data Poisoning Attacks
on Machine Learning Model Reliability,” Procedia
Computer Science, vol. 192, pp.
1-9, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Wai Yee Wan et al., “Legal and
Regulatory Issues on Artificial Intelligence, Machine Learning, Data Science, and
Big Data,” HCI International 2022 –
Late Breaking Papers: Interacting with eXtended Reality and Artificial
Intelligence, pp. 558-567, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Jiaan Wang et al., “Is Chatgpt
a Good NLG Evaluator? A Preliminary Study,”
arXiv preprint arXiv:2303.04048, pp. 1-11, 2023.
[CrossRef] [Google Scholar] [Publisher
Link]
[32] Estefania Roldan-Vasquez et
al., “Reliability of Artificial Intelligence Chatbot Responses to Frequently
Asked Questions in Breast Surgical Oncology,” Journal of Surgical Oncology, vol. 130, no. 2, pp. 188-203, 2024.
[CrossRef] [Google Scholar] [Publisher Link]