Google’s AI Overviews feature misleads users by confusing SCP Foundation fictions with factual information. Artificial intelligence’s inability to distinguish between fiction and reality has created controversy.
The AI Overviews feature that Google integrated into its search engine faced a significant accuracy problem by mixing the content of the SCP Foundation, the well-known fictional universe on the internet, with real scientific data.
According to the report published by Futurism, artificial intelligence algorithms mislead users by presenting these imaginary “anomalies” as documented real events.
Hundreds of fictional reports, especially those containing biological and paranormal elements, are used as information sources by artificial intelligence without adding any warning labels.
This situation once again brings into question the reliability of the artificial intelligence equivalents at the top of the search results.
Artificial Intelligence Cannot Distinguish Fictional Content from Real
SCP Foundation is a completely imaginary science fiction project created jointly by internet users and containing “anomalies”.
However, Google’s artificial intelligence models miss context when scanning these contents, placing them exactly on a par with real-world documents.
For example, in searches for a fictional object codenamed SCP-426, the system conveys the story of the object told in its own words as if it were a reality.
The inability of systems to distinguish between fiction and reality poses a significant disinformation risk, especially for children and researchers.
Although many of the responses produced by the system contain terms such as “lore”, it is not clearly stated that these terms relate to a fictional cosmos.
Since users tend to accept this information at the top of the search engine without questioning it, this “artificial reality” provided by artificial intelligence seems quite convincing.
Google Trying to Fix Faulty Algorithms
In the investigations, it was observed that Google started adding the “fictional anomaly” tag to some queries. This shows that engineers noticed the problem and intervened in the algorithms. However, it is reported that the system now lacks a balanced security barrier and similar misconceptions continue to be repeated.
Although the rapid development of artificial intelligence technology aims to improve the quality of the information provided by search engines, such weaknesses in verifying the origin of the information create a major problem of faith.
Past precedents prove that Google’s artificial intelligence strategy still needs improvement.
Questioning the accuracy of the information provided by artificial intelligence is becoming the most fundamental part of information literacy in the digital age.
Do you think that a “fictional” warning should be added under such content produced by artificial intelligence? You can share your opinions about the accuracy rate in Google’s search results with us in the comments section.