The reason behind Telegram’s temporary removal from the App Store has become clear. Pavel Durov revealed that the platform was the target of blackmailers using artificial intelligence.
Telegram, one of the world’s most well-known instant messaging applications, was temporarily removed from Apple’s digital store, the App Store, yesterday. Apple stated that the application was removed from the store for violating its rules by containing content related to child abuse. After the platform’s developers quickly removed the inappropriate content and banned the user who shared it, the application returned to the market shortly afterward. However, Telegram CEO Pavel Durov explained that a malicious blackmail attempt lay behind this situation.
Attackers Use AI as a Weapon
Telegram CEO Pavel Durov shared the technical details of the incident with the public. According to Durov, the attackers used a rather complex and deceptive method to bypass the platform’s moderation tools. In particular, in public group chats, malicious individuals editing past posts inserted AI-generated illegal images into these old posts.
This AI-generated illegal content was implicitly included in the system to prevent group members from noticing it.
The main purpose of this system was to make it difficult for members to quickly report the content and to mislead Telegram’s automated moderation systems. Durov stated that these individuals demanded ransom from group owners and threatened communities. For example, it is said that attacks target many public groups through automated bots and fake accounts.
Security Measures Under Review
This crisis on Telegram has once again highlighted how sensitive the moderation processes of digital platforms are. Apple’s security policies have zero tolerance for this type of content, and although attempts are made to introduce it through off-system techniques, it increases the pressure on platforms. Durov emphasized that Telegram has mobilized all its tools against these types of abusers, and reminds users that reporting suspicious situations is vital.
The attempt by malicious individuals to use digital platforms as ransomware is creating a new threat model in the cybersecurity world.
The platform plans to update its moderation algorithms to prevent similar attacks in the future. In particular, a stricter filtering system is expected to be implemented for the detection of AI-powered content. Telegram management, which prioritizes user security, underlined that they will not compromise against blackmailers.
In your opinion, how can digital platforms take more effective measures against this type of blackmail content, which is generated with AI and aims to mislead moderation? Don’t forget to share your opinions with us in the comments section.