• Latest
  • Trending
  • All

The deepfake crisis engulfing hundreds of schools

September 3, 2024

Wales wildfires: Military deployed and arson arrests made

August 15, 2026

X-Men: Christopher Abbott and Sadie Sink in new Marvel movie

August 15, 2026

Demonstrations held a year after first protests at Falkirk asylum seekers hotel

August 15, 2026

Thousands of Bonnie Tyler fans line the streets as coffin taken to Swansea home

August 15, 2026

Derry Féile: Carnival parade brings community festival to a close

August 15, 2026

Under strain, Australia’s world-leading disability support faces major restructure

August 15, 2026

Eleven killed in Israeli strikes on southern Lebanon, authorities say

August 15, 2026

Michaely Bihina: The Cameroon goalkeeper making waves at Wafcon 2026

August 15, 2026

Family stranded at sea for 16 hours after jet ski capsized in Thailand

August 15, 2026

Dozens injured and thousands evacuated in Croatia wildfire

August 15, 2026

Teens who fled Venezuela after deadly quakes caught in another disaster in Colombia

August 15, 2026

Activists deliver aid to Palestinians in homes besieged by Israeli settlers

August 15, 2026
News
  • Login
  • Home
  • News
  • Sports
  • Worklife
  • Travel
  • Reel
  • Future
  • More
Saturday, August 15, 2026
No Result
View All Result

NEWS

3 °c
London
8 ° Wed
9 ° Thu
11 ° Fri
13 ° Sat
  • Home
  • Video
  • World
    • All
    • Africa
    • Asia
    • Australia
    • Europe
    • Latin America
    • Middle East
    • US & Canada

    Under strain, Australia’s world-leading disability support faces major restructure

    Eleven killed in Israeli strikes on southern Lebanon, authorities say

    Michaely Bihina: The Cameroon goalkeeper making waves at Wafcon 2026

    Family stranded at sea for 16 hours after jet ski capsized in Thailand

    Dozens injured and thousands evacuated in Croatia wildfire

    Teens who fled Venezuela after deadly quakes caught in another disaster in Colombia

    Activists deliver aid to Palestinians in homes besieged by Israeli settlers

    Canadians are still boycotting US travel. Here’s where they’re going instead

    Australia v Bangladesh: Steve Smith benefits from reprieve but tourists dominate day one of first Test

  • UK
    • All
    • England
    • N. Ireland
    • Politics
    • Scotland
    • Wales

    Wales wildfires: Military deployed and arson arrests made

    Demonstrations held a year after first protests at Falkirk asylum seekers hotel

    Thousands of Bonnie Tyler fans line the streets as coffin taken to Swansea home

    Derry Féile: Carnival parade brings community festival to a close

    Temporary disposable barbecue ban over wildfire risk

    European Athletics Championships 2026: Keely Hodgkinson takes 800m silver behind Swiss rival Audrey Werro

    Killer who will not say where wife's body is to stay in prison

    Arrests and road closed over suspected abduction in East Lothian

    Tân mawr ger Llanymddyfri yn gorfodi nifer o bobl i adael eu tai

  • Business
    • All
    • Companies
    • Connected World
    • Economy
    • Entrepreneurship
    • Global Trade
    • Technology of Business

    Ice cream: How the big firms innovate to stay ahead

    Electric vehicle sales targets could be cut after pressure from car makers

    Business Daily – Taking Stock: The cost of heatwaves

    US says dozens of countries helped China dodge Trump’s tariffs

    RBSI announces around 50 job cuts in Jersey

    UK economy grows but experts warn of challenging months ahead

    Twitch users can now block Amazon from using their content to train AI

    Burnham warned Iran war could hit UK growth next year

    First wave of ‘pounds for pylons’ energy discount sites revealed

  • Tech
  • Entertainment & Arts

    Meghan hits red carpet at Power of Women in Hollywood

    Margot Robbie unable to speak at Saltburn premiere

    Barbra Streisand: Siri can now pronounce my name

    Wes Anderson’s The Grand Budapest Hotel inspires cinema’s look

    Taylor Swift/ Travis Kelce romance reaches White House

    The Killers booed at Georgia concert after inviting Russian fan on stage

    Watch: Memorable moments from Parkinson's star-studded show

    Tom Jones: Neighbour surprised to find singer in flat below

    Black Country Folk Festival showcases local musicians

    Watch: Australians set new world record with Tina Turner dance

  • Science
  • Health
  • In Pictures
  • Reality Check
  • Have your say
  • More
    • Newsbeat
    • Long Reads

NEWS

No Result
View All Result
Home Tech

The deepfake crisis engulfing hundreds of schools

September 3, 2024
in Tech
12 min read
236 17
0
492
SHARES
1.4k
VIEWS
Share on FacebookShare on Twitter


BBC A hand in front of the Korean flag uses the app Telegram on a phoneBBC

Last Saturday, a Telegram message popped up on Heejin’s phone from an anonymous sender. “Your pictures and personal information have been leaked. Let’s discuss.”

As the university student entered the chatroom to read the message, she received a photo of herself taken a few years ago while she was still at school. It was followed by a second image using the same photo, only this one was sexually explicit, and fake.

Terrified, Heejin, which is not her real name, did not respond, but the images kept coming. In all of them, her face had been attached to a body engaged in a sex act, using sophisticated deepfake technology.

Deepfakes, the majority of which combine a real person’s face with a fake, sexually explicit body, are increasingly being generated using artificial intelligence.

“I was petrified, I felt so alone,” Heejin told the BBC.

But she was not alone.

Two days earlier, South Korean journalist Ko Narin had published what would turn into the biggest scoop of her career. It had recently emerged that police were investigating deepfake porn rings at two of the county’s major universities, and Ms Ko was convinced there must be more.

She started searching social media and uncovered dozens of chat groups on the messaging app Telegram where users were sharing photos of women they knew and using AI software to convert them into fake pornographic images within seconds.

“Every minute people were uploading photos of girls they knew and asking them to be turned into deepfakes,” Ms Ko told us.

Ms Ko discovered these groups were not just targeting university students. There were rooms dedicated to specific high schools and even middle schools. If a lot of content was created using images of a particular student, she might even be given her own room. Broadly labelled “humiliation rooms” or “friend of friend rooms”, they often come with strict entry terms.

Ms Ko’s report in the Hankyoreh newspaper has shocked South Korea. On Monday, police announced they were considering opening an investigation into Telegram, following the lead of authorities in France, who recently charged Telegram’s Russian founder for crimes relating to the app. The government has vowed to bring in stricter punishments for those involved, and the president has called for young men to be better educated.

The BBC has reached out to Telegram for comment and while it is yet to reply on this particular case, it has previously told the BBC that it proactively searches for illegal activity, including child sexual abuse, on its site. It said undisclosed action was taken against 45,000 groups worldwide, in August alone.

‘A systematic and organised process’

The BBC has viewed the descriptions of a number of these chatrooms. One calls for members to post more than four photos of someone along with their name, age and the area they live in.

“I was shocked at how systematic and organised the process was,” said Ms Ko. “The most horrific thing I discovered was a group for underage pupils at one school that had more than 2,000 members.”

In the days after Ms Ko’s article was published, women’s rights activists started to scour Telegram too, and follow leads.

By the end of that week, more than 500 schools and universities had been identified as targets. The actual number impacted, and the number of victims, is still to be established, but many are believed to be under 16, which is South Korea’s age of consent. A large proportion of the suspected perpetrators are teenagers themselves.

Heejin said learning about the scale of the crisis had made her anxiety worse, as she now worried how many people might have viewed her deepfakes. Initially she blamed herself. “I couldn’t stop thinking did this happen because I uploaded my photos to social media, should I have been more careful?”

Scores of women and teenagers across the country have since removed their photos from social media or deactivated their accounts altogether, frightened they could be exploited next.

“We are frustrated and angry that we are having to censor our behaviour and our use of social media when we have done nothing wrong,” said one university student, Ah-eun, whose peers have been targeted.

Ah-eun said one victim at her university was told by police not to bother pursuing her case as it would be too difficult to catch the perpetrator, and it was “not really a crime” as “the photos were fake”.

News 1 Protests in South Korea against the deepfake porn scandalNews 1

South Koreans have been shocked and angry since the deepfake scandal has come to light

At the heart of this scandal is the messaging app Telegram. Unlike public websites, which the authorities can access easily, and then request for images be removed, Telegram is a private, encrypted messaging app.

Users are often anonymous, rooms can be set to “secret” mode, and their contents quickly deleted without a trace. This has made it a prime space for criminal behaviour to flourish.

Last week, politicians and the police responded forcefully, promising to investigate these crimes and bring the perpetrators to justice.

On Monday, Seoul National Police Agency announced it would look to investigate Telegram over its role in enabling fake pornographic images of children to be distributed.

The app’s founder, Pavel Durov, was charged in France last week with being complicit in a number of crimes related to the app, including enabling the sharing of child pornography.

But women’s rights activists accuse the authorities in South Korea of allowing sexual abuse on Telegram to simmer unchecked for too long, because Korea has faced this crisis before. In 2019, it emerged that a sex ring was using Telegram to coerce women and children into creating and sharing sexually explicit images of themselves.

Police at the time asked Telegram for help with their investigation, but the app ignored all seven of their requests. Although the ringleader was eventually sentenced to more than 40 years in jail, no action was taken against the platform, because of fears around censorship.

“They sentenced the main actors but otherwise neglected the situation, and I think this has exacerbated the situation,” said Ms Ko.

Blurred screenshot of one of the groups

Chat groups like these are offering to create deepfake images. The bottom one notes that “if you request someone to be humiliated (deepfaked), we will do so”

Park Jihyun, who, as a young student journalist, uncovered the Nth room sex-ring back in 2019, has since become a political advocate for victims of digital sex crimes. She said that since the deepfake scandal broke, pupils and parents had been calling her several times a day crying.

“They have seen their school on the list shared on social media and are terrified.”

Ms Park has been leading calls for the government to regulate or even ban the app in South Korea. “If these tech companies will not cooperate with law enforcement agencies, then the state must regulate them to protect its citizens,” she said.

Before this latest crisis exploded, South Korea’s Advocacy Centre for Online Sexual Abuse victims (ACOSAV) was already noticing a sharp uptick in the number of underage victims of deepfake pornography.

In 2023 they counselled 86 victims. That jumped to 238 in just the first eight months of this year, not counting the last seven days.

One of the centre’s leaders, Park Seonghye, said over the past week her staff had been inundated with calls and were working around the clock. “It’s been a full scale emergency for us, like a wartime situation,” she said.

“With the latest deepfake technology there is now so much more footage than there used to be, and we’re worried it’s only going to increase.”

As well as counselling victims, the centre tracks down harmful content and works with online platforms to have it taken down. Ms Park said there had been some instances where Telegram had removed content at their request. “So it’s not impossible,” she noted.

While women’s rights organisations accept that new AI technology is making it easier to exploit victims, they argue this is just the latest form of misogyny to play out online in South Korea.

First women were subjected to waves of verbal abuse online. Then came the spy cam epidemic, where they were secretly filmed using public toilets and changing rooms.

“The root cause of this is structural sexism and the solution is gender equality,” read a statement signed by 84 women’s groups.

This is a direct criticism of the country’s President Yoon Suk Yeol, who has denied the existence of structural sexism, cut funding to victim support groups and is abolishing the government’s gender equality ministry.

Getty Images The Telegram messaging app is seen on an iPhone in this illustration taken on 25 August, 2024 in Warsaw, PolandGetty Images

Lee Myung-hwa, who treats young sex offenders, agreed that although the outbreak of deepfake abuse might seem sudden, it had long been lurking under the surface. “For teenagers, deepfakes have become part of their culture, they’re seen as a game or a prank,” said the counsellor, who runs the Aha Seoul Youth Cultural Centre.

Ms Lee said it was paramount to educate young men, citing research that shows when you tell offenders exactly what they have done wrong, they become more aware of what counts as sexual abuse, which stops them from reoffending.

Meanwhile, the government has said it will increase the criminal sentences of those who create and share deepfake images, and will also punish those who view the pornography.

It follows criticism that not enough perpetrators were being punished. One of the issues is that the majority of offenders are teenagers, who are typically tried in youth courts, where they receive more lenient sentences.

Since the chatrooms were exposed, many have been closed down, but new ones will almost certainly take their place. A humiliation room has already been created to target the journalists covering this story. Ms Ko, who broke the news, said this had given her sleepless nights. “I keep checking the room to see if my photo has been uploaded,” she said.

Such anxiety has spread to almost every teenage girl and young woman in South Korea. Ah-eun, the university student, said it had made her suspicious of her male acquaintances.

“I now can’t be certain people won’t commit these crimes behind my back, without me knowing,” she said. “I’ve become hyper-vigilant in all my interactions with people, which can’t be good.”

Additional reporting by Hosu Lee and Sunwook Lee



Source link

Tags: crisisdeepfakeengulfingHundredsschools

Related Posts

Why tech bosses keep sharing their manifestos about AI

August 15, 2026
0

This past week, Meta CEO Mark Zuckerberg published a 6,500 word open letter, external entitled "The Future is for...

Bumble divides users by ditching its signature ‘women-first’ chat rule

August 14, 2026
0

Reddit's popular r/Bumble community - where half a million people share dating stories and discuss app features - has...

Why Japanese firms are being so slow to use AI

August 13, 2026
0

However, critics argue that at each of these businesses only a tiny proportion of staff are actually using the...

  • Lee McGregor: Scot seeks world title in 2025 & Nathaniel Collins bout

    677 shares
    Share 271 Tweet 169
  • Belgian footballer arrested in cocaine investigation

    533 shares
    Share 213 Tweet 133
  • Next to raise prices to help pay for rising wage costs

    532 shares
    Share 213 Tweet 133
  • South Wales Police officers injured, one arrested

    525 shares
    Share 210 Tweet 131
  • Charities to get £15m fund to save surplus farm food

    516 shares
    Share 206 Tweet 129
  • Trending
  • Comments
  • Latest

Lee McGregor: Scot seeks world title in 2025 & Nathaniel Collins bout

January 16, 2025

Belgian footballer arrested in cocaine investigation

January 27, 2025

Next to raise prices to help pay for rising wage costs

January 7, 2025

World Cup 2022: TikTok brings football fever to millions of fans

0

UK economy will get worse before it gets better, warns chancellor

0

One of Central America’s most active volcanoes erupts again

0

Wales wildfires: Military deployed and arson arrests made

August 15, 2026

X-Men: Christopher Abbott and Sadie Sink in new Marvel movie

August 15, 2026

Demonstrations held a year after first protests at Falkirk asylum seekers hotel

August 15, 2026

Categories

UK

Wales wildfires: Military deployed and arson arrests made

August 15, 2026
0

The military has been deployed to help tackle wildfires across Wales.Personnel and an Army helicopter are supporting firefighters in...

Read more

X-Men: Christopher Abbott and Sadie Sink in new Marvel movie

August 15, 2026
News

© 2023 GODJ - NEWS CORP - news.godj.com.

Explore NEWS.GODJ.COM

  • Home
  • News
  • Sports
  • Worklife
  • Travel
  • Reel
  • Future
  • More

Follow Us

  • Home Main
  • Video
  • World
  • Top News
  • Business
  • Sport
  • Tech
  • UK
  • In Pictures
  • Health
  • Reality Check
  • Science
  • Entertainment & Arts
  • Login

© 2023 GODJ - NEWS CORP - news.godj.com.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Fill the forms bellow to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy and Cookie Policy.