• Latest
  • Trending
  • All

The deepfake crisis engulfing hundreds of schools

September 3, 2024

We are behind you and that will not change, PM tells Zelensky

October 14, 2026

Raye hits back at ticket touts who took over Albert Hall sign-up

October 14, 2026

Swimmer Archie Goodburn thanks prime minister as brain cancer review announced

October 14, 2026

Ji-sung Eom racist abuse: Millwall boss Alex Neil criticised for stoppage comments

October 14, 2026

Waterford: Vigil held after murder of four family members

October 14, 2026

Sydney teen charged with murder of boy who was shot in face

October 14, 2026

Republic of Ireland: Public sector strike begins

October 14, 2026

Mauritius reels from worst riots in decades after woman shot by police

October 14, 2026

Australia’s first Michelin stars awarded to 11 restaurants

October 14, 2026

Germany puts Ukrainian on trial accused of blowing up Nord Stream pipelines

October 14, 2026

Argentina targets UK in legal claim over Falklands oil exploration

October 14, 2026

Houthi missile hits Aramco building after Saudi-led coalition hits Yemen fuel depot

October 14, 2026
News
  • Login
  • Home
  • News
  • Sports
  • Worklife
  • Travel
  • Reel
  • Future
  • More
Wednesday, October 14, 2026
No Result
View All Result

NEWS

3 °c
London
8 ° Wed
9 ° Thu
11 ° Fri
13 ° Sat
  • Home
  • Video
  • World
    • All
    • Africa
    • Asia
    • Australia
    • Europe
    • Latin America
    • Middle East
    • US & Canada

    Sydney teen charged with murder of boy who was shot in face

    Republic of Ireland: Public sector strike begins

    Mauritius reels from worst riots in decades after woman shot by police

    Australia’s first Michelin stars awarded to 11 restaurants

    Germany puts Ukrainian on trial accused of blowing up Nord Stream pipelines

    Argentina targets UK in legal claim over Falklands oil exploration

    Houthi missile hits Aramco building after Saudi-led coalition hits Yemen fuel depot

    Pope diagnosed with lung cancer but had successful surgery, Vatican says

    Qantas flight grounded after bedbug outbreak

  • UK
    • All
    • England
    • N. Ireland
    • Politics
    • Scotland
    • Wales

    We are behind you and that will not change, PM tells Zelensky

    Swimmer Archie Goodburn thanks prime minister as brain cancer review announced

    Ji-sung Eom racist abuse: Millwall boss Alex Neil criticised for stoppage comments

    Waterford: Vigil held after murder of four family members

    Zelensky and Burnham to meet in Downing Street

    Family pays tribute to ‘warm and engaging’ man killed in tiger attack

    Man killed in tiger attack identified as William Chapman

    Gymnast Reuben Ward eyes more history after GB selection

    Welsh government does not want new national park in north Wales

  • Business
    • All
    • Companies
    • Connected World
    • Economy
    • Entrepreneurship
    • Global Trade
    • Technology of Business

    Shropshire heating oil users face tough choices as prices rise

    Poundland in rescue talks as owners seek buyer

    Three things we’ve learnt about the UK economy from the IMF

    Cost-of-living struggles inspire new supermarket in Newcastle-under-Lyme

    Lego fraudster among last year’s most high-profile insurance scammers

    Healey faces £35bn Budget challenge to meet spending pledges, says think tank

    Rural West communities struggle as price of heating oil rises

    AI is less regulated than milk, Microsoft president says

    ‘Stop throwing shade’ – the woman trying to stop firms leaving the UK

  • Tech
  • Entertainment & Arts

    Meghan hits red carpet at Power of Women in Hollywood

    Margot Robbie unable to speak at Saltburn premiere

    Barbra Streisand: Siri can now pronounce my name

    Wes Anderson’s The Grand Budapest Hotel inspires cinema’s look

    Taylor Swift/ Travis Kelce romance reaches White House

    The Killers booed at Georgia concert after inviting Russian fan on stage

    Watch: Memorable moments from Parkinson's star-studded show

    Tom Jones: Neighbour surprised to find singer in flat below

    Black Country Folk Festival showcases local musicians

    Watch: Australians set new world record with Tina Turner dance

  • Science
  • Health
  • In Pictures
  • Reality Check
  • Have your say
  • More
    • Newsbeat
    • Long Reads

NEWS

No Result
View All Result
Home Tech

The deepfake crisis engulfing hundreds of schools

September 3, 2024
in Tech
12 min read
236 18
0
494
SHARES
1.4k
VIEWS
Share on FacebookShare on Twitter


BBC A hand in front of the Korean flag uses the app Telegram on a phoneBBC

Last Saturday, a Telegram message popped up on Heejin’s phone from an anonymous sender. “Your pictures and personal information have been leaked. Let’s discuss.”

As the university student entered the chatroom to read the message, she received a photo of herself taken a few years ago while she was still at school. It was followed by a second image using the same photo, only this one was sexually explicit, and fake.

Terrified, Heejin, which is not her real name, did not respond, but the images kept coming. In all of them, her face had been attached to a body engaged in a sex act, using sophisticated deepfake technology.

Deepfakes, the majority of which combine a real person’s face with a fake, sexually explicit body, are increasingly being generated using artificial intelligence.

“I was petrified, I felt so alone,” Heejin told the BBC.

But she was not alone.

Two days earlier, South Korean journalist Ko Narin had published what would turn into the biggest scoop of her career. It had recently emerged that police were investigating deepfake porn rings at two of the county’s major universities, and Ms Ko was convinced there must be more.

She started searching social media and uncovered dozens of chat groups on the messaging app Telegram where users were sharing photos of women they knew and using AI software to convert them into fake pornographic images within seconds.

“Every minute people were uploading photos of girls they knew and asking them to be turned into deepfakes,” Ms Ko told us.

Ms Ko discovered these groups were not just targeting university students. There were rooms dedicated to specific high schools and even middle schools. If a lot of content was created using images of a particular student, she might even be given her own room. Broadly labelled “humiliation rooms” or “friend of friend rooms”, they often come with strict entry terms.

Ms Ko’s report in the Hankyoreh newspaper has shocked South Korea. On Monday, police announced they were considering opening an investigation into Telegram, following the lead of authorities in France, who recently charged Telegram’s Russian founder for crimes relating to the app. The government has vowed to bring in stricter punishments for those involved, and the president has called for young men to be better educated.

The BBC has reached out to Telegram for comment and while it is yet to reply on this particular case, it has previously told the BBC that it proactively searches for illegal activity, including child sexual abuse, on its site. It said undisclosed action was taken against 45,000 groups worldwide, in August alone.

‘A systematic and organised process’

The BBC has viewed the descriptions of a number of these chatrooms. One calls for members to post more than four photos of someone along with their name, age and the area they live in.

“I was shocked at how systematic and organised the process was,” said Ms Ko. “The most horrific thing I discovered was a group for underage pupils at one school that had more than 2,000 members.”

In the days after Ms Ko’s article was published, women’s rights activists started to scour Telegram too, and follow leads.

By the end of that week, more than 500 schools and universities had been identified as targets. The actual number impacted, and the number of victims, is still to be established, but many are believed to be under 16, which is South Korea’s age of consent. A large proportion of the suspected perpetrators are teenagers themselves.

Heejin said learning about the scale of the crisis had made her anxiety worse, as she now worried how many people might have viewed her deepfakes. Initially she blamed herself. “I couldn’t stop thinking did this happen because I uploaded my photos to social media, should I have been more careful?”

Scores of women and teenagers across the country have since removed their photos from social media or deactivated their accounts altogether, frightened they could be exploited next.

“We are frustrated and angry that we are having to censor our behaviour and our use of social media when we have done nothing wrong,” said one university student, Ah-eun, whose peers have been targeted.

Ah-eun said one victim at her university was told by police not to bother pursuing her case as it would be too difficult to catch the perpetrator, and it was “not really a crime” as “the photos were fake”.

News 1 Protests in South Korea against the deepfake porn scandalNews 1

South Koreans have been shocked and angry since the deepfake scandal has come to light

At the heart of this scandal is the messaging app Telegram. Unlike public websites, which the authorities can access easily, and then request for images be removed, Telegram is a private, encrypted messaging app.

Users are often anonymous, rooms can be set to “secret” mode, and their contents quickly deleted without a trace. This has made it a prime space for criminal behaviour to flourish.

Last week, politicians and the police responded forcefully, promising to investigate these crimes and bring the perpetrators to justice.

On Monday, Seoul National Police Agency announced it would look to investigate Telegram over its role in enabling fake pornographic images of children to be distributed.

The app’s founder, Pavel Durov, was charged in France last week with being complicit in a number of crimes related to the app, including enabling the sharing of child pornography.

But women’s rights activists accuse the authorities in South Korea of allowing sexual abuse on Telegram to simmer unchecked for too long, because Korea has faced this crisis before. In 2019, it emerged that a sex ring was using Telegram to coerce women and children into creating and sharing sexually explicit images of themselves.

Police at the time asked Telegram for help with their investigation, but the app ignored all seven of their requests. Although the ringleader was eventually sentenced to more than 40 years in jail, no action was taken against the platform, because of fears around censorship.

“They sentenced the main actors but otherwise neglected the situation, and I think this has exacerbated the situation,” said Ms Ko.

Blurred screenshot of one of the groups

Chat groups like these are offering to create deepfake images. The bottom one notes that “if you request someone to be humiliated (deepfaked), we will do so”

Park Jihyun, who, as a young student journalist, uncovered the Nth room sex-ring back in 2019, has since become a political advocate for victims of digital sex crimes. She said that since the deepfake scandal broke, pupils and parents had been calling her several times a day crying.

“They have seen their school on the list shared on social media and are terrified.”

Ms Park has been leading calls for the government to regulate or even ban the app in South Korea. “If these tech companies will not cooperate with law enforcement agencies, then the state must regulate them to protect its citizens,” she said.

Before this latest crisis exploded, South Korea’s Advocacy Centre for Online Sexual Abuse victims (ACOSAV) was already noticing a sharp uptick in the number of underage victims of deepfake pornography.

In 2023 they counselled 86 victims. That jumped to 238 in just the first eight months of this year, not counting the last seven days.

One of the centre’s leaders, Park Seonghye, said over the past week her staff had been inundated with calls and were working around the clock. “It’s been a full scale emergency for us, like a wartime situation,” she said.

“With the latest deepfake technology there is now so much more footage than there used to be, and we’re worried it’s only going to increase.”

As well as counselling victims, the centre tracks down harmful content and works with online platforms to have it taken down. Ms Park said there had been some instances where Telegram had removed content at their request. “So it’s not impossible,” she noted.

While women’s rights organisations accept that new AI technology is making it easier to exploit victims, they argue this is just the latest form of misogyny to play out online in South Korea.

First women were subjected to waves of verbal abuse online. Then came the spy cam epidemic, where they were secretly filmed using public toilets and changing rooms.

“The root cause of this is structural sexism and the solution is gender equality,” read a statement signed by 84 women’s groups.

This is a direct criticism of the country’s President Yoon Suk Yeol, who has denied the existence of structural sexism, cut funding to victim support groups and is abolishing the government’s gender equality ministry.

Getty Images The Telegram messaging app is seen on an iPhone in this illustration taken on 25 August, 2024 in Warsaw, PolandGetty Images

Lee Myung-hwa, who treats young sex offenders, agreed that although the outbreak of deepfake abuse might seem sudden, it had long been lurking under the surface. “For teenagers, deepfakes have become part of their culture, they’re seen as a game or a prank,” said the counsellor, who runs the Aha Seoul Youth Cultural Centre.

Ms Lee said it was paramount to educate young men, citing research that shows when you tell offenders exactly what they have done wrong, they become more aware of what counts as sexual abuse, which stops them from reoffending.

Meanwhile, the government has said it will increase the criminal sentences of those who create and share deepfake images, and will also punish those who view the pornography.

It follows criticism that not enough perpetrators were being punished. One of the issues is that the majority of offenders are teenagers, who are typically tried in youth courts, where they receive more lenient sentences.

Since the chatrooms were exposed, many have been closed down, but new ones will almost certainly take their place. A humiliation room has already been created to target the journalists covering this story. Ms Ko, who broke the news, said this had given her sleepless nights. “I keep checking the room to see if my photo has been uploaded,” she said.

Such anxiety has spread to almost every teenage girl and young woman in South Korea. Ah-eun, the university student, said it had made her suspicious of her male acquaintances.

“I now can’t be certain people won’t commit these crimes behind my back, without me knowing,” she said. “I’ve become hyper-vigilant in all my interactions with people, which can’t be good.”

Additional reporting by Hosu Lee and Sunwook Lee



Source link

Tags: crisisdeepfakeengulfingHundredsschools

Related Posts

How long will humans be needed for translation?

October 14, 2026
0

AI dominates the translation business, but for high-stakes work, humans are still needed. Source link

Bumble shares soar after report dating firm in $1bn takeover talks

October 13, 2026
0

Shares in dating app company Bumble soared by almost 50% on Monday after a report that it is in...

Rogue Anthropic AI agent gave police fake tip in unsolved murder case

October 12, 2026
0

An artificial intelligence (AI) agent developed by Anthropic went rogue and sent US police a fake tip about an...

  • Lee McGregor: Scot seeks world title in 2025 & Nathaniel Collins bout

    680 shares
    Share 272 Tweet 170
  • Belgian footballer arrested in cocaine investigation

    535 shares
    Share 214 Tweet 134
  • Next to raise prices to help pay for rising wage costs

    534 shares
    Share 214 Tweet 134
  • South Wales Police officers injured, one arrested

    526 shares
    Share 210 Tweet 132
  • ‘It stirred the people to breathless wonder and scalding abuse’: The tumultuous history of the Sydney Opera House

    521 shares
    Share 208 Tweet 130
  • Trending
  • Comments
  • Latest

Lee McGregor: Scot seeks world title in 2025 & Nathaniel Collins bout

January 16, 2025

Belgian footballer arrested in cocaine investigation

January 27, 2025

Next to raise prices to help pay for rising wage costs

January 7, 2025

World Cup 2022: TikTok brings football fever to millions of fans

0

UK economy will get worse before it gets better, warns chancellor

0

One of Central America’s most active volcanoes erupts again

0

We are behind you and that will not change, PM tells Zelensky

October 14, 2026

Raye hits back at ticket touts who took over Albert Hall sign-up

October 14, 2026

Swimmer Archie Goodburn thanks prime minister as brain cancer review announced

October 14, 2026

Categories

UK

We are behind you and that will not change, PM tells Zelensky

October 14, 2026
0

Ukrainian officials have said that overnight strikes by Russian missiles and drones had left at least 600,000 people without...

Read more

Raye hits back at ticket touts who took over Albert Hall sign-up

October 14, 2026
News

© 2023 GODJ - NEWS CORP - news.godj.com.

Explore NEWS.GODJ.COM

  • Home
  • News
  • Sports
  • Worklife
  • Travel
  • Reel
  • Future
  • More

Follow Us

  • Home Main
  • Video
  • World
  • Top News
  • Business
  • Sport
  • Tech
  • UK
  • In Pictures
  • Health
  • Reality Check
  • Science
  • Entertainment & Arts
  • Login

© 2023 GODJ - NEWS CORP - news.godj.com.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Fill the forms bellow to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy and Cookie Policy.