Instagram is recommending highly inappropriate content to teens
In this article (5)
If you have a teenager with a phone, you might be perturbed to discover that Instagram has been recommending content of a sexual nature to users as young as 13. This inappropriate content appears on teen’s feeds only minutes after they log in to their accounts. Over seven months ending in June, separate tests conducted by The Journal and Northwestern University revealed that Instagram parent Meta is not living up to a promise it made this year.
Back in January, Meta said that it would focus on giving teens an experience on the platform that was more appropriate for their age. As a result, the company said that it would restrict sexually suggestive material. While the company says that users 16 and younger should not be shown sexually explicit content, it appears that Meta is dropping the ball.
For its tests, both The Journal and Northwestern University computer science professor Laura Edelson created new Instagram accounts listing the age of each subscriber as 13. At first, Instagram sent these accounts videos of women dancing seductively or posing in a way that put an emphasis on their breasts. The accounts skipped other content but watched the videos that were sexually suggestive. As a result, Reels would then recommend content that was even more racy.
The Journal says that adult sex content creators started showing up on the feed for the 13-year-old user after only three minutes. After less than 20 minutes of watching the Reels videos for the test accounts, they were full of promotions from these creators with some offering to send nude photos to Instagram subscribers willing to interact with their posts. The testing revealed that the short-form video platforms belonging to TikTok and Snapchat did not deliver the same sexually-focused content to underage users. A TikTok spokesman said, “We err on the side of caution,” and noted that teen subscribers have a limited pool of content that they can view.
“The Journal says that adult sex content creators started showing up on the feed for the 13-year-old user after only three minutes.”
Northwestern University’s Professor Edelson said, “All three platforms also say that there are differences in what content will be recommended to teens. But even the adult experience on TikTok appears to have much less explicit content than the teen experience on Reels.” While most of the testing took place from January through April, this month the Journal once again opened an account for a fake 13-year-old who watched only videos about women recommended by Instagram. After a half hour, the account was being sent videos about anal sex.
Meta, as you might expect it would, shrugged off the results of the tests as not being representative of the overall experience of teens on Instagram. Spokesman Andy Stone said, “This was an artificial experiment that doesn’t match the reality of how teens use Instagram.” The spokesman added, “As part of our long-running work on youth issues, we established an effort to further reduce the volume of sensitive content teens might see on Instagram, and have meaningfully reduced these numbers in the past few months.”
An internal analysis conducted by Meta in 2022 and reviewed by the Journal revealed that Meta knows that Instagram shows more pornography to teens than its adult users. The report showed that teens saw three times the number of posts containing nudity, 1.7 times the number of violent posts, and 4.1 times the number of posts showing bullying than those over 30 viewed.
Meta’s own internal analysis suggested that to resolve the problem, Meta build a separate recommendation engine for teens. So far, there does not appear to be any plan to do this. Part of the reason why teens are seeing such content is due to how the algorithm works. Content is recommended to users based on the type of content they view the most and linger over for the longest period of time.
Questions & Answers
Q.Which organisations conducted the tests revealing Instagram's inappropriate recommendations for teens?
Which organisations conducted the tests revealing Instagram's inappropriate recommendations for teens?
The Journal and Northwestern University conducted separate tests. They created new Instagram accounts for 13-year-olds to observe the content recommended to them over several months.
Q.What was Meta's promise earlier this year regarding teen safety on Instagram?
What was Meta's promise earlier this year regarding teen safety on Instagram?
In January, Meta promised to focus on giving teens a more age-appropriate experience on the platform. They stated they would restrict sexually suggestive material for users aged 16 and younger.
Q.How did the content recommendations for the fake teen accounts escalate during the tests?
How did the content recommendations for the fake teen accounts escalate during the tests?
Initially, sexually suggestive videos were recommended. After the accounts watched these, Reels then suggested racier content, leading to adult sex content creators and offers of nude photos within minutes.
Q.Does Meta's own internal analysis support the findings of the external tests?
Does Meta's own internal analysis support the findings of the external tests?
Yes, an internal Meta analysis from 2022, reviewed by The Journal, showed Instagram exposes teens to significantly more pornography, nudity, violence, and bullying than adult users.