TikTok Withheld Safety Feature From 10% of US Users; Teen Suicide Linked to Experiment
A TikTok safety feature — a tweaked algorithm designed to reduce exposure to harmful content — was deliberately withheld from roughly 10% of the platform's U.S. users in December 2021 as part of an internal A/B test. According to a confidential internal report later obtained and made public by Bloomberg, the experiment was designed to measure whether the safety feature would reduce user engagement. One of the users inadvertently included in that control group was 16-year-old Chase Nasca, who subsequently died by suicide after being exposed to thousands of videos about self-harm. The report, which TikTok had fought to keep sealed, has now triggered intense scrutiny from U.S. senators and renewed the national debate over algorithmic transparency and child safety on social media.
What Happened: The 2021 TikTok Safety Experiment
The key event is TikTok's decision in December 2021 to conduct a so-called "backtest" experiment. The company temporarily removed algorithmic safety features — specifically, a model designed to downrank content promoting self-harm, eating disorders, and other damaging behaviors — from approximately 15 million U.S. users.
A confidential internal report, first reported by Bloomberg Businessweek in August 2026, documented this experiment. The document reveals that TikTok wanted to see what would happen to metrics like watch time, shares, and likes if the safety algorithm was switched off for a statistically significant portion of its user base. The assumption was that the safety feature might be reducing engagement because it filtered out highly emotional, attention-grabbing content.
TikTok has stated in the past that it reserves the right to A/B test features to improve the platform. However, the nature of this particular test — withholding a safeguard deliberately designed to protect vulnerable teens — has drawn widespread condemnation.
The Suicide of Chase Nasca: A Tragic Consequence
Chase Nasca, a 16-year-old from Long Island, New York, was one of the users in the control group that did not receive the safety algorithm. During the period the feature was withheld, TikTok's recommendation engine served him thousands of videos about self-harm, depression, and suicide. According to the internal report, Nasca's feed began to be dominated by this type of content after the safety guardrails were removed.
On January 8, 2022, Chase Nasca died by suicide. His family and their legal team have since argued that TikTok's algorithm played a direct and causal role in his death. The confidential document, which TikTok refused to release to U.S. Senators Marsha Blackburn and Richard Blumenthal, has become central to a lawsuit filed by Nasca's family. The company cited ongoing litigation as its reason for not providing the document to Congress.
Senator Blumenthal, in a statement reported by WSHU, called the experiment "morally wrong but potentially illegal," stating that the backtest directly contributed to Nasca's exposure to harmful content.
Who Was Affected? The Scale of the Experiment
To understand the scope of this incident, it is useful to put the numbers in perspective. The experiment affected roughly 10% of TikTok's U.S. user base at the time. While TikTok has not disclosed the exact demographic breakdown, internal data suggests that a significant percentage of affected users were minors.
| Metric | Detail |
|---|---|
| Date of experiment | December 2021 |
| Percentage of US users affected | ~10% |
| Estimated number of affected users | ~15 million |
| Safety feature withheld | Algorithm to reduce self-harm / harmful content exposure |
| Known fatality directly linked | 1 (Chase Nasca, age 16) |
| Internal report status | Confidential until made public by Bloomberg, Sept 2026 |
The table shows that this was not a minor, negligible test. It involved millions of real people, including vulnerable teenagers, without their knowledge or consent.
Why Did TikTok Do It? The Engagement Trade-Off
The central revelation of the Bloomberg report is the motivation behind the experiment: TikTok wanted to quantify the engagement cost of its own safety features. The company's internal documents explicitly frame the test as a way to determine whether the safety algorithm was "costing" the platform in terms of user retention and watch time.
This trade-off — safety versus engagement — is not unique to TikTok. Every major social platform grapples with it. Recommender systems optimized for maximum watch time often amplify sensational, divisive, or harmful content because that content drives higher engagement. TikTok's algorithm is particularly powerful because it learns user preferences rapidly from swipe and dwell-time signals.
The internal report indicated that the safety feature had a measurable negative impact on engagement metrics. By turning it off, TikTok could see how much reach harmful content had been losing under the safety model. Critics argue that this prioritization of profit and growth over user safety is a fundamental design flaw in the modern social media industry.
Senate Scrutiny: Blumenthal and Blackburn Demand Answers
The revelations have sparked a new wave of Congressional pressure on TikTok. Senator Richard Blumenthal (D-CT) has been particularly vocal, sending formal letters to TikTok's CEO demanding explanations for the experiment. He has questioned whether the company violated federal laws regarding children's online safety and deceptive trade practices.
Senator Marsha Blackburn (R-TN) has also pressed the company, noting that TikTok fought to keep the document sealed even from lawmakers. The two senators jointly requested the document in 2023, but TikTok refused, citing the ongoing Nasca family lawsuit.
Separately, Congressman John Moolenaar (R-MI) claimed that TikTok backed out of a planned public roundtable session, alleging that the company feared being questioned about child safety practices. As The Verge reported, Moolenaar stated that TikTok cited Meta's recent settlement on child safety issues as a reason they could not answer similar questions, even though child safety was not the original focus of the meeting.
The Legal and Regulatory Repercussions
The legal landscape for TikTok is increasingly hostile. The Nasca family's lawsuit is ongoing and has become a reference point for multiple other cases alleging algorithmic harm. The release of the confidential document by Bloomberg has provided plaintiff attorneys with a powerful piece of evidence: an internal company report that shows the company knew the safety feature was being withheld and knew it could cause harm, yet proceeded with the test anyway.
Legal experts cited in the Bloomberg coverage suggest that the document strengthens claims of negligence and, potentially, product liability. If a court finds that TikTok knowingly exposed minors to harm in order to test engagement metrics, the financial and reputational consequences could be severe.
Regulatory action is also possible. The Federal Trade Commission (FTC) has previously fined TikTok for privacy violations involving children. The new revelations could trigger a broader investigation into algorithmic practices across the industry.
TikTok Shop and Safety: A Broader Context
While the safety experiment controversy dominates the headlines, it is worth noting that TikTok's ecommerce arm, TikTok Shop, has also recently faced scrutiny over its practices. An Online Store News report from September 2026 alleged that TikTok Shop is quietly throttling third-party affiliate data flows to platforms like Klaviyo, potentially pushing merchants towards TikTok's native analytics tools.
In addition, sellers on platforms like Shopee and TikTok have called out auto-generated AI ads that they say mislead customers, as reported by Channel NewsAsia. These issues, while distinct from the safety algorithm controversy, paint a picture of a company that is willing to prioritize its own ecosystem and growth metrics over transparency, partner relationships, and user safety.
What This Means for Users and Parents
The practical implications of this story are significant for anyone using TikTok, especially parents of teenage users. The experiment reveals that TikTok's For You feed is not a neutral reflection of user interest; it is an engineered environment where safety features can be turned on or off based on internal business metrics.
For parents, the key takeaway is that platform safety features cannot be taken for granted. Even when safety algorithms are active, they are imperfect. When they are turned off for testing purposes, the consequences can be lethal. Experts recommend that parents actively monitor their children's TikTok usage, use built-in screen time and content filtering tools, and engage in open conversations about the nature of algorithmic recommendations.
Industry-Wide Implications: A Reckoning for Algorithmic Testing
TikTok is not the only platform that A/B tests its algorithms. Facebook, Instagram, YouTube, and Twitter (now X) all run experiments on millions of users regularly. However, the TikTok case is notable because the test involved a feature specifically designed to reduce exposure to clearly harmful content, and because a death has been directly linked to the experiment.
This incident is likely to accelerate calls for regulation of algorithmic experiments. The concept of "informed consent" for software updates and algorithm changes is gaining traction among privacy advocates. If a drug company wants to test a new medication, it must go through rigorous ethical review and obtain informed consent. Should the same standard apply to algorithm changes that affect the mental health of millions of users?
Senator Blumenthal has indicated he will introduce legislation requiring social media companies to disclose when they are conducting A/B tests that involve safety features, and to obtain affirmative consent from users (or their guardians) before including minors in such tests.
Conclusion: A Document That Changed the Conversation
The publication of the confidential TikTok report by Bloomberg has fundamentally changed the conversation around social media safety. What was once a theoretical debate about algorithmic harm is now backed by a concrete internal document showing a company's willful decision to remove safety guardrails from millions of users, including children, to test its bottom line.
As the Nasca family continues its legal fight and as Congressional hearings loom, TikTok faces an existential question: Can a platform built on maximizing engagement ever truly be made safe for its most vulnerable users? The answer, based on the evidence now public, remains deeply uncertain.
Frequently Asked Questions
What safety feature did TikTok withhold from users?
TikTok withheld an algorithmic safety feature designed to reduce exposure to content related to self-harm, eating disorders, and suicide. This feature downranked such material in users' For You feeds.
How many users were affected by TikTok's 2021 experiment?
Approximately 15 million U.S. users, or roughly 10% of TikTok's U.S. user base at the time, were placed in the control group that did not receive the safety algorithm.
Who was Chase Nasca?
Chase Nasca was a 16-year-old from Long Island, New York, who died by suicide in January 2022. He was part of the control group in TikTok's experiment and was exposed to thousands of self-harm videos as a result.
Why did TikTok conduct this experiment?
According to the internal Bloomberg report, TikTok conducted the experiment to measure whether the safety feature reduced user engagement metrics like watch time, shares, and likes.
Has TikTok faced legal consequences for this experiment?
The Nasca family has filed a lawsuit against TikTok, and the release of the confidential document has strengthened their case. Senators have also called for investigations and potential legislation.
Did TikTok cooperate with Congress on this matter?
No. TikTok refused to release the confidential report to Senators Blackburn and Blumenthal, citing ongoing litigation. Congressman Moolenaar also said TikTok backed out of a meeting about child safety.
What is an algorithmic 'backtest' in the context of TikTok?
A backtest is an A/B test where a platform temporarily changes an algorithm for a subset of users to measure the impact on behavior or engagement. In this case, the safety algorithm was removed to measure its effect.
How can parents protect their teens on TikTok?
Parents can enable TikTok's built-in screen time limits, use the restricted mode to filter mature content, monitor their teen's activity through family pairing, and discuss how algorithmic recommendations work.
Tired of expensive video shoots that don't convert?
VEONIB turns any product URL into high-converting ecommerce videos, product videos, social media ads and TikTok videos in under 60 seconds. No filming, no editing, no design skills needed.
Generate your first free video →