Defenders of privacy and digital rights are generating alarms about a law that many would expect to encourage: a federal repression against revenge porn and the deep deep generated by AI.
The newly signed Take it down act It makes illegal publish not consensual, real or generated by AI, and offers platforms only 48 hours to comply with the request to eliminate a victim or facial responsibility. While it is widely praised as a victory for a long time for the victims, experts also warned their vagus language, lax standards to verify the statements and the low compliance window could pave the way to exaggerate, censorship of legitimate content and even vigilance.
“The moderation of scale content is widely problematic and always ends with an important and necessary discourse,” he told TechCrunch, director of Federal Affairs of the Frontier Electronic Foundation, a digital rights organization.
Online platforms have a year to establish a process to eliminate non -consensual intimate images (NCII). Although the law requires that demolition requests come from victims or their representatives, only request a physical or electronic firm, an identification with photo or other form of verification is not needed. That is probably aimed at reducing barriers to victims, but could create an abuse opportunity.
“I really want to be wrong about this, but I think there will be more requests to eliminate images that represent queer and trans people in relationships, and even more than that, I think it will be consensual porn,” McKinney said.
Senator Marsha Blackburn (R-TN), copatrochinator of the Take It Down law, also sponsored the Children’s Security Law What puts responsibility on platforms to protect children from the harmful content online. Blackburn has said she believes Content related to transgender people It is harmful to children. Similarly, the Heritage Foundation, the group of conservative experts behind the 2025 project, also has saying that “maintaining the trans content away from children is to protect children.”
Due to the responsibility facing the platforms if they do not withdraw an image within 48 hours after the reception of a request, “the default value will simply eliminate it without investigating whether this is really NCII or if it is another type of speech protected, or if it is relevant for the person who is making the request,” McKinney said.
Snapchat and Meta have said that they support the law, but none responded to TechCrunch requests for more information on how to verify if the person requesting a demolition is a victim.
Mastodon, a decentralized platform that houses its own flagship server that others can join, told TechCrunch that it would bow towards elimination if it was too difficult to verify the victim.
Mastodon and other decentralized platforms such as Bluesky or Pixed can be especially vulnerable to the relaxing effect of the 48 -hour demolition rule. These networks depend on independent servers, often administered by non -profit organizations or individuals. According to the law, the FTC can deal with any platform that does not “reasonably comply” with the demands of demolition such as committing an “unjust or misleading act or practice”, even if the host is not a commercial entity.
“This is worrying in his face, but it is particularly so at a time when the FTC chair has taken unprecedented pass to politicize the agency and has explicitly promised to use the power of the agency to punish platforms and services in a ideologicalUnlike the basis of principle, “said in a cyber civil rights initiative, a non -profit organization dedicated to ending the porn of revenge, in a statement.
Proactive monitoring
McKinney predicts that platforms will begin to moderate the content before it is disseminated, so they have less problematic publications to tear down in the future.
The platforms are already using AI to monitor the harmful content.
Kevin Guo, CEO and co -founder of Generated ai Start of hive content detectionHis company said, he works with online platforms to detect deep defaces and child sexual abuse (CSAM). Some of Hive customers include Reddit, Giphy, Vevo, Bluesky and Bereal.
“Actually we were one of the technology companies that supported that bill,” Guo told Techcrunch. “It will help to solve some quite important problems and force these platforms to adopt solutions more proactively.”
Hive’s model is a software as a service, so the start does not control how platforms use their product to mark or eliminate content. But Guo said that many clients insert Hive API at the point of loading to monitor before something is sent to the community.
A Reddit spokesman told TechCrunch that the platform uses “sophisticated internal tools, processes and equipment to address and eliminate” NCII. Reddit is also associated with non -profit SWGFL to implement its Stopncii tool, which scan live traffic to coincide with a known NCII database and eliminates precise coincidences. The company did not share how it would guarantee that the person requesting the demolition is the victim.
McKinney warns that this type of monitoring could be extended to encrypted messages in the future. While the law focuses on public or semi -public dissemination, it also requires that platforms “eliminate and make reasonable efforts to avoid the reupplication” of non -consensual intimate images. She argues that this could encourage the proactive scan of all content, even in encrypted spaces. The law does not include any size for messaging services encrypted from end to end such as WhatsApp, Signal or Imessage.
Meta, Signal and Apple have not responded to TechCrunch’s request for more information about their encrypted message plans.
Broader implications of freedom of expression
On March 4, Trump delivered a joint speech to Congress in which he praised Take It’s law and said he hoped to sign him.
“And I will also use that invoice for me, if you don’t care,” he added. “There is no one who is treated worse than me online.”
While the public laughed at the comment, not everyone took it as a joke. Trump has not been shy to suppress or retaliate against unfavorable discourse, either labeling the main media “people’s enemies” except for the Association press from the oval office despite a court order, or Pull funds NPR and PBS.
On Thursday, the Trump Administration Barred Harvard University Since accepting foreign students admissions, increasing a conflict that began after Harvard refused to adhere to Trump’s demands to make changes in his curriculum and eliminate content related to DEI, among other things. In retaliation, Trump has frozen federal funds for Harvard and threatened to revoke the university -free state.
“At a time when we already see that school boards try to prohibit books and we are seeing that certain politicians are very explicitly about the types of content that do not want people to see, whether it is the critical theory of the race or information of abortion or information on climate change … it is deeply uncomfortable for us with our previous work in the moderation of content to see the members of both parties open for the open parties in the modernization. Scale, “McKinney says.