Snap Employees Aware of Child Safety Concerns in App, New Lawsuit Unveils

Sextortion on Social Media: The Echo from Snap Inc.

The issue of sextortion on platforms designed for social interaction has become increasingly concerning, particularly with revelations surrounding Snapchat, a popular app among teens. A recent lawsuit filed by New Mexico’s Attorney General against Snap Inc. highlighted alarming statistics and internal communications that indicate a troubling awareness within the organization.

Rising Reports of Sextortion

By November 2022, Snap employees reported receiving 10,000 user submissions relating to sextortion each month. However, they acknowledged that this number “likely represents a small fraction of this abuse” due to the stigma and barriers that prevent victims from reporting such incidents. The lawsuit, with less redaction than previous versions, emphasizes the pressure on both Snap and its users.

Failures in User Protection

Specific cases revealed in the complaint show a disturbing trend; one case noted had 75 reports involving minors, nudity, and extortion, yet the associated account was still operational. In 2022, internal research showed that over one-third of teenage girls and 30% of teenage boys encountered unwanted contact on Snap's platform. This paints a picture of a company that, despite being aware of these issues, appears to be inadequately addressing them.

Management Disconnect and Prioritization of Features

Compounding the problem, former employees voiced concerns about a lack of interaction between trust and safety teams and upper management. Pushback was reported against in-app safety mechanisms, as CEO Evan Spiegel focused more on design aesthetics than user safety. Such prioritization raises serious questions about the company's commitment to safeguarding its younger audience.

Design Choices Impacting Safety

Snap’s design choices aimed at ensuring user privacy inadvertently contributed to a riskier environment for minors. Reports from 2021 indicated that there were numerous cases of predators manipulating Snapchat to connect with children, some as young as eight. Nevertheless, it was feared that implementing measures to combat these predatory behaviors would overburden user privacy and significantly raise operational costs.

Quick Add Feature Risks

One of the features flagged by employees was Quick Add, which suggests users to connect with others. An internal communication revealed a desire to find innovative approaches that would shield vulnerable users, like minors, from predatory accounts. While Snap eventually restricted Quick Add visibility based on shared friends, employees recognized this measure didn’t adequately address the larger issues at play.

Facilitating Illegal Activities: Gun Sales

In addition to sextortion, the unsealed complaint brought attention to Snap’s alleged role in facilitating illegal gun sales. A presentation within the company stated that Snap sees approximately 50 posts related to illegal weapon sales daily. Alarmingly, it was noted that reported content is often seen hundreds of times prior to being acted upon.

The Addictiveness of Snapstreaks

Moreover, internal communications regarding Snapstreaks—a feature designed to encourage continued communication between users—highlighted their addictive nature. One employee commented on the allure of such features, noting that they effectively keep users engaged, making it “impossible to unplug for even a day.” These features raise ethical questions regarding user engagement strategies.

Conclusion: The Need for Accountability

The lawsuit against Snap Inc. underscores significant safety and ethical concerns regarding how social media platforms prioritize user engagement over protection, particularly for vulnerable populations like minors. Going forward, it is crucial for technology companies to reassess their policies and design choices, ensuring they foster a safe, not just engaging, environment for users.