Protecting Young People from Unwanted Nudity and Sextortion Scams
Meta, the social media giant, is taking steps to protect young people from the dangers of unwanted nudity and sextortion scams. The company is testing new tools and features, including the introduction of Nudity Protection in DMs. This feature automatically blurs nude images sent in direct messages, providing a layer of protection for users.
Financial sextortion, a growing crime where individuals threaten to post nude photos online unless the victim pays a sum of money or gift cards, is a major concern for Meta. Antigone Davis, Meta’s director of global safety, acknowledges the seriousness of this crime, stating that it preys on people’s feelings of isolation and shame. To combat this issue, Meta aims to raise awareness and continually evolve its tools.
Nudity Protection in DMs will be a default feature for users under 18 years old, and it will be encouraged for all users. When someone with this protection enabled attempts to send a photo containing nudity, they will receive a reminder to be cautious, with the option to unsend the image at any time. If a user tries to forward a nude image, they will be prompted to reconsider their actions and act responsibly and respectfully. Additionally, when a user receives a nude image, it will be automatically blurred, and they will be encouraged not to feel pressured to respond in kind. Users will also have access to safety tips when sending or receiving such images.
Meta’s ability to detect nudity in images is made possible through on-device machine learning, which includes end-to-end encryption protection. According to Meta, unless an image in a direct message is reported, the company does not have access to it.
In its commitment to combating sextortion, Meta is developing technology to identify accounts engaged in this harmful activity. If an account is flagged as a potential sextortion account, the messages sent by that account will be directed to the recipient’s hidden request folder. Furthermore, if an account is flagged as a potential sextortion account, even if the user is already connected to a teenager, there will be no “Message” button displayed on the teenager’s profile. If someone interacts with an account that has been removed for sextortion, they will receive a pop-up message guiding them to additional resources. Additionally, when teenagers report relevant issues, they will be provided with information about local child safety helplines.
Meta recognizes the importance of collaboration in combating these crimes. Predators and sextortion scammers often target victims across multiple platforms. To address this, Meta has started sharing more sextortion-specific signals with Lantern, an industry collaboration platform. By working together, Meta aims to prevent sextortion scams not only on individual platforms but across the entire internet.
In conclusion, Meta is taking proactive steps to protect young people from unwanted nudity and sextortion scams. Through features like Nudity Protection in DMs and technology to identify potential sextortion accounts, the company is committed to creating a safer online environment for its users.