Instagram Rolls Out New Anti-Abuse Features After Racist Attacks

Instagram Enhances Account Protection Against Online Abuse

Instagram is currently deploying a suite of new functionalities designed to bolster user protection against harassment and abusive behavior. These updates address issues like unwanted comments and direct messages, offering users greater control over their online experience.

New Tools for Managing Interactions

The platform is introducing tools to filter potentially abusive direct message (DM) requests. Furthermore, users will gain the ability to restrict commenting and DM access from others during periods of heightened attention, such as when a post goes viral.

Individuals who engage in harassing conduct on the service will now receive more prominent warnings outlining the potential repercussions of their actions.

Introducing "Limits" – A Temporary Lockdown Feature

Instagram head Adam Mosseri recently announced the testing of a new anti-harassment tool, named Limits, in a video update to the Instagram community. This feature provides a straightforward method for users to temporarily secure their accounts when facing a surge of harassment.

This addition would have been particularly beneficial in addressing the recent wave of racist attacks that occurred on Instagram following the Euro 2020 final.

Several England footballers were subjected to vicious harassment from disgruntled fans after the team's defeat, highlighting the limited protective measures available to users experiencing viral negativity.

How the "Limits" Feature Works

During periods of increased attention, Instagram users often encounter a large volume of unsolicited comments and DM requests from unfamiliar individuals. The Limits feature empowers users to determine who can interact with them during these busy times.

Accessible through the privacy settings, users can activate Limits to restrict interactions from accounts that do not follow them, as well as those that recently began following. When enabled, these accounts are temporarily prevented from posting comments or sending DM requests for a duration specified by the user, ranging from days to weeks.

Twitter had previously considered similar tools for users experiencing viral attention, but has yet to implement them.

The Limits feature, after a testing phase, is now being made available to all Instagram users globally.

Leveraging Machine Learning for Proactive Protection

Instagram is currently exploring the use of machine learning to identify spikes in comment and DM activity. This technology will proactively prompt users to activate Limits through notifications within the Instagram app.

Expanding the "Hidden Words" Feature

Another feature, Hidden Words, is also undergoing expansion to further safeguard users from abusive DM requests.

Hidden Words automatically filters requests containing offensive words, phrases, and emojis, placing them into a Hidden Folder that users can choose not to view. It also filters out spam and low-quality messages.

To prevent circumvention, Instagram does not publicly disclose the list of blocked words, but has recently updated its database to include new forms of offensive language, including strings of emojis used in the recent attacks on footballers.

Initially launched in a limited number of countries, Hidden Words will be accessible to all Instagram users worldwide by the end of the month. Instagram will actively encourage users with larger followings to utilize this feature through messages in their DM inbox and Stories tray.

Enhanced Comment Filtering Options

The feature has been augmented with a new option, “Hide More Comments,” allowing users to easily conceal comments that are potentially harmful but do not directly violate Instagram’s community guidelines.

Stronger Warnings Against Abusive Content

The warnings displayed when a user attempts to post potentially abusive content are also being strengthened. Previously, Instagram would issue a warning upon the first attempt to post an offensive comment, followed by a more severe warning for repeated offenses.

Now, the more forceful message will be displayed immediately upon the initial attempt to post potentially harmful content.

This message explicitly states that the comment may contain offensive language or violate Instagram’s guidelines, and warns that the comment may be hidden as a result. It further cautions that continued violations may lead to account deletion.

Potential for Misuse and Impact on the Creator Economy

While systems to combat online abuse are essential, there is a risk of these tools being misused to suppress legitimate dissent. For instance, a content creator spreading misinformation could utilize anti-abuse tools to hide critical comments, creating a false impression of widespread support.

This could then be leveraged for marketing purposes and securing brand partnerships.

As Instagram grants creators more control over managing online abuse, it must also consider the potential consequences for the broader creator ecosystem.

“We hope these new features will better protect people from seeing abusive content, whether it’s racist, sexist, homophobic or any other type of abuse,” stated Mosseri. “We know there’s more to do, including improving our systems to find and remove abusive content more quickly, and holding those who post it accountable.”