Discord · Trust & Safety

Warning System

Reframing enforcement as education.

Account Standing screen on a phone
Client
Discord
Role
Lead Product Designer
Team
Product, Engineering, Research, Policy, Legal, Data Science, Product Marketing
Year
2023

My contribution

Designed the end-to-end Warning System, Account Standing, and Appeals experiences, including the content strategy.

Deliverables

End-to-end user flows, interaction patterns, content strategy, responsive UI, design specifications.

The challenge

How do we enforce the rules and still help people recover?

Discord’s old enforcement system was simple: break the rules enough times and eventually lose your account. But it gave people little understanding of what they’d done wrong, where their account stood, or how to avoid making the same mistake again.

New EU regulations required us to make enforcement more transparent. We used that mandate to rethink the experience entirely. Instead of treating every violation as another step toward punishment, we created a graduated Warning System that shows people what happened, explains the policy behind it, makes the consequences clear, and gives them a path back to good standing.

The system launched ahead of the EU deadline and contributed to a 9% decrease in bans, or roughly 6,000 fewer bans per month, with no increase in appeal volume. More than 75% of affected users viewed their violation details, suggesting that when people were given context, they actually wanted to understand it.

System DM, violation detail and Account Standing screens on mobile
The approach

Offer transparency without complexity

We needed a model that did more than keep score. Each violation became an opportunity to explain the boundary someone had crossed and what they could do differently next time.

Behind that experience were complex policy rules, account states, consequences, and appeals. We brought them together into one clear path based on conversations with users who found themselves on the wrong side of Discord’s policies: what happened → why it happened → what it means → what comes next.

Violation detail modal on desktop
Design principle 1

Leave room for people to get it right

Someone making a mistake shouldn’t be treated the same as a bad actor repeatedly causing harm. We designed graduated consequences that could escalate with continued violations, while allowing people to recover. Account Standing made that path visible: where they stood, what their violations meant, and how their standing could improve.

Account Standing states from all good to banned
Design principle 2

Show people exactly what crossed the line.

A warning only helps if someone understands what triggered it. I defined how violation details brought together the relevant content, the policy it broke, and the consequences. That meant balancing enough context to make the decision understandable with care around how violating content was shown.

Account Standing page with active violations on desktopViolation content cards and evidence states
Design principle 3

Make enforcement contestable, not just understandable.

Clearer explanations also needed a clear way to disagree. We redesigned appeals as part of the same system, connecting violation details to a path for challenging Discord’s decision. People could understand the action taken against their account and request a review when they believed we got it wrong.

Request a review flow on mobile

Our approach got noticed

Read the story →
Platformer: Inside Discord’s reform movement for banned users, by Casey Newton
The impact

Fewer bans. More understanding.

The Warning System launched ahead of the EU deadline and contributed to a 9% decrease in bans, or roughly 6,000 fewer bans per month, without increasing appeal volume.

More than 75% of affected users viewed their violation details, and people also actively sought out Account Standing to understand where they stood.

The result was an enforcement system that could still hold people accountable while giving more of them a chance to understand the rules and get it right.

Impact
−9%

Decrease in bans, roughly 6,000 fewer bans per month.

75%+

Viewed their violation details

0

Increase in appeal volume

Early

Launched ahead of the EU deadline

Next steps

Building toward account health.

The EU’s Digital Services Act set our launch deadline. We focused first on enforcement transparency, while designing a foundation for broader account health.

Safety at Discord: projects map showing where Safety Center phases 1 and 2 sit in the app
Phase 1

What happened, and what are my options?

Warnings, Account Standing, and Appeals helped people understand Discord’s decisions and what they could do next. A system message leading to an inbox in Settings gave us a practical path to launch.

Account statuses in the wild, and the heat map we translated ladders and account state into Entry-point comparison scorecard: six options scored on usability, process transparency and engineering effort

Comparison scores are retrospective design hypotheses, not research findings or engineering estimates.

Phase 2

How can I take charge of my safety?

The future vision added Reports and safety resources to give people a fuller picture of their account health. A side-tab entry point would make the experience more usable and transparent, but required a larger engineering investment.

Safety Center with account health, safety spotlight and account standing on desktop

On to the next one

Family Center

Family Center

Sparking conversation between parents & teens

Coming soon
Ignore

Ignore

Offering a stealthy way to get space

Coming soon

Let’s create
something great

Get in touch