How we generate credibility scores

people annotating people annotating

1

First, chrome extension users highlight suspicious information in their news articles, sending it along to Public Editor.

people annotating people annotating

2

An expert annotator receives and reads the article, highlighting problematic passages mapped to categories of misinformation. Passages are sent to specialist annotators for further review.

people annotating people annotating

3

Specialists in each category assess the problematic passages in close detail, identifying specific mistakes.

people annotating

4

Work of the specialists is statistically evaluated. When multiple specialists find the same mistake type, that mistake is factored into the article’s credibility score.

people annotating

5

A credibility icon combines all contributing mistakes into a single score displayed on the article for Public Editor users.

5

A credibility icon combines all contributing mistakes into a single score displayed on the article for Public Editor users.

people annotating

5

A credibility icon combines all contributing mistakes into a single score displayed on the article for Public Editor users.