Can you really trust the 'community note' that prevents the spread of Twitter's hoaxes? Explain the mechanism of the algorithm



In December 2022, Twitter officially

introduced a ' community note ' function that allows users to evaluate each other and check facts in order to prevent the spread of misleading information and hoax information. However, since community notes are written by users, there are many people who are wondering, 'Can I trust community notes in the first place?' The algorithm that determines the reliability of community notes has been published, so I tried to summarize its contents.

Note Ranking Algorithm
https://communitynotes.twitter.com/guide/en/under-the-hood/ranking-notes



◆What is a community note?
Community Notes is a feature that allows users to leave 'notes' that explain the context of tweets that may be misleading. For example, the following tweet claiming that ``

Red No. 40 develops ADHD'' contains a note that ``spreads misinformation about developmental disorders.''



Each note is created and evaluated by Twitter users, and the Twitter management team will not intervene unless the rules are violated. However, if notes created by malicious users or users with wrong knowledge become widespread, notes that are supposed to prevent the spread of misinformation can lead to the spread of misinformation. . In order to prevent the spread of notes containing false information, community notes are equipped with a mechanism of ``evaluating notes among users''.

You can rate the credibility of each note by clicking 'Rate' inside the note.



There are three levels of evaluation: 'yes', 'a little', and 'no'.



◆ Judgment of usefulness before publication of notes
The note is not released to the world immediately after it is created. It is open only to users who have participated in the 'Cooperation Program', and is evaluated as 'useful' or 'not useful'.

The note has three levels of status: ``The note is currently rated as ``useful'''', ``The note needs further evaluation'', and ``The note is currently not rated as ``useful''. exists. Immediately after creation, the note was assigned a status of 'The note needs further evaluation', and after receiving 5 or more evaluations, the notebook that received the most positive evaluations was released to the public and received a large number of negative evaluations. Notes will be private. In addition, it is said that measures such as temporarily locking the note creation function will be taken for users who have repeatedly created notes that collect many negative evaluations.



◆ Judgment of usefulness immediately after the release of the notebook
Post-publication notes will be judged as 'useful' or 'useless' based on the usefulness score determined by the 'matrix decomposition model'. Notes with a usefulness score of 0.40 or higher are considered 'useful' notes, notes below -0.04 are classified as 'useless' notes, and notes between 0.40 and -0.04 are classified as 'needs more evaluation'. .

Until two weeks have passed since the note was displayed, a ranking algorithm, including the results of matrix decomposition, is run to update the usefulness score and status each time. A note's usefulness status is fixed two weeks after publication.

In addition, the official Twitter account `` Useful Community Notes '' summarizes tweets containing notes that satisfy the conditions `` `` useful '' status was maintained for 6 hours '' and `` usefulness score is 0.45 or higher ''.

Useful community notes (@HelpfulNotesJP) / Twitter

https://twitter.com/HelpfulNotesJP



Also, the source code of the Twitter community note algorithm is available on GitHub.

communitynotes/sourcecode at main twitter/communitynotes GitHub

https://github.com/twitter/communitynotes/tree/main/sourcecode

Related Posts:

in Web Service, Posted by log1r_ut