Media Bias/Fact Check

Media Bias/Fact Check (MBFC) is a fact-checking website which indexes and ranks websites by left- or right wing bias (each website is ranked from "extreme left" to "least biased" to "extreme right") and by quality of factual reporting (each website has a "conspiracy level" and a "pseudo-sci level"). Although MBFC's methodology is ultimately subjective, it appears to be fairly consistent and reliable in its ratings. MBFC has extensions for both and.

Besides evaluating media bias and factual reporting, they have also made a profile of the current state of media in 36 countries with the aim of expanding to 180 countries by the next year and a report page that includes short excerpts from credible and unbiased news articles and fact checks selected by Dave Van Zandt. It is not considered a reliable source by Wikipedia because it is considered a "self-published" source.

Contributors
According to its "About" page, MBFC was started by Dave Van Zandt in November 2015. Other than Van Zandt, the website has five now nine other volunteers who perform source research, writing and assist in fact checking, who are:
 * Aaron O’Leary – Writer/Contributor
 * Karen O’Connor Rubsam – Writer/Contributor
 * Kenneth White – Writer/Contributor
 * Jim Fowler – Writer/Contributor
 * Dennis Kelley – Research
 * Michael Allen – Research
 * Faith Locke Siewert – Research
 * McKenzie Huitsing – Research
 * Mike Crowe – Extensions – Web Development

Not much additional information about Van Zandt is publicly available online. A LinkedIn profile states that a Dave Van Zandt is the former owner of Van Zandt Webs and studied at William Paterson University of New Jersey. From the F.A.Q:

Methodology
According to their FAQ page, their methodology "is a simple tool that provides a general rating of bias" but it "is not a scientifically proven methodology." Their methodology page contains this disclaimer:

Sites are rated on a 0-10 scale by Van Zandt and his team on 4 categories, biased wording and headlines, factuality and sourcing, story choices and political affiliation.

The scores of each of these (biased wording, factuality, story choices, political affiliation) is averaged to give one bias score. Scoring and classification on bias level is as follows:
 * 0 – 2 = Least Biased (best)
 * 2 – 5 = Left/Right Center Bias
 * 5 – 8 = Left/Right Bias
 * 8 – 10 = Extreme Bias (worst)

Classifications on bias is as follows:
 * Extreme left
 * Left
 * Left-center
 * Least Biased
 * Right-center
 * Right
 * Extreme right

Scoring and classification on factual reporting is as follows (increasing by failed fact-checks):
 * 0 - 0 = Very High
 * 1 - 3 = High
 * 3 - 4 = Mostly Factual
 * 5 - 6 = Mixed
 * 7 - 9 = Low
 * 10   = Very Low

Classifications on conspiracy level is as follows:
 * Mild
 * Moderate
 * Strong
 * Tin Foil Hat

Classification on pseudoscience level is as follows:
 * Mild
 * Moderate
 * Strong
 * Quackery

Other classifications are as follows:
 * Questionable Sources (FN - stands for fake news - or Q in MBFC's official browser extensions)
 * Conspiracy/Pseudoscience
 * Pro-science
 * Satire

For each source, a minimum of 10 headlines are reviewed and a minimum of 5 news stories reviewed. News reporting is reviewed first and then followed by looking at editorial and opinion pieces. If there is still not enough clear evidence, searching methods for articles on the site such as “Republican”, “Democrat”, “Liberal”, “Conservative”, “Trump”, “Clinton” etc. are used until the political affiliation is confirmed. This process can be time-consuming or very simple depending on the source.

Example: CNN
Here is an example of how CNN would be (and is) scored with the same methodology.

Biased Wording = 5 (CNN uses moderate biased words that favor liberals and headlines typically match the story) Factual/Sourcing = 4 (CNN is mostly trustworthy for providing evidence and sources, but sometimes jumps the gun on breaking stories) Story Choices = 7 (CNN mostly favors pro-liberal stories and publishes negative conservative stories) Political Affiliation = 7 (CNN mostly favors liberal ideology through content and wording)

Total = 23 Average 23/4 = 5.75 5.75 = Moderate Left Bias

Factual Reporting = 6 (See factual/sourcing above. Here, 0 is not perfect but it is the opposite) 6 = Mixed

Trusted websites
MBFC's most trusted fact checking websites include:


 * PolitiFact
 * FactCheck.org
 * Snopes
 * Flack Check
 * Hoax-Slayer
 * Fact Checker by the Washington Post
 * Flack Check
 * Hoax-Slayer
 * Fact Checker by the Washington Post
 * Fact Checker by the Washington Post

Reception from nutters
Predictably, MBFC has drawn ire from several of the websites that file under "Conspiracy/Pseudoscience" or "Questionable Sources" — typically, in light of their regular publication of fake news and/or general bigotry. For example, WND was rated by MBFC as having mixed factual reporting and right-wing bias. WND then included MBFC in their article titled "Phony Baloney: The 9 Fakest Fake-News Checkers". Zero Hedge, a website rated as conspiracy-pseudoscience, posted the same article on their website. Media Fact Watch wrote their own negative article about fact checkers which also included MBFC.

Reasonable criticism
The Columbia Journalism Review has described MBFC reviews as subjective assessments that "leave room for human biases, or even simple inconsistencies, to creep in". According to the methodology listed on the MBFC website, reviews may be assigned after reviewing as little as ten headlines and five articles, which may only represent but a sliver of all the content said source produces. The Poynter Institute has also criticized the method of MBFC as "in no way scientific".

MBFC has rated some propaganda outlets as being "least biased". For example:
 * The United States' Voice of America and allied Radio Free Europe/Radio Liberty, which are considered to be propaganda outlets by some, and are also regarded as sources to be treated carefully by Wikipedia.
 * Until October 2018 MBFC rated China's Xinhua News Agency as "least biased", but the rating has since changed to the somewhat more reasonable "left-center bias". Xinhua has been criticized by Reporters Without Borders as being the "world's biggest propaganda agency", and is regarded by Wikipedia as a source "to treat carefully". While seemingly avoiding the outright conspiracy peddling of fellow state media outfits Press TV and RT (both considered questionable sources by MBFC), Xinhua may still be using techniques that tend to evade MBFC's rating system: government-picked journalists, political indoctrination of trainee journalists, recapitulation of government reports, allowing some critical or sensitive reporting in English but not in Chinese, no demarcation between the Communist Party and Xinhua administrators, defense of repressive regimes (e.g., Zimbabwe, Burma, Sudan and Pakistan), and preparation of "internal reports" that are intended only for Communist Party leaders. An analysis of the French-language Xinhua site found that 80% of news stories about China were positive, indicating that there is a systematic absence of critical reporting.

Other questionable ratings:
 * Epoch Times was evaluated as 'least biased' with factual reporting 'high' as of September 7, 2017. By November 4, 2018, the rating was changed to 'right-center' with 'high' factual reporting. By December 30, 2018, after it was pointed out to MBFC that Epoch Times had regularly been reporting uncritical pseudoscience in their "Beyond Science" section, their rating was changed to 'mixed' factual reporting. By July 28, 2019, it was clear that Epoch Times had entered full-Trump mode, and their rating changed to 'right bias'. As of its most recent update, it is listed as a "Questionable Source" with "Low Credibility".
 * Prior to its re-evaluation as a conspiracy website in November 2018, American Herald Tribune was described as "usually factually based and sourced". The website has articles describing LGBT people as "perverts", the Sandy Hook massacre as a "staged event", and 9/11 as a "false flag". The editor of the website, Anthony Hall, hosts a YouTube program called False Flag Weekly News and has supported an "open debate" on the Holocaust in a video for a Holocaust denying organisation.    The website also includes articles written by Robert David Steele who famously believes "there is a colony on Mars that is populated by children who were kidnapped and sent into space on a 20-year ride."
 * Quillette was rated as "right-center" bias with its factual reporting to be high. This is despite the site pushing absolutely bunk racialist pseudoscience and highly questionable views on hereditarianism and other biological bullshit. This is also in spite of the founder following 16 alt-right accounts on Twitter and being hosted on the alt-right Rebel Media, while other frequent contributors include Toby Young, supporter of eugenics; and Adam Perkins, supporter of hereditarianism. Quillette included several alt-right figures, KKK members, Proud Boys, and Neo-Nazis in their list of conservatives being oppressed by media. Media Bias Fact Check later updated Quillette on July 19, 2019 and has rated them Questionable based on promotion of racial pseudoscience as well as moving away from right-center to right bias. Great!
 * MBFC had stated, a "factual search reveals a Pants on Fire claim" by Right Wing Watch. However, they linked to an article which mentions that Right Wing Watch had reported the claim from right-wing pastor Paul Begley that Melania Trump ordered the White House to be completely exorcised before moving in. Right Wing Watch highlights fringe views from right-wing figures and is clearly not endorsing them, such as the article titled "Paul Begley Says Kate Spade And Anthony Bourdain May Have Been ‘High Profile Sacrifices Of The Illuminati’". Another Right Wing Watch article also specifically stated that "there was no reason to believe that Begley’s [exorcism] story was true or that he was in any position to know about the first lady’s spiritual housecleaning practices." MBFC has since corrected this error, and changed the Factual Reporting rating to "High".
 * Blue Lives Matter is rated correctly with "right bias". However, they were given a "high" factual rating until July 2020 when it was lowered to "mixed". Some of their examples do have neutral language, but fail to mention how articles preface police deaths as "hero down"; other articles, some writtten by the community, others by Sandy Malone, a managing editor, do have loaded, misleading headlines such as "School District Defends AP History Lesson Calling Trump A Nazi And Communist". Some articles written by have been sourced from sites Media Bias/Fact Check has rated as "mixed" in accurate reporting including Project Veritas and Fox News, loaded headline included. They have also promoted a highly misleading article, with a misleading headline, on the effects of hydroxychloroquine and governor's apparently hypocritical approaches to them, and that "doctors all over the world have [been] experimenting with it and seeing success" This runs against Snopes's article on hydroxychloroquine, where all success from COVID-19 treatment are only in cell cultures, a very weak line of evidence, and that more is needed. The Blue Lives Matter article also fails to note the distinction between addressing shortage of hydroxychloroquine used to treat malaria compared to using the drug for limited circumstances, emergency use authorization while creating the narrative of apparently hypocritical governors. The site has also used a Campus Report article as its source of news, which was also rated as "Mixed" from Media Bias / Fact Check and was lambasted by Media Matters.

Despite a few issues, Media Bias/Fact Check does often correct those errors within a reasonable amount of time, which is commendable. It helps if someone brings the problem to their attention with citations, and the problem is fixed speedily.