PropOrNot

We will consider revealing our names when Russia reveals the names of those running its propaganda operations in the West 😂 PropOrNot is a site providing lists of websites that purportedly spread and expose Russian propaganda, and is (according to The Daily Beast) a "sorry piece of trash". Some justified, some not. It was also accused of McCarthyism.

Methodology
PropOrNot’s methodology consists of 7 checks. If it passes in all of the above, it is claimed to be safe to classify the site as Russian propaganda.
 * Check 1: Citing obvious Russian propaganda sites such as RT, Fort-Russ etc.
 * Check 2: History of reusing text from obvious Russian propaganda.
 * Check 3: History of generally echoing the Russian propaganda "line".
 * Check 4: History of echoing the Russian line in strange ways.
 * Check 5: Lacks the hallmarks of good actual journalism (well-cited, balanced, bias-free).
 * Check 6: Called out by other credible fact-checkers, journalists, and debunkers.
 * Check 7: Steadfastly avoids coherently proposing constructive solutions to anything.

The list
On November 30 2016, PropOrNot published a list of 202 websites that they classify as Russian propaganda based on "a combination of manual and automated analysis, including analysis of content, timing, technical indicators, and other reporting", which the anonymous group suggests are "consistently, uncritically, and one-sidedly echoing, repeating, being used by, and redirecting their audiences to Russian official and semi-official state media".

They might not be propaganda, but most of them are definitely fake news sites.


 * 4thmedia.org
 * 4threvolutionarywar.wordpress.com
 * abeldanger.net
 * activistpost.com
 * ahtribune.com
 * allnewspipeline.com
 * americanlookout.com
 * americasfreedomfighters.com
 * amren.com
 * amtvmedia.com
 * ancient-code.com
 * anonews.co
 * anonhq.com
 * antiwar.com
 * asia-pacificresearch.com
 * assassinationscience.com
 * baltimoregazette.com
 * barenakedislam.com
 * beforeitsnews.com
 * bignuggetnews.com
 * bioprepper.com
 * blackagendareport.com
 * blacklistednews.com
 * christianfightback.com
 * collective-evolution.com
 * conservativedailypost.com
 * consortiumnews.com
 * corbettreport.com
 * cosmicscientist.com
 * countercurrents.org
 * counterinformation.wordpress.com
 * dailyoccupation.com
 * dailystormer.com
 * darkmoon.me
 * darkpolitricks.com
 * davidstockmanscontracorner.com
 * dcclothesline.com
 * dcleaks.com
 * defenddemocracy.press
 * dennismichaellynch.com
 * disclose.tv
 * disclosuremedia.net
 * drudgereport.com
 * educate-yourself.org
 * educateinspirechange.org
 * endingthefed.com
 * endoftheamericandream.com
 * endtime.com
 * eutimes.net
 * eutopia.buzz
 * ewao.com
 * eyeopening.info
 * fellowshipoftheminds.com
 * filmsforaction.org
 * floridasunpost.com
 * foreignpolicyjournal.com
 * fourwinds10.net
 * freedomoutpost.com
 * gaia.com
 * galacticconnection.com
 * gangstergovernment.com
 * gatesofvienna.net
 * geopolmonitor.com
 * globalresearch.ca
 * godlikeproductions.com
 * govtslaves.info
 * greanvillepost.com
 * guccifer2.wordpress.com
 * hangthebankers.com
 * healthnutnews.com
 * henrymakow.com
 * heresyblog.net
 * humansarefree.com
 * ihavethetruth.com
 * in5d.com
 * informationclearinghouse.info
 * infowars.com
 * intellihub.com
 * intersectionproject.eu
 * intrepidreport.com
 * investmentresearchdynamics.com
 * investmentwatchblog.com
 * jackpineradicals.com
 * jamesrgrangerjr.com
 * jewsnews.co.il
 * journal-neo.org
 * katehon.com
 * kingworldnews.com
 * lewrockwell.com
 * libertyblitzkrieg.com
 * libertywritersnews.com
 * makeamericagreattoday.com
 * memoryholeblog.com
 * mintpressnews.com
 * moonofalabama.org
 * nakedcapitalism.com
 * naturalblaze.com
 * naturalnews.com
 * newcoldwar.org
 * newstarget.com
 * newswithviews.com
 * nowtheendbegins.com
 * nsnbc.me
 * off-guardian.org
 * oftwominds.com
 * oilgeopolitics.net
 * opednews.com
 * orientalreview.org
 * patriotrising.com
 * paulcraigroberts.org
 * platosguns.com
 * pravda.ru
 * pravdareport.com
 * prepperwebsite.com
 * presstv.com
 * prisonplanet.com
 * rbth.com
 * readynutrition.com
 * redflagnews.com
 * regated.com
 * rense.com
 * righton.com
 * rinf.com
 * ronpaulinstitute.org
 * rt.com
 * rumormillnews.com
 * ruptly.tv
 * russia-insider.com
 * sana.sy
 * sentinelblog.com
 * sgtreport.com
 * shiftfrequency.com
 * shtfplan.com
 * silentmajoritypatriots.com
 * silverdoctors.com
 * sott.net
 * southfront.org
 * sputniknews.com
 * stormcloudsgathering.com
 * strategic-culture.org
 * superstation95.com
 * survivopedia.com
 * the-newspapers.com
 * theantimedia.org
 * thecommonsenseshow.com
 * thedailybell.com
 * thedailysheeple.com
 * theduran.com
 * theearthchild.co.za
 * theeconomiccollapseblog.com
 * theeventchronicle.com
 * thefederalistpapers.org
 * thefreethoughtproject.com
 * themindunleashed.org
 * thenewsdoctors.com
 * therebel.media
 * therussophile.org
 * thesaker.is
 * thesleuthjournal.com
 * thetruenews.info
 * thetruthseeker.co.uk
 * theunhivedmind.com
 * thirdworldtraveler.com
 * toprightnews.com
 * trueactivist.com
 * trunews.com
 * truthout.org
 * truthandaction.org
 * truthdig.com
 * truthfeed.com
 * truthkings.com
 * ufoholic.com
 * undergroundworldnews.com
 * unz.com
 * usanewshome.com
 * usapoliticsnow.com
 * usasupreme.com
 * usdcrisis.com
 * usslibertyveterans.org
 * vdare.com
 * veteransnewsnow.com
 * veteranstoday.com
 * vigilantcitizen.com
 * viralliberty.com
 * voltairenet.org
 * wakeupthesheep.com
 * wakingtimes.com
 * washingtonsblog.com
 * wearechange.org
 * weshapelife.org
 * whatdoesitmean.com
 * whatreallyhappened.com
 * wikileaks.com
 * wikileaks.org
 * wikispooks.com
 * worldnewspolitics.com
 * worldpolitics.us
 * www.fort-russ.com
 * yournewswire.com
 * zerohedge.com

Questionable inclusions

 * CounterPunch was included in one of the earlier versions of the list. After a brief exchange of emails, they agreed to remove them from the list. As Joshua Frank writes:


 * Truthdig, which is a fairly normal news site that is rated with high-factual reporting from MBFC, is still present on the list. While they are very critical of the US government, they pass none of the 7 criteria to be classified as propaganda.
 * Survivopedia, which is also fairly normal news site focused on, well, survival, is also purported Russian propaganda.
 * Naked Capitalism, which literally has capitalism in its name, is supposedly Russian propaganda. It also has a high-factual reporting rate from MBFC. It is a widely respected left-wing site run by Wall Street critic Yves Smith. That site was named by Time magazine as one of the 25 Best Financial Blogs in 2011 and by Wired magazine as a crucial site to follow for finance, and Smith has been featured as a guest on programs such as PBS's Bill Moyers Show.

Reception
The site gained traction from an article in The Washington Post by Craig Timberg on November 24th, 2016, nearly a month after its inception. The site was further endorsed by Business Insider, The Wrap, and the Associated Press.

The Washington Post report was one of the most widely circulated political news articles on social media over the previous 48 hours, with dozens, perhaps hundreds, of U.S. journalists and pundits with large platforms hailing it as an earth-shattering exposé. It was the most-read piece on the entire Post website on the Friday after it was published.

Criticism
While the threat of Russian manipulation of information is certainly very real,     the fact that Russian trolls are being paid to spread misinformation,       hackers are being hired to push propaganda,   and many of the sites present on the list have been known to spread it, it seems that the PropOrNot team isn’t very good at actually identifying them. As BuzzFeed's Sheera Frenkel noted, "a lot of reporters passed on this story." Its flaws are self-evident.
 * After a mere two days of The Washington Post article, Ben Norton and Glenn Greenwald of The Intercept called them out for "disgracefully"” promoting the site written by "very shady" anonymous authors for which "the credentials of this supposed group of experts are impossible to verify", leading The Washington Post to put a disclaimer on their original article about it which read:


 * Consortium News described it as a movement of “McCarthyistic smears”.
 * After a few days, many other news sites that were falsely classified as Russian propaganda picked up on the story to rant about it. One of them was CounterPunch. Renee Parsons of CounterPunch went as far as linking PropOrNot to Obama's presidency. CounterPunch also stated the link between NATO and being anti-Trump to PropOrNot, citing a page from a conspiratorial site which cries about internet censorship. On the same day, Joshua Frank reported that after a brief exchange of emails, PropOrNot agreed to remove CounterPunch from its list. but that did not exactly stop them from making a million more articles about them.

Media Bias/Fact Check
MBFC has rated PropOrNot as a 'Conspiracy/Pseudoscience' source with strong conspiracy level and mixed factual reporting. The following note is displayed on their page:

Current state
The website has gone majorly underground, the last post on their website was on March 24, 2017. Their Twitter account is still active, but has stopped posting childish tweets and now just reposts tweets from other famous people that support its movement.

Hamilton 2.0 Dashboard
Hamilton 2.0 Dashboard, a successor to Hamilton 68, is something like a resurrection of the resourcefulness of the PropOrNot. The Alliance for Securing Democracy, an initiative housed at The German Marshall Fund of the United States have been publishing since 2017, and have undoubtedly observed PropOrNot’s spectacular failure, while developing the “Hamilton 68 Dashboard".

According to The German Marshall Fund, the “dashboard” is designed to “shed light on Russian propaganda efforts on Twitter in near-real time.” The “Hamilton 68” website offers a dozen automatically-updated columns tracking “trending hashtags,” “trending topics,” “top domains,” “top URLs,” and so on.

“Our analysis is based on 600 Twitter accounts linked to Russian influence activities online,” Laura Rosenberger (a senior fellow at the alliance) and J.M. Berger (a non-resident fellow) wrote in a blog post on August 2.

The dashboard was endorsed by many other famous people on Twitter (but to a relatively less extent than PropOrNot).

Differences
After the spectacular failure of the PropOrNot list, it seems self-evident that one might stay away from certain aspects of their methodology that led to their demise. Some of the more major ones include:
 * Hamilton 68's propaganda list is a secret. Unlike PropOrNot, Hamilton 68 does not disclose the identities of the 600 Twitter accounts. The German Marshall Fund says it refuses to reveal the specific accounts in its dataset because it “prefers to focus on the behavior of the overall network rather than get dragged into hundreds of individual debates over which troll fits which role.”
 * The lack of methodological clarity (for the sake of avoiding “debates”) has already led to some misleading coverage in the media, with outlets like Business Insider reporting that “Hamilton 68 is now working to expose those trolls — as well as automated bots and human accounts — whose main use for Twitter appears to be an amplification of pro-Russia themes,” despite the fact that the website doesn’t actually reveal the names of any Twitter accounts. J.M. Berger stated that his team could have expanded the dashboard to “6,000 almost as easily, but the analysis would be less close to real-time.” Berger also emphasized that the 600 selected accounts were identified with a "98-percent confidence rate."