RationalWiki:Pages by popularity

From RationalWiki
Jump to: navigation, search
Shortcut:

These logs are very imperfect, but will give you a rough idea what's up with this.

The number is the number of pageviews coming in via the /wiki form of the URL. (Other forms are not counted, e.g. diffs, in-MediaWiki redirections, etc. So some pages with a popular redirect might need to be hand-merged if you cared a lot about the count.)

  • [1] (4,941,847 bytes)
  • [2] (6,917,870 bytes)
  • [3] (5,714,253 bytes)

Raw pagehit logs[edit]

These are the month's log from squid1 concatenated with the log from squid2 (which is why the timestamp appears to restart half way through). Note: These links automatically download the file.

  • [4] (326,711,908 bytes, expands to 6,594,965,830 bytes)
  • [5] (353,310,816 bytes, expands to 7,131,549,181 bytes)
  • [6] (358,071,400 bytes, expands to 7,235,593,627 bytes)

How this was made[edit]

The shell script is:

#!/bin/bash
grep -oP "wiki\/.*" $1 | grep -v "wiki\/.*\/" | grep -v "\?" | grep -o "\/.*" | sed -e 's/%20/_/g' | sed -e "s/%27/'/g" | sed -e 's/%28/(/g' | sed -e 's/%29/)/g' | sed -e 's/%3F/?/g' | sort | uniq -c| sort -nr

Here's the first thirty lines of the pagehits log from 201510.pagehits.xz:

[01/Oct/2015:06:41:09 +0000] http://rationalwiki.org/w/index.php?title=Special:WhatLinksHere/Talk:Ozone_layer&hideredirs=1&limit=50
[01/Oct/2015:06:41:09 +0000] http://rationalwiki.org/w/index.php?title=Hermann_G%C3%B6ring&action=edit
[01/Oct/2015:06:41:10 +0000] http://rationalwiki.org/w/index.php?title=Mark_Foley&action=edit&section=1
[01/Oct/2015:06:41:10 +0000] http://rationalwiki.org/w/index.php?title=Talk:FoodBabe&redirect=no
[01/Oct/2015:06:41:10 +0000] http://rationalwiki.org/wiki/RationalWiki:Saloon_bar/Archive78
[01/Oct/2015:06:41:10 +0000] http://rationalwiki.org/wiki/Talk:Large_Hadron_Collider
[01/Oct/2015:06:41:10 +0000] http://rationalwiki.org/w/index.php?title=Red_Ice_Creations&direction=prev&oldid=1509645&printable=yes
[01/Oct/2015:06:41:11 +0000] http://rationalwiki.org/w/index.php?title=Vegetarianism&diff=599564&oldid=586988&printable=yes
[01/Oct/2015:06:41:11 +0000] http://rationalwiki.org/w/index.php?title=User_talk:Dalek&lqt_method=edit&lqt_operand=4488&oldid=679167
[01/Oct/2015:06:41:11 +0000] http://rationalwiki.org/wiki/User:LMM
[01/Oct/2015:06:41:12 +0000] http://rationalwiki.org/w/index.php?title=Alternative_cosmology&oldid=1391615&printable=yes
[01/Oct/2015:06:41:12 +0000] http://rationalwiki.org/wiki/User:LMM
[01/Oct/2015:06:41:13 +0000] http://rationalwiki.org/w/images/thumb/4/4f/Warning_icon_orange.svg/400px-Warning_icon_orange.svg.png
[01/Oct/2015:06:41:13 +0000] http://rationalwiki.org/w/index.php?title=Fun:Frog&oldid=750650
[01/Oct/2015:06:41:14 +0000] http://rationalwiki.org/w/index.php?title=Atheism&diff=1395431&oldid=904403&printable=yes
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=site&only=styles&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/wiki/RationalWiki:What_is_going_on_in_the_clogosphere%3F
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=mediawiki.legacy.commonPrint%2Cshared%7Cskins.vector&only=styles&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/index.php?title=Special:RecentChanges&feed=atom
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/api.php?inprop=protection%7Csubjectid&format=json&rvprop=content%7Cids%7Cflags%7Ctimestamp%7Cuser%7Ccomment%7Csize&prop=revisions%7Cinfo&titles=User%20talk%3AAgingHippie&rvlimit=1&action=query
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/wiki/Christian_Flag
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/images/thumb/4/4f/Warning_icon_orange.svg/400px-Warning_icon_orange.svg.png
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/images/thumb/4/4f/Warning_icon_orange.svg/400px-Warning_icon_orange.svg.png
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/extensions/UsabilityInitiative/css/combined.min.css?117
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=mediawiki.legacy.commonPrint%2Cshared%7Cskins.vector&only=styles&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/extensions/UsabilityInitiative/css/vector/jquery-ui-1.7.2.css?1.7.2y
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=startup&only=scripts&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=site&only=styles&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/load.php?debug=false&lang=en&modules=site&only=scripts&skin=vector&*
[01/Oct/2015:06:41:15 +0000] http://rationalwiki.org/w/extensions/UsabilityInitiative/js/plugins.combined.min.js?477

The aim of the script is to get only requests starting http://rationalwiki.org/wiki/ and not any other hits. The script probably needs more than a few tweaks.

If anyone feels up to setting up the code from Wikimedia Toolforge - Pageviews for RW purposes, we have pagehits logs back to late 2012 on hand.