Dim
Not sure if advertising plant?
I have been working on a project of data analysis on video game review scores. Part of the standard work flow is dealing with Outliers. Outliers are technically defined as observations made by systems different than the rest of the data. I would describe the common review process as decent but herding-instinct-y. Outliers arise when some reviewer decides to be crazy, lazy, stupid or, and here is the fun part, not a sheep. I am now trying to decide which of the following outlier detection methods detects the truth instead of the crazy. While some outliers immediately seem excessive, one of the few games I can prove was grossly miss-rated (Darwinia) has outliers very near its real worth. Do you think the outliers of games you know are extremely crazy, kind of understandable or closer to the actual worth of the game than median or Metascore?
Outliers must be outlying for both the publication and the game. [Here is the rest of the data.] I will reduce the outlyingness of a score to it's closest non-outlier. The average score shift expected for Greatest Outliers is around 3.7 times more than Most Outliers. This data is adjusted with max at 100 and min at 40 because median of all games scored is at 70 and quartiles are at 80 and 60. A difference of 30 points is half the total range.
Some games are selected often.
Median, outlier's difference from cutoffs, diff from median, times reviewed, name, publication, cutoffs. Different methods make different cutoffs.
90 -17.67 -36.6 54 xbox/rallisport-challenge-2 operation-sports -19 -19
92 -18 -37 86 xbox-360/assassins-creed-ii destructoid -19 19 -19 19
90 -16 -35 106 playstation-3/heavy-rain bigpond-gamearena -19 19 -19 19
90 -9.17 -36.6 106 playstation-3/heavy-rain metro-gamecentral -19 19 -27.5 10.5
90 -21.6 -41.6 77 xbox-360/need-for-speed-hot-pursuit gameshark -19 19 -20 18
90 -16 -35 86 xbox-360/the-witcher-2-assassins-of-kings gamer-limit -19 19 -19 19
90 -11 -30 86 xbox-360/the-witcher-2-assassins-of-kings darkstation -19 19 -19 19
90 -6.67 -31.6 92 xbox-360/halo-4 armchair-empire -20 19 -25 28
90 0 -43.3 92 xbox-360/halo-4 quarter-to-three -20 19 -43.3 30
90 -11 -30 81 xbox-360&PS3/dead-space-2 game-over-online -19 19 -18 23.333
90 -9.5 -30 83 playstation-3/demons-souls gamervision -20 19 -20.5 19
90 -16 -35 66 pc/diablo-iii armchair-empire -19 19 -19 19
53.3 16.67 38.6 31 playstation-3/tony-hawk-ride gamezone -19 19 -16 22
55.3 11.5 34.6 43 xbox-360/tony-hawk-ride planet-xbox-360 -19 19 -16 23.167
55.3 14.67 36.6 43 xbox-360/tony-hawk-ride gamingtrend -19 19 -16 22
85 -7 -34 81 xbox-360/rage gameshark -20 19 -27 24
85 -5 -25 81 xbox-360/rage darkstation -20 19 -19 19
85 -5 -25 81 xbox-360/rage gamernode -20 19 -19 19
85 -8.3 -28.3 81 xbox-360/rage gamers-hell -20 19 -19 19
Why Darwinia is so misrated. Based on letsplays. MS 84 Median 88. The game has an interesting but simple aesthetic and no gameplay. Never mind the pathfinding, though this game is pretty old and it's lets-plays are probably of the latest version. You move your guys to a spot then click on the red stuff and the guys shoot it. That is it. That is all. There is no challenge. You can not lose. There is nothing to learn or become skilled at. There is no variety. None of the publications rating it over 70 mention the complete lack of gameplay and most call it an RTS of all things. I feel like I am getting reviews from some alternate dimension or something. For comparison AE's review of Diablo3 is reasonable but the score drop is overenthusiastic. Giving The Witcher 2 a score of 55 is sheer lunacy.
Outlier detection methods from fewest to most outliers detected. The numbers next to each game are the difference from the median of the game.
**GRUBBS Highest difference**
-ds/new-super-mario-bros
playstation-3/duke-nukem-forever
-xbox-360/halo-4
-xbox/halo-2
xbox-360/army-of-two-the-devils-cartel
-xbox-360/dead-space-2
playstation-2/evil-dead-a-fistful-of-boomstick
playstation-3/start-the-party!
wii-u/game-wario
-xbox/rallisport-challenge-2
ds/spectrobes
-pc/diablo-iii
-playstation-2/final-fantasy-xii
-playstation-3/demons-souls
-xbox-360/the-witcher-2-assassins-of-kings
-pc/the-talos-principle
-playstation-3/fifa-soccer-13
**GRUBBS Most Outliers (2)**
-xbox-360/halo-4
ios/borderlands-legends vandal-online
playstation-4/submerged
-pc/escape-from-monkey-island
-ios/star-wars-knights-of-the-old-republic
-pc/fifa-15
xbox-360/facebreaker
-xbox/aggressive-inline
pc/great-invasions-the-darkages-350-1066-ad
**Medcup Highest Outliers**
34.3 playstation-4/the-amazing-spider-man-2
33.3 xbox-360/aliens-colonial-marines
-30.0 playstation-3/dead-space-2
-30.0 xbox-360/dead-space-2
-37.0 xbox-360/assassins-creed-ii
-36.7 playstation-3/heavy-rain
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-30.0 playstation-3/demons-souls
38.7 playstation-3/tony-hawk-ride
36.7 xbox-360/tony-hawk-ride
34.7 xbox-360/tony-hawk-ride
**Medcup Most Outliers (3)**
-35.2 psp/dissidia-final-fantasy
-27.3 xbox/mortal-kombat-deception
"+ - 20” xbox-360/dead-rising-2-case-zero
“+ - 20” pc/that-dragon-cancer
36.7 xbox-360/tony-hawk-ride
**Dixon Highest Outliers**
-36.7 psp/daxter
-39.0 xbox/doom-3-resurrection-of-evil
-36.0 playstation-2/grand-theft-auto-san-andreas
-37.0 xbox-360/assassins-creed-ii
-40.0 xbox/ninja-gaiden
-36.7 playstation-3/heavy-rain
-35.0 playstation-3/heavy-rain
-41.7 xbox-360/need-for-speed-hot-pursuit
-35.7 xbox/midnight-club-3-dub-edition
-35.0 pc/diablo-iii
40.0 wii/final-fantasy-crystal-chronicles-echoes-of-time
-35.0 xbox-360/the-witcher-2-assassins-of-kings
**Dixon Most Outliers (4)**
32.3 xbox-360/x-men-the-official-game
30.0 xbox-360/spider-man-3
-30.0 playstation-4/fallout-4
**IQR Highest Outliers**
40.0 playstation-4/entwined
-31.7 xbox-360/halo-4
-30.0 playstation-3/dead-space-2
-30.0 xbox-360/dead-space-2
-36.0 playstation-2/grand-theft-auto-san-andreas
-37.0 xbox-360/assassins-creed-ii
-41.7 xbox-360/need-for-speed-hot-pursuit
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-30.0 playstation-3/demons-souls
-30.0 xbox-360/the-witcher-2-assassins-of-kings
-35.0 xbox-360/the-witcher-2-assassins-of-kings
36.7 xbox-360/tony-hawk-ride
36.7 xbox-360/tony-hawk-ride
**IQR Most Outliers (4)**
-30.0 playstation-3/bayonetta
32.7 playstation-3/lair
+-27.5 wii-u/kirby-and-the-rainbow-curse
-25.0 wii-u/runbow
32.3 xbox-360/x-men-the-official-game
35.0 playstation-3/spider-man-3
30.0 xbox-360/spider-man-3
-34.0 xbox-360/rage
+-20.0 xbox-360/dead-rising-2-case-zero
-29.0 xbox-360/mafia-ii
-30.0 pc/dear-esther
-30.7 playstation-3/la-noire
-36.7 playstation-3/heavy-rain
40.0 playstation-2/driv3r
26.7 xbox-360/sonic-free-riders
36.7 xbox-360/tony-hawk-ride
**Chi-squared Highest Outliers**
40.0 playstation-4/entwined
-34.0 xbox-360/rage
-40.0 gamecube/killer7
-36.3 playstation-3/uncharted-3-drakes-deception
-37.0 xbox-360/assassins-creed-ii
-40.0 xbox/ninja-gaiden
-35.0 playstation-3/heavy-rain
-36.7 playstation-4/the-witness
-41.7 xbox-360/need-for-speed-hot-pursuit
40.0 xbox/driv3r
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-35.0 xbox-360/the-witcher-2-assassins-of-kings
**Chi-Squared Most Outliers (7)**
40.0 playstation-4/entwined
+-26.7 xbox-one/quantum-break
-34.0 xbox-360/rage
+-30.0 pc/dear-esther
-36.7 playstation-4/the-witness
-20.7 playstation-3/motorstorm-apocalypse
+-26.7 xbox-360/from-dust
Outliers must be outlying for both the publication and the game. [Here is the rest of the data.] I will reduce the outlyingness of a score to it's closest non-outlier. The average score shift expected for Greatest Outliers is around 3.7 times more than Most Outliers. This data is adjusted with max at 100 and min at 40 because median of all games scored is at 70 and quartiles are at 80 and 60. A difference of 30 points is half the total range.
Some games are selected often.
Median, outlier's difference from cutoffs, diff from median, times reviewed, name, publication, cutoffs. Different methods make different cutoffs.
90 -17.67 -36.6 54 xbox/rallisport-challenge-2 operation-sports -19 -19
92 -18 -37 86 xbox-360/assassins-creed-ii destructoid -19 19 -19 19
90 -16 -35 106 playstation-3/heavy-rain bigpond-gamearena -19 19 -19 19
90 -9.17 -36.6 106 playstation-3/heavy-rain metro-gamecentral -19 19 -27.5 10.5
90 -21.6 -41.6 77 xbox-360/need-for-speed-hot-pursuit gameshark -19 19 -20 18
90 -16 -35 86 xbox-360/the-witcher-2-assassins-of-kings gamer-limit -19 19 -19 19
90 -11 -30 86 xbox-360/the-witcher-2-assassins-of-kings darkstation -19 19 -19 19
90 -6.67 -31.6 92 xbox-360/halo-4 armchair-empire -20 19 -25 28
90 0 -43.3 92 xbox-360/halo-4 quarter-to-three -20 19 -43.3 30
90 -11 -30 81 xbox-360&PS3/dead-space-2 game-over-online -19 19 -18 23.333
90 -9.5 -30 83 playstation-3/demons-souls gamervision -20 19 -20.5 19
90 -16 -35 66 pc/diablo-iii armchair-empire -19 19 -19 19
53.3 16.67 38.6 31 playstation-3/tony-hawk-ride gamezone -19 19 -16 22
55.3 11.5 34.6 43 xbox-360/tony-hawk-ride planet-xbox-360 -19 19 -16 23.167
55.3 14.67 36.6 43 xbox-360/tony-hawk-ride gamingtrend -19 19 -16 22
85 -7 -34 81 xbox-360/rage gameshark -20 19 -27 24
85 -5 -25 81 xbox-360/rage darkstation -20 19 -19 19
85 -5 -25 81 xbox-360/rage gamernode -20 19 -19 19
85 -8.3 -28.3 81 xbox-360/rage gamers-hell -20 19 -19 19
Why Darwinia is so misrated. Based on letsplays. MS 84 Median 88. The game has an interesting but simple aesthetic and no gameplay. Never mind the pathfinding, though this game is pretty old and it's lets-plays are probably of the latest version. You move your guys to a spot then click on the red stuff and the guys shoot it. That is it. That is all. There is no challenge. You can not lose. There is nothing to learn or become skilled at. There is no variety. None of the publications rating it over 70 mention the complete lack of gameplay and most call it an RTS of all things. I feel like I am getting reviews from some alternate dimension or something. For comparison AE's review of Diablo3 is reasonable but the score drop is overenthusiastic. Giving The Witcher 2 a score of 55 is sheer lunacy.
Outlier detection methods from fewest to most outliers detected. The numbers next to each game are the difference from the median of the game.
**GRUBBS Highest difference**
-ds/new-super-mario-bros
playstation-3/duke-nukem-forever
-xbox-360/halo-4
-xbox/halo-2
xbox-360/army-of-two-the-devils-cartel
-xbox-360/dead-space-2
playstation-2/evil-dead-a-fistful-of-boomstick
playstation-3/start-the-party!
wii-u/game-wario
-xbox/rallisport-challenge-2
ds/spectrobes
-pc/diablo-iii
-playstation-2/final-fantasy-xii
-playstation-3/demons-souls
-xbox-360/the-witcher-2-assassins-of-kings
-pc/the-talos-principle
-playstation-3/fifa-soccer-13
**GRUBBS Most Outliers (2)**
-xbox-360/halo-4
ios/borderlands-legends vandal-online
playstation-4/submerged
-pc/escape-from-monkey-island
-ios/star-wars-knights-of-the-old-republic
-pc/fifa-15
xbox-360/facebreaker
-xbox/aggressive-inline
pc/great-invasions-the-darkages-350-1066-ad
**Medcup Highest Outliers**
34.3 playstation-4/the-amazing-spider-man-2
33.3 xbox-360/aliens-colonial-marines
-30.0 playstation-3/dead-space-2
-30.0 xbox-360/dead-space-2
-37.0 xbox-360/assassins-creed-ii
-36.7 playstation-3/heavy-rain
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-30.0 playstation-3/demons-souls
38.7 playstation-3/tony-hawk-ride
36.7 xbox-360/tony-hawk-ride
34.7 xbox-360/tony-hawk-ride
**Medcup Most Outliers (3)**
-35.2 psp/dissidia-final-fantasy
-27.3 xbox/mortal-kombat-deception
"+ - 20” xbox-360/dead-rising-2-case-zero
“+ - 20” pc/that-dragon-cancer
36.7 xbox-360/tony-hawk-ride
**Dixon Highest Outliers**
-36.7 psp/daxter
-39.0 xbox/doom-3-resurrection-of-evil
-36.0 playstation-2/grand-theft-auto-san-andreas
-37.0 xbox-360/assassins-creed-ii
-40.0 xbox/ninja-gaiden
-36.7 playstation-3/heavy-rain
-35.0 playstation-3/heavy-rain
-41.7 xbox-360/need-for-speed-hot-pursuit
-35.7 xbox/midnight-club-3-dub-edition
-35.0 pc/diablo-iii
40.0 wii/final-fantasy-crystal-chronicles-echoes-of-time
-35.0 xbox-360/the-witcher-2-assassins-of-kings
**Dixon Most Outliers (4)**
32.3 xbox-360/x-men-the-official-game
30.0 xbox-360/spider-man-3
-30.0 playstation-4/fallout-4
**IQR Highest Outliers**
40.0 playstation-4/entwined
-31.7 xbox-360/halo-4
-30.0 playstation-3/dead-space-2
-30.0 xbox-360/dead-space-2
-36.0 playstation-2/grand-theft-auto-san-andreas
-37.0 xbox-360/assassins-creed-ii
-41.7 xbox-360/need-for-speed-hot-pursuit
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-30.0 playstation-3/demons-souls
-30.0 xbox-360/the-witcher-2-assassins-of-kings
-35.0 xbox-360/the-witcher-2-assassins-of-kings
36.7 xbox-360/tony-hawk-ride
36.7 xbox-360/tony-hawk-ride
**IQR Most Outliers (4)**
-30.0 playstation-3/bayonetta
32.7 playstation-3/lair
+-27.5 wii-u/kirby-and-the-rainbow-curse
-25.0 wii-u/runbow
32.3 xbox-360/x-men-the-official-game
35.0 playstation-3/spider-man-3
30.0 xbox-360/spider-man-3
-34.0 xbox-360/rage
+-20.0 xbox-360/dead-rising-2-case-zero
-29.0 xbox-360/mafia-ii
-30.0 pc/dear-esther
-30.7 playstation-3/la-noire
-36.7 playstation-3/heavy-rain
40.0 playstation-2/driv3r
26.7 xbox-360/sonic-free-riders
36.7 xbox-360/tony-hawk-ride
**Chi-squared Highest Outliers**
40.0 playstation-4/entwined
-34.0 xbox-360/rage
-40.0 gamecube/killer7
-36.3 playstation-3/uncharted-3-drakes-deception
-37.0 xbox-360/assassins-creed-ii
-40.0 xbox/ninja-gaiden
-35.0 playstation-3/heavy-rain
-36.7 playstation-4/the-witness
-41.7 xbox-360/need-for-speed-hot-pursuit
40.0 xbox/driv3r
-36.7 xbox/rallisport-challenge-2
-35.0 pc/diablo-iii
-35.0 xbox-360/the-witcher-2-assassins-of-kings
**Chi-Squared Most Outliers (7)**
40.0 playstation-4/entwined
+-26.7 xbox-one/quantum-break
-34.0 xbox-360/rage
+-30.0 pc/dear-esther
-36.7 playstation-4/the-witness
-20.7 playstation-3/motorstorm-apocalypse
+-26.7 xbox-360/from-dust
Last edited:
