By Walter Broeckx and Tony Attwood
(Note: the gathering of data and interpretation of it is by Walter. The commentary on sampling techniques is by Tony)
This article is part of the series of the Referee Review 2013. You can find links to earlier articles on the bottom of this article.
On this site we have published all kinds of reports over the season 2012-2013.
We have dealt with the different teams. We have looked more closely at the refs themselves leading to the best ref election of the season according to the views and based on the numbers found by our referee reviewers.
We then had another look at the bias from the refs for and against each individual team.
The next step was to look at the four most important decisions on the football field that could have the biggest impact on the final result of games.
These are the “important decisions” as we call them. Decisions that can change games. And it is important to see how many decisions teams suffered in the games we reviewed. This will bring some extra light on the famous saying that it evens all out at the end of the season.
For some it might but shouldn’t it even out for all at the end of the season? Because if even for one team it doesn’t even out at the end… the playing field was not level. As it should be level for all!
So in an earlier article we have taken all the previous important decisions and put them in total tables. We made no difference any more for the type of decisions. Because they all are the most important decisions. Decisions that can change games and results.
That final table could be somewhat comparable with the debatable decisions website that was active for a while. But our table should be called: The Wrong Decisions Table.
Now someone said that this didn’t tell the whole picture and they are right in a way. As we couldn’t do all the games you might see some things that might have looked differently if we had done all the games. Although it should be pointed out that no analysis ever covers every example.
Sampling is a fundamental approach to analysing all human behaviour – no one had to examine the entire white population of the United States in 2006 to establish that 22.3% of whites had blue eyes. They did samples which took into account age, location, sex, nutrition etc and matched that to the national population. Such surveys can be undertaken by interviewing maybe just 500 people. To check that the result is correct a totally separate survey conducted by a totally different team using different samples could be undertaken. If it comes up with the same answer there is a very strong chance the answer is right.
Likewise the medical authorities in England did not have to administer ibuprofen to every living person in England before deciding that products containing ibuprofen should be available to buy without prescription from a GP. They did a wide range of animal studies, then tests on a small number of volunteers. In short even on vital matters relating to health sampling is the process that is used.
Thus the notion that we should have examined every game in order to get any insight into referee decisions goes against all the normal procedures of estimating human behaviour. It is suggested often by disbelievers on this site, but it has no place in sampling technique. If we only looked at one match per referee the argument could be put that the sample was not big enough, but given the level of sampling that we have undertaken, this does not apply.
What we can do is take the trend from the matches we have done and multiplied that with 38 games and then divided that by the number of games we actually reviewed.
But for the benefit of the readers who still feel that no sample is good enough unless it covers a huge number of examples, in the table I am about to show you I have highlighted the teams that we didn’t do 50% of their games in yellow. In any other survey 50% would be considered more than enough to get a fair resultant figure, but I don’t want to talk about those teams as we don’t want to be distracted by talk about sampling. I put them in to be complete, and because most people will find that acceptable, but for those who worry then are not considered in the overall total.
So remember before reading this that this is an extrapolation exercise and is not based on actual numbers from reviews. It is the table if we would extrapolate the numbers we have found in our reviews to 38 games for each team:
We do see that Arsenal is still in top position when it comes to suffering from important decisions. That is the only number that has stayed unchanged from the previous articles as we did all Arsenal matches in our review last season.
What does change is that both clubs from Liverpool also seem to suffer a lot. Again one has to be careful about it but they surely weren’t on the good side of things.
Manchester City only had a small amount of wrong decisions going against them.
Chelsea on the other hand was on the positive side of things if we look at the numbers like we did in this article.
Tottenham is a team that could have enjoyed 9 important decisions if we look at the numbers over 38 matches. And the same could be said of Sunderland, although if you are concerned about numbers you might like to note that we did 50% of their games.
If we would have done all 38 matches from Manchester United we might have seen them being given 18 big and important decisions in their favour.
From this we can see that there is a difference of 38 important decisions between Arsenal and Manchester United. And that would be one possible defining moment each game of the season between those clubs. 38 decisions difference in the important decisions over 38 matches in a season. Now surely that would have a big impact on the points total of any team.
In this series
The earlier series of reviews:
- 1. Who reviewed the games
- 2. What we did and what next
- 3. All the decisions in numbers
- 4. The first, at times astonishing, numbers
- 5. Home and away bias
- 6. It all evens out in the end – Wigan last season
- 7. West Ham: Life with a positive bias
- 8. West Brom and the Referees
- 9. Tottenham, penalties and some amusing comments
- 10. Swansea City and a change this year
- 11. Sunderland, a positive bias
- 12. Stoke, where refereeing is different.
- 13. Southampton – how did they ever survive?
- 14. QPR – a strange case
- 15. Norwich – more errors than acceptable
- 16. Newcastle United – again, more errors than there should be.
- 17. Manchester United: 70% of wrong decisions in their favour.
- 18. Manchester City: unlike their neighbours a very small bias.
- 19: Liverpool: you should blame the refs
- 20: Fulham – it all evens out in the end
- 21: Everton: a slight bias in favour
- 22: Chelsea: an occasional bias against
- 23: Aston Villa: a huge bias in favour
- 24: Refs give opposition freedom to kick Arsenal off the park.
- 25. The complete league bias table
- 26. Untold has said it for a long while, others follow
- 27. Andre Marriner; a good ref but 10% of his goal decisions are wrong!
- 28: Anthony Taylor: Disastrous when it comes to penalties
- 29. Chris Foy: Very bad on cards and fouls
- 30. Howard Webb, an amazing score
- 31: Jonathon Moss: Over 90% right.
- 32: Lee Mason, the ref with penalty area fever
- 33: Kevin Friend: the red card disaster
- 34: Lee Probert: This is not acceptable
- 35: Mark Clattenburg: good on red, poor on yellow
- 36: Mark Halsey: under half his penalty decisions were correct
- 37: Martin Atkinson. This is not a Fifa ref
- 38: Michael Jones: Poor discipline
- 39: Michael Oliver: This doesn’t look too clever
- 40: Mike Dean – an unacceptable bias.
- 41: Neil Swarbrick. Every goal right but oh the bias
- 42: Phil Dowd: After a good year, a year in decline
- 43: Roger East a short term solution
- 44: The Referee Competency League Table
- 45. The most unbiased referee in the PL
- 46 The best ref of the season 2012/13
- 47. Wigan and the bias of the ref
- 48. West Ham and the bias of the refs
- 49. WBA and the bias of the refs
- 50. Tottenham Hotspur and the bias of the refs
- 51. Swansea and the bias of the refs
- 52. Sunderland and the bias of the refs
- 53. Stoke: Three unbiased refs
- 54: Southampton, an extraordinary mix
- 55: Reading, which two refs helped them the most?
- 56. QPR and the bias of the refs
- 57. Norwich and the bias of the refs
- 58. Newcastle and the bias of the refs
- 59. Manchester United and the bias of the refs
- 60. Manchester City and the bias of the refs
- 61. Liverpool and the bias of the refs
- 62. Fulham and the bias of the refs
- 63. Everton and the bias of the refs
- 64. Chelsea and the bias of the refs
- 65. Aston Villa and the bias of the refs
- 66: Arsenal – and the total bias of the refs