AFL Prediction & Analysis

List Changes

Posted on

Three new models join the Squiggle comp:

And retiring this year is The Flag.

That makes 26 models (plus Punters). Which is, you know, quite a lot of models.

Edit (14-Mar-2024): Wait! There’s a late entry! So that makes 27.

Ladder Predictor 2024 is Online

Posted on

Every year, the AFL unexpectedly releases the fixture on the first day of my holidays. Then thirty seconds later people start messaging to ask when I’m updating the site.

This year, I was in line to board my plane at Melbourne Airport. I’m about to attempt to run a half-marathon up Mt. Wellington in Hobart, by the way, so if I don’t make it back, that’s what happened.

Anyway, Squiggle is now updated for 2024, except for all the things that immediately broke because of Round 0. It will take a while until I get home and take a look at why the in-house model apparently thinks Fremantle are red-hot for next year, and whether that’s legit. I don’t think it’s super urgent because although this model has an outstanding track record, that’s based on final preseason predictions, made once we have info on off-season injuries as well as practice matches, which can change the numbers a lot.

But we have 2024 games up the top, we’re collecting 2024 tips & predictions from models, and you can use the ladder predictor, so, you know, priorities.

2024 Squiggle Ladder Predictor

Preparing to 0pen 2024

Posted on

You can’t tell, but the first character of “0pen” above is a zero. Because the AFL realized that when everyone wants different things in the first round, it’s easier to accomodate them if you have two first rounds.

So Round 1, 2024 will be the 2nd round. And the first round, if you have to give it a number, will be 0.

That’s problematic for people like me, because I do have to give rounds numbers, and Round 0 is how I’ve always designated ratings and predictions generated prior to the start of a season. So now I have to choose:

  1. Stick to the same numbering scheme, so “1” still means the first round, and “2” the second, etc. This would be ridiculous, because no matter how careful we all are, it will be endlessly confusing for “2” to mean “Round 1.”
  2. Change the numbering scheme, so that “0” means “Opening Round,” and “-1” is pre-season. (Also, in some contexts, change “0” from meaning “no round in particular, give me all the data you have.”) This is also terrible, because that’s not how it’s worked before, and will break some existing third-party apps that rely on the Squiggle API, of which there are quite a lot.

Nevertheless, #2 is less stupid than #1. So I think that’s what I have to do.

2023 Results

Posted on

Since Twitter has begun sliding into the sea and can’t be relied on to exist in the future.

Full leaderboard

🏆 Overall champion: @EloPredicts (156 tips)

Runner-up: @thecruncherau (154 tips)

🏆 Bits champion: @AflGlicko (35.76 bits)

Runner-up: @MatterOfStats (33.24)

🏆 MAE champion: @AflGlicko (24.91)

Runner-up: @MatterOfStats (25.09)

The s10 index for 2024, i.e. this year’s top 10 performing models by MAE:

@AflGlicko and @GRAFTRatings re-enter the index, @MatterOfStats & the Squiggle in-house model make it 7 in a row, and @AflLadder misses for the first time since joining in 2018.

A Review of Preseason Ladder Predictions (2023)

Posted on

For the fifth consecutive year, Squiggle carefully recorded all public preseason ladder predictions made by experts and media pundits, and scored how accurate those predictions turned out to be.

Not all well-known media names do preseason ladder predictions. In fact, only a minority seem willing to put their name to an actual ladder, as opposed to safer, more vague statements about which teams might rise or fall. This year, we found fifty of them. All should be applauded. But also scored.

Every 2023 Expert Ladder Prediction Rated

Since this is the fifth year, we’ve built a reasonable idea of how reliable people tend to be in the long-term; that is, whether a great prediction this year means that person is likely to come back with another the year after. But before we get to that, here’s how 2023 shook out:

Best ladder: (Tie) Johnathon Horn (The Guardian) & Jon Pierik (The Age)

Horn led for most of the back end of the year, thanks to his faith in Collingwood and Port Adelaide. But Pierik closed in the final round with a ladder that correctly tipped 6 out of 8 finalists, and placed eight teams within a rung of their actual position. There might have been a fair bit of luck, given the closeness of the middle of the pack, and how easily it might have been different. But it was a great ladder. The rating system judges them different but equally good, so Horn and Pierik share the honours.

Best ladder by a model: Squiggle

It was a poor year for models, who went very heavy on Geelong and underestimated Collingwood. None made the top 10, while many fell to the bottom half of the 50 predictions. The best was Squiggle’s own in-house model, which was ranked 14th.

The betting odds weren’t a great guide, either, with an aggregate of where punters were putting their money landing 25th, right in the middle.

Worst ladder: 2022 + Pythagorus

To be fair, this wasn’t Max Laughton’s own prediction (which is ranked 30th). It was, instead, a completely reasonable application of Pythagorean wins to adjust what the 2022 ladder “should” have looked like. But since it was supposed to tell us what the ladder would look like in 2023, too, I included it. And it did badly: worse, in fact, than if no adjustment was performed at all, and we guessed that this year’s ladder would look the same as last year’s.

With only half the Top 8 correct, no team in the exact right spot, and five teams out by at least 8 rungs, it ties with Damien Barrett’s 2019 entry as the worst ladder prediction we’ve recorded.

Long-Term Performance Award

Last year, we lauded Peter Ryan, who over four years maintained an average rank of 8th, including topping the list in 2022. Unfortunately, Ryan had a shocker this year, finishing near the bottom, mostly because of a failure of optimism in Port Adelaide, Carlton, GWS, and St Kilda.

The best long-term performers, counting everyone who made a prediction in at least 3 of the last 5 years, are:

Average RankExpert
10.8Squiggle
14.6Sam McClure (The Age)
15.4Peter Ryan (The Age)
15.6Jake Niall (The Age)
16.0Riley Beveridge (AFL Media)
16.0Nat Edwards (AFL Media)
16.3Sarah Olle (AFL Media)
16.3Daniel Cherney (The Age)
17.0Michael Gleeson (Code Sports)
18.2Jon Pierik (The Age)

Each year there are about 50 expert predictions, so it’s challenging to remain even in the top half on a long-term basis. Or, put another way, ladder predictions seem to be a bit of a crapshoot, with not much evidence that someone who made a good prediction this year will be able to do it again next year.

However…

Squiggle is, frankly, killing it here, outperforming the whole football industry by a significant margin over the tracked period. You can judge for yourself whether this is due to the brilliance of the Squiggle algorithm or the awfulness of the average media ladder prediction. And, to be sure, a big reason for this project was the suspicion that a lot of ladder predictions got tossed around each year by people who didn’t expect anyone to look at them again after March.

Live Running Predictions

Squiggle also tracks ladder predictions made throughout the year by various models, including our own. This year, Squiggle narrowly beat out Glicko Ratings, Matter of Stats, Wheelo Ratings, and AFLalytics.

Fixture Analysis 2022

Posted on

First, the headlines: Geelong had the easiest fixture, GWS the hardest. But before we go any further, an important disclaimer: the Cats were so comfortably in far of everyone else, not even the league’s hardest fixture would have kept them from the minor premiership.

Home advantage is important, but not that important. If home advantage was as important as people say, all the left-column circles would be green and all the right ones would be red:

Games Won & Lost in 2022 (incl finals)

With Significant Home AdvantageNeutral-ishWith Significant Away Disadvantage
1
GeelongWWWWLWWWWWWWWWWWWWLLWWWWL
2
SydneyLWWWWWLWWWWWWWWLWLLWLWWWL
3
BrisbaneWWWLLWWWWWWWWLWWLWLWWWLLL
4
CollingwoodWLWWWWLWWWWWLLWWWWLLLWWWL
5
FremantleLWWLWLLWWWWWWWLLWWWDLWWW
6
MelbourneWLLLWLWLWWWWLLWWWWWWLWWW
7
RichmondWWWWDWWWLWWLWLLWLLLWLWL
8
BulldogsWLWWLLWWLWWWLWWWLLWLLLL
9
CarltonWWWWLWWLWLWWWLLLWLWLLL
10
St KildaWLLLWLLWLWWWLLWLWLWWLW
11
Port AdelaideLLWWWWLWWLWLWLLLLLLWLW
12
Gold CoastLLWWWLWWLWWLLLLLLWLLWW
13
HawthornWWWWLWWLLLLLLLLLLLWLWL
14
AdelaideLLLLWLWLWWWLLLLWWLLLLW
15
EssendonWWWLLLLWWLLLLLLLWLLLLW
16
GWSLLLLLLWWWWLLLLLLLLWWLL
17
West CoastLLLLWLLLLLLLLWLLLLLLLL
18
North MelbourneLLLLLWLLLLLLLLWLLLLLLL

There is a bias there – home advantage is worth something – but it’s not a guaranteed ride to the Top Eight, or even a single extra win. You still actually have to be a good team.

(In the above table, “Significant Home Advantage” means games between interstate teams at a home ground, Geelong playing anyone at Kardinia Park, and Hawthorn or North dragging anyone off to Tassie.)

Of course, there are different degrees of home advantage. In Round 19 alone, we had:

  • West Coast vs St Kilda @ Perth Stadium (WA) – an interstate game with fervent crowd support for the home team – that’s about as extreme a case as you’ll find, and good for 13.3 pts, by Squiggle’s model, which is generally calibrated to the level of crowd support
  • Carlton vs GWS @ Docklands (Victoria) – an interstate game with good home crowd support, at a venue frequented fairly often by the away team – that’s 7.9 pts
  • Brisbane vs Gold Coast @ the Gabba (Queensland) – two teams with smaller fan bases from the same state at one’s home ground – 2.8 pts
  • Collingwood vs Essendon @ MCG (Victoria) – an extremely well-supported team hosts a very well-supported team at the Magpies’ home ground – 2.6 pts
  • North Melbourne vs Hawthorn @ Bellerive Oval (Tasmania) – two teams in their secondary state, at a ground more often played by the Kangaroos – 2.0 pts

There’s a real hodge-podge of scenarios, which over the season shake out a bit like this:

Don’t stare at that too long, though; there’s not much to be gleaned from it. The Squiggle model considers Collingwood and Richmond to enjoy many games of mild home advantage, by virtue of their large crowds at MCG games. The South Australian & West Australian teams usually have 10 games of extreme home advantage but fewer games of extreme disadvantage, as they revisit the same venues repeatedly (especially Docklands). NSW and Queensland teams essentially never create the same level of home advantage as the rest of the league, due to their lack of fan-filled cauldrons. And the Cats have a cauldron as well as warm fan support at many of their away games, which is a pretty handy setup.

Let’s now throw in Opposition Strength, because that’s the other big piece of the puzzle. As you know, each year the AFL carefully divides the previous year’s ladder into blocks of 6 teams, and assigns double-up games based on an equalisation strategy, so that weaker teams receive gentler match-ups.

Ha ha! We know that never works, since it only takes a couple of teams to shoot up or down the ladder to throw the whole thing out. But it may never have worked worse than this year, with Geelong, the eventual premier (and last year’s preliminary finalist) receiving quite gentle double-up games, while back-to-back wooden spooners North Melbourne faced a much sterner test. To some extent, this happens because teams can’t play themselves – you can’t fixture the wooden spooner against the wooden spooner – but still, things have not gone well when the premier has double-up games against the bottom 2 teams (representing 4 wins combined), while the bottom team faces both Grand Finalists, who have 34 wins.

Overall, Adelaide did well out of the 2022 fixture – which, as a bottom-6 team, was at least to plan. Gold Coast, also lowly ranked in 2021, received a terrific set of double-up games, but lost it all to home advantage, as they hosted interstate teams at Carrara only 8 times while flying out 10 times themselves – and not just to familiar Docklands; the Suns were dispatched to every state plus the Northern Territory (twice), and even country Victoria.

St Kilda had terrible everything, as usual; St Kilda always have a terrible fixture, to the point where I’m starting to think it must be written into the AFL constitution. They hosted just 4 interstate teams (at Docklands, which their opponents visit often) while taking 6 interstate trips, including two to Perth, plus a bus to Kardinia. Their five double-up games – which should have been mild, as a middle-6 team – included both Grand Finalists, a Preliminary Finalist, and a Semi-Finalist. This combination of bad luck and bad design is very St Kilda, as was the Round 7 home game the Saints sold to play in Cairns and subsequently lost by a single point: a rare sighting of the case where a team’s unfair fixture really did cost them the match.

GWS also had four finalists in its five double-up games, and its fifth opponent was Carlton, who missed finals by a point. That’s enough for the Giants to take the booby prize for the worst set of match-ups.

Geelong’s bounty, while appreciated, I’m sure, was mostly wasted, since they finished two wins and percentage clear on top of the ladder, and were decidedly the best team in finals as well as the second half of the year in general (after Melbourne’s slide). It’s unlikely their fixture affected anything, and the Cats almost had a case for being dudded, escaping by 3 points against the Tigers in a home game played at the MCG, and by a goal against Collingwood in a home final at the same venue.

The 2023 AFL fixture will be released in the near future, and I have some thoughts. Chief among them: We are not actually achieving much equalization when we focus on the 6-6-6 system – which is obviously flawed and often produces the opposite effect – while ignoring systemic, completely predictable imbalances, such as:

  • Poor teams sell home games.
  • Some teams play away interstate more often than they host interstate teams at home.
  • Some teams have many more games at the Grand Final ground – which doesn’t matter if you don’t make it, but can matter quite a lot if you do.
  • Teams with smaller fan bases generate less home advantage.
  • Geelong generate more home advantage playing any Melbourne-based team at Kardinia Park than they give away in the reverse match-up.
  • Some teams have home games shifted to their opponents’ home ground.

To be fair, the fixture-makers do seem to be aware of most of the above, and I think they make some effort to avoid any of them becoming too egregious. But the priority is clearly the double-up games, which is the least predictable part of the equation. The result is that Docklands teams – especially St Kilda! – are almost guaranteed a bottom-4 fixture every year.

And maybe we can’t fix that; maybe the world isn’t ready for a fixture that provides kinder fixtures to poor teams with smaller fan bases. But it should be part of the conversation. Today, any talk of fixture fairness quickly shifts to how many times each team should play each other, and stops there, as if that’s the whole problem. It’s not: a 17-round fixture (or 34 rounds) won’t stop teams selling games, or being shifted to the MCG to face Richmond and Collingwood, or being sent to country Victoria; or, for that matter, being lucky enough to play a team when they have a bunch of outs versus when they don’t.

It’s a grab-bag of factors, and there’s no way to smooth them all out. Teams will inevitably have good fixtures and bad fixtures. But we can do better if we don’t rest the whole thing on 6-6-6 and the clearly wrong assumption that next year’s ladder will look just the same as today’s.