Actingup
Mostly Harmless
- Joined
- Feb 12, 2018
- Posts
- 1,000
Righto... I fully recognise that this might descend into yet another thread of bashing LW. But I wanted to approach this differently. I wanted to start from the point of understanding how a LW rating really compares to a rating in other categories, since we already know that LW is infamously different. It is what it is, but what is it?
So this is what I did when I was a bit bored today. I searched the database for:
1) All stories in Loving Wives in the past 12 months, listed in order of score. After ignoring the non-scored stories at the end of the listing, there were 3421 stories
2) All stories in LW for all years (46029 scored stories)
3) All stories in all categories, past 12 months (60363 scored stories)
4) All stories in all categories for all years (676525 scored stories)
Just let me pause for a moment and acknowledge those incredible numbers. Over half a million stories on this site, written by a ton of people and then all approved and managed by a very, very small team! Incredible effort.
With those stories ranked by score, I then plotted percentiiles of the scores for those four searches. For example the 50th percentile (median) of the All Categories, All Time stories was the 338,662nd story on the ranked list, and had a score of 4.41. So that's the 50th percentile. The 99th percentile for the 2024 LW stories was the 3386 th story on the list, with a score of 4.61. In other words, only 1% of LW stories in the past year have a score of more than 4.61.
I'm happy to have this method challenged and improved on. Anyway, what it gave me was a table like this:

And then graphing that out gave me this:

So what does this all mean? Firstly, what jumps out the most is that the LW score population is so markedly different to the consolidated population. We knew that already of course, but if anybody was thinking of entering a competition and choosing LW.. good luck! But the other thing is that the last 12 months is just as different again in LW, but hardly different at all in the consolidated population. This might suggest that the scoring culture in LW has become more negative over time, or that the 1-bombing is ultra-aggressive in LW (and not in the general population otherwise), or both. We probably can't disentangle those things, and we won't want to get into the details of how 1-bombing is dealt with. But what we can take out of that is that if you're an author in LW and you're trying to compare how you went with the all-time greats... don't. If you've scored over 3.75, you're over the median for the past 12 months, and that's as good as having scored a 4.06 10 years ago, or a 4.5 in another category now.
There is not necessarily any 'right' or 'wrong' here in the scoring (particularly once the sweeps pick up the 1-bombers). You could simply argue that the categories can't be compared. If you see a 'Hot' tag on a LW story, that means it's in the top 5% of LW scores. If you see it in the other categories, you might be above the 60th percentile or thereabouts. In either case, there will be some hotness involved, but the LW author had to work harder for it.
Loving Wives authors, take heart. If you're staring at a score 3 or even below for your recent masterpiece, you can see that 70% of the other authors are right there with you. If you're smugly in the 4s... enjoy it, but don't expect it next time! Or of course, ignore the whole scoring thing and just have some fun, which is mostly what we're here for, right?
As I said, I'm very happy to have improvements to my method proposed. Although I'm probably not going to repeat the process as there was some manual labour involved!
So this is what I did when I was a bit bored today. I searched the database for:
1) All stories in Loving Wives in the past 12 months, listed in order of score. After ignoring the non-scored stories at the end of the listing, there were 3421 stories
2) All stories in LW for all years (46029 scored stories)
3) All stories in all categories, past 12 months (60363 scored stories)
4) All stories in all categories for all years (676525 scored stories)
Just let me pause for a moment and acknowledge those incredible numbers. Over half a million stories on this site, written by a ton of people and then all approved and managed by a very, very small team! Incredible effort.
With those stories ranked by score, I then plotted percentiiles of the scores for those four searches. For example the 50th percentile (median) of the All Categories, All Time stories was the 338,662nd story on the ranked list, and had a score of 4.41. So that's the 50th percentile. The 99th percentile for the 2024 LW stories was the 3386 th story on the list, with a score of 4.61. In other words, only 1% of LW stories in the past year have a score of more than 4.61.
I'm happy to have this method challenged and improved on. Anyway, what it gave me was a table like this:

And then graphing that out gave me this:

So what does this all mean? Firstly, what jumps out the most is that the LW score population is so markedly different to the consolidated population. We knew that already of course, but if anybody was thinking of entering a competition and choosing LW.. good luck! But the other thing is that the last 12 months is just as different again in LW, but hardly different at all in the consolidated population. This might suggest that the scoring culture in LW has become more negative over time, or that the 1-bombing is ultra-aggressive in LW (and not in the general population otherwise), or both. We probably can't disentangle those things, and we won't want to get into the details of how 1-bombing is dealt with. But what we can take out of that is that if you're an author in LW and you're trying to compare how you went with the all-time greats... don't. If you've scored over 3.75, you're over the median for the past 12 months, and that's as good as having scored a 4.06 10 years ago, or a 4.5 in another category now.
There is not necessarily any 'right' or 'wrong' here in the scoring (particularly once the sweeps pick up the 1-bombers). You could simply argue that the categories can't be compared. If you see a 'Hot' tag on a LW story, that means it's in the top 5% of LW scores. If you see it in the other categories, you might be above the 60th percentile or thereabouts. In either case, there will be some hotness involved, but the LW author had to work harder for it.
Loving Wives authors, take heart. If you're staring at a score 3 or even below for your recent masterpiece, you can see that 70% of the other authors are right there with you. If you're smugly in the 4s... enjoy it, but don't expect it next time! Or of course, ignore the whole scoring thing and just have some fun, which is mostly what we're here for, right?
As I said, I'm very happy to have improvements to my method proposed. Although I'm probably not going to repeat the process as there was some manual labour involved!