Go Back   Literotica Discussion Board > Main Literotica Forums > Authors' Hangout

Reply
 
Thread Tools

Old 11-29-2017, 03:39 PM   #1
LoquiSordidaAdMe
Really Really Experienced
 
LoquiSordidaAdMe's Avatar
 
LoquiSordidaAdMe is offline
Join Date: Aug 2017
Location: Washington, DC
Posts: 471
Star Rating Breakdowns

Is there a way to see how many of each star-rating a story gets? Like how many 1-star votes, how many 2-star votes, etc. for a particular story?

I've been mildly curious about this for a while, and every so often I'll look around to see if I can find this kind of data, but if it's out there, I can't find it.

I know I shouldn't obsess about star-ratings, or favorite-numbers, or things like that and I should just write stories that make me happy. But I'm a bit of a data nerd, and I'd get a kick out of tracking my stories in a spreadsheet and comparing them.

So does anyone know how I can get that data, or if it's even available?
__________________
My latest story:
Time to Breathe (Sci-Fi; 6 pages)
Low on air. Far from aid. How do you spend your final hours?
Proudly part of the 2018 Geek Pride Day Anthology

The rest of my prosaic little stroke stories
  Reply With Quote

Old 11-29-2017, 03:41 PM   #2
sr71plt
Literotica Guru
 
sr71plt's Avatar
 
sr71plt is offline
Join Date: Jul 2006
Location: Mid-Atlantic, USA
Posts: 51,756
Not that I've heard of.
__________________
______________________
  Reply With Quote

Old 11-29-2017, 03:42 PM   #3
Bramblethorn
Mallory Heart Surgeon.
 
Bramblethorn's Avatar
 
Bramblethorn is offline
Join Date: Feb 2012
Posts: 7,609
Quote:
Originally Posted by LoquiSordidaAdMe View Post
Is there a way to see how many of each star-rating a story gets? Like how many 1-star votes, how many 2-star votes, etc. for a particular story?

I've been mildly curious about this for a while, and every so often I'll look around to see if I can find this kind of data, but if it's out there, I can't find it.

I know I shouldn't obsess about star-ratings, or favorite-numbers, or things like that and I should just write stories that make me happy. But I'm a bit of a data nerd, and I'd get a kick out of tracking my stories in a spreadsheet and comparing them.

So does anyone know how I can get that data, or if it's even available?
Only way that I'm aware of is to track scores and vote counts and then deduce the ratings from that. (New score)*(New # votes) - (Old score)*(Old # votes) = total of new votes.
  Reply With Quote

Old 11-29-2017, 03:51 PM   #4
oggbashan
Ancient writer
 
oggbashan's Avatar
 
oggbashan is offline
Join Date: Jul 2002
Location: Facing the sea.
Posts: 39,597
Quote:
Originally Posted by Bramblethorn View Post
Only way that I'm aware of is to track scores and vote counts and then deduce the ratings from that. (New score)*(New # votes) - (Old score)*(Old # votes) = total of new votes.
And watch your ratings constantly. With a new story that can mean every five minutes.
__________________


Nude Day 2018 Story:

https://www.literotica.com/s/naked-corpse

Oggbashan's long list of stories
Jeanne D'Artois' few


electricblue66:
It's like [oggbashan] is writing for the third puffin over there by the sixth rock, when everyone else is an emperor penguin in the Antarctic, where there's tens of thousands of the bastards.

  Reply With Quote

Old 11-29-2017, 04:49 PM   #5
NotWise
Snipe hunter
 
NotWise's Avatar
 
NotWise is offline
Join Date: Sep 2015
Location: On the high desert
Posts: 4,452
Quote:
Originally Posted by Bramblethorn View Post
Only way that I'm aware of is to track scores and vote counts and then deduce the ratings from that. (New score)*(New # votes) - (Old score)*(Old # votes) = total of new votes.
And of course (New # votes)-(Old # votes)=number of readers voting. If that number isn't 1 then the results may be ambiguous.

If the roundoff is handled correctly then the results are good up to 50 votes cast. Above that, the potential for error increases and above 170 votes cast the chance that your result is wrong exceeds the chance that it's right. I usually find that the upper limit of reliability is a little under 100 votes cast.

Even with all the limitations, you can see the patterns.
__________________
My stories

My personal favorites are The Third Ring and Oscar's Place.
My Valentines Day contest entry was Her Bodyguard (and his Dirty Valentine). It's a little brother/sister love story.
My most recent story is The Third Ring -- Tamsin of Sky Village, a story inspired by the legendary character of Yellow Woman.
I was seduced by two dead flappers, so next up is a ghost story named "Love is Enough."
  Reply With Quote

Old 11-29-2017, 04:54 PM   #6
sr71plt
Literotica Guru
 
sr71plt's Avatar
 
sr71plt is offline
Join Date: Jul 2006
Location: Mid-Atlantic, USA
Posts: 51,756
And then the Web site sweeps come along and delete votes of unknown rating.
__________________
______________________
  Reply With Quote

Old 11-29-2017, 05:01 PM   #7
ChloeTzang
Literotica Guru
 
ChloeTzang's Avatar
 
ChloeTzang is offline
Join Date: Apr 2015
Location: Nope, ain't telling..., USA
Posts: 3,983
Quote:
Originally Posted by NotWise View Post
And of course (New # votes)-(Old # votes)=number of readers voting. If that number isn't 1 then the results may be ambiguous.

If the roundoff is handled correctly then the results are good up to 50 votes cast. Above that, the potential for error increases and above 170 votes cast the chance that your result is wrong exceeds the chance that it's right. I usually find that the upper limit of reliability is a little under 100 votes cast.

Even with all the limitations, you can see the patterns.
And usually after that first couple of days the rating won't move much so if you want to track it, check every few minutes for the first couple of days. It's a very manual process. Been there done that.
__________________
Chloe Tzang
And live now for the Siren's Song event - "Chinese Eyes" - Surf, sand, sea and... a sweet Chinese-American girl in Oz

All of Chloe Tzang's stories can be found here
Chloe supports our Veterans by drinking Black Rifle Coffee
Aaaaand... Chloe's first actual published short story ("Blood Sacrifice") now available on Amazon as part of the Sex and Sorcery 4 anthology
And Chloe's first novel, "Mistaken Identity", is also now available (on that website that sells books)
  Reply With Quote

Old 11-29-2017, 05:15 PM   #8
SimonDoom
Literotica Guru
 
SimonDoom is offline
Join Date: Apr 2015
Location: USA
Posts: 1,873
While you can't know the exact composition of the votes your story has received, you can figure out, for a particular score over 4.0, what the minimum number of 5s is that you received. See this article by Carlus Magnus: https://www.literotica.com/s/how-to-analyze-your-scores.
__________________
My stories are at https://www.literotica.com/stories/m...ge=submissions.
  Reply With Quote

Old 11-29-2017, 08:06 PM   #9
LoquiSordidaAdMe
Really Really Experienced
 
LoquiSordidaAdMe's Avatar
 
LoquiSordidaAdMe is offline
Join Date: Aug 2017
Location: Washington, DC
Posts: 471
Quote:
Originally Posted by SimonDoom View Post
While you can't know the exact composition of the votes your story has received, you can figure out, for a particular score over 4.0, what the minimum number of 5s is that you received. See this article by Carlus Magnus: https://www.literotica.com/s/how-to-analyze-your-scores.
That was a great article! Thanks SD! I can have lots of fun building a spreadsheet with those formulas. It looks like I can't have the data I want, but at least I can calculate a uniform comparison between stories with very different vote numbers without having to check a new story every five minutes.

Thanks to everyone who offered advice and ideas.
__________________
My latest story:
Time to Breathe (Sci-Fi; 6 pages)
Low on air. Far from aid. How do you spend your final hours?
Proudly part of the 2018 Geek Pride Day Anthology

The rest of my prosaic little stroke stories
  Reply With Quote

Old 11-30-2017, 03:28 AM   #10
Bramblethorn
Mallory Heart Surgeon.
 
Bramblethorn's Avatar
 
Bramblethorn is offline
Join Date: Feb 2012
Posts: 7,609
Quote:
Originally Posted by NotWise View Post
And of course (New # votes)-(Old # votes)=number of readers voting. If that number isn't 1 then the results may be ambiguous.

If the roundoff is handled correctly then the results are good up to 50 votes cast. Above that, the potential for error increases and above 170 votes cast the chance that your result is wrong exceeds the chance that it's right. I usually find that the upper limit of reliability is a little under 100 votes cast.
50 votes? You should always be able to get the exact total up to 100 votes cast, and sometimes for higher counts up to 199 votes. At 100 votes, each star makes a difference of exactly 0.01 on your rating, which is too large to get lost in rounding.

If anybody wants to build a spreadsheet: for a story with N votes and a rounded score of S, the minimum possible number of stars is roundup((S-0.005)*N) and the maximum is rounddown((S+0.00499999)*N).

Quote:
Originally Posted by sr71plt View Post
And then the Web site sweeps come along and delete votes of unknown rating.
Indeed, though sometimes you can use the same arithmetic to figure out what got swept.
  Reply With Quote

Old 11-30-2017, 03:48 AM   #11
KindofHere
Literotica Guru
 
KindofHere is offline
Join Date: Nov 2016
Location: Wherever Mistakes Are Made
Posts: 793
...............

Last edited by KindofHere : 01-25-2018 at 07:07 PM.
  Reply With Quote

Old 11-30-2017, 02:25 PM   #12
Kojak01
Really Experienced
 
Kojak01 is offline
Join Date: Dec 2016
Posts: 132
Quote:
Originally Posted by LoquiSordidaAdMe View Post
Is there a way to see how many of each star-rating a story gets? Like how many 1-star votes, how many 2-star votes, etc. for a particular story?

I've been mildly curious about this for a while, and every so often I'll look around to see if I can find this kind of data, but if it's out there, I can't find it.

I know I shouldn't obsess about star-ratings, or favorite-numbers, or things like that and I should just write stories that make me happy. But I'm a bit of a data nerd, and I'd get a kick out of tracking my stories in a spreadsheet and comparing them.

So does anyone know how I can get that data, or if it's even available?
I'd love to have that!

A simple bar chart.
  Reply With Quote

Old 11-30-2017, 03:26 PM   #13
NotWise
Snipe hunter
 
NotWise's Avatar
 
NotWise is offline
Join Date: Sep 2015
Location: On the high desert
Posts: 4,452
Quote:
Originally Posted by Bramblethorn View Post
50 votes? You should always be able to get the exact total up to 100 votes cast, and sometimes for higher counts up to 199 votes. At 100 votes, each star makes a difference of exactly 0.01 on your rating, which is too large to get lost in rounding.

If anybody wants to build a spreadsheet: for a story with N votes and a rounded score of S, the minimum possible number of stars is roundup((S-0.005)*N) and the maximum is rounddown((S+0.00499999)*N).



Indeed, though sometimes you can use the same arithmetic to figure out what got swept.
The uncertainty in a single value rounded to 1/100th is +/- 0.005. When you perform an operation using two such rounded numbers (as you do when you calculate the change in the number of stars voted) then the uncertainties are convolved and the possible range in the result is doubled to +/- 0.01. The error distribution also changes from a rectangular probability function to a triangular probability function.

I can give you a graph of the probability of getting a correct result. I've run numerical experiments that show it to be true. The results of back-calculating the scores are only exact to 50 votes, but for most purposes the uncertainties are acceptable to somewhere near 90 votes.

There's also a problem that when you get a vote that doesn't change the score then the only result you can back-calculate correctly is the rounded-off version of the score, which may or may not be the right result.
__________________
My stories

My personal favorites are The Third Ring and Oscar's Place.
My Valentines Day contest entry was Her Bodyguard (and his Dirty Valentine). It's a little brother/sister love story.
My most recent story is The Third Ring -- Tamsin of Sky Village, a story inspired by the legendary character of Yellow Woman.
I was seduced by two dead flappers, so next up is a ghost story named "Love is Enough."
  Reply With Quote

Old 11-30-2017, 03:38 PM   #14
RubenR
Literotica Guru
 
RubenR's Avatar
 
RubenR is offline
Join Date: Aug 2015
Location: Hidden
Posts: 1,382
Quote:
Originally Posted by NotWise View Post
The uncertainty in a single value rounded to 1/100th is +/- 0.005. When you perform an operation using two such rounded numbers (as you do when you calculate the change in the number of stars voted) then the uncertainties are convolved and the possible range in the result is doubled to +/- 0.01. The error distribution also changes from a rectangular probability function to a triangular probability function.

I can give you a graph of the probability of getting a correct result. I've run numerical experiments that show it to be true. The results of back-calculating the scores are only exact to 50 votes, but for most purposes the uncertainties are acceptable to somewhere near 90 votes.

There's also a problem that when you get a vote that doesn't change the score then the only result you can back-calculate correctly is the rounded-off version of the score, which may or may not be the right result.
I'm not sure I get your point, but if you have 100 votes, say 99 * 5 and 1 * 4, you get a total of 499 "stars". On average, that is 4.99. Hence, you can calculate back what was the number of 4 and 5 stars.

I think that's how it works; the total number of stars are counted, and divided by the number of votes/ both integers. So, you don't have any errors there.
__________________
My Stories and Poems
  Reply With Quote

Old 11-30-2017, 04:27 PM   #15
SimonDoom
Literotica Guru
 
SimonDoom is offline
Join Date: Apr 2015
Location: USA
Posts: 1,873
I wish this site allowed one to search for stories within a certain score range or above a certain score. As it is, the only score parameter for search purposes is 4.5, which is around the 75th percentile for most categories but somewhat above that for Loving Wives. It would be interesting to know what the median score is and what the 90th percentile score is without actually having to go through a hundred or so stories and tabulating their scores.
__________________
My stories are at https://www.literotica.com/stories/m...ge=submissions.
  Reply With Quote

Old 11-30-2017, 04:38 PM   #16
RubenR
Literotica Guru
 
RubenR's Avatar
 
RubenR is offline
Join Date: Aug 2015
Location: Hidden
Posts: 1,382
Quote:
Originally Posted by SimonDoom View Post
I wish this site allowed one to search for stories within a certain score range or above a certain score. As it is, the only score parameter for search purposes is 4.5, which is around the 75th percentile for most categories but somewhat above that for Loving Wives. It would be interesting to know what the median score is and what the 90th percentile score is without actually having to go through a hundred or so stories and tabulating their scores.
It is possible to sort on the score, so you can stop at your limit
__________________
My Stories and Poems
  Reply With Quote

Old 11-30-2017, 05:33 PM   #17
NotWise
Snipe hunter
 
NotWise's Avatar
 
NotWise is offline
Join Date: Sep 2015
Location: On the high desert
Posts: 4,452
Quote:
Originally Posted by RubenR View Post
I'm not sure I get your point, but if you have 100 votes, say 99 * 5 and 1 * 4, you get a total of 499 "stars". On average, that is 4.99. Hence, you can calculate back what was the number of 4 and 5 stars.

I think that's how it works; the total number of stars are counted, and divided by the number of votes/ both integers. So, you don't have any errors there.
Lets say that you have 86 votes and a total of 347 *'s (rounded off score of 4.03), then you receive one 5* vote. You now have 87 votes a total of 352 *'s and an average score is 4.05.

Now back-calculate that vote. You had 86*4.03 stars (346.58) and now you have 87*4.05 stars (352.35). That's a change of 5.77 stars. It looks like you just got a 6* vote. You didn't.
__________________
My stories

My personal favorites are The Third Ring and Oscar's Place.
My Valentines Day contest entry was Her Bodyguard (and his Dirty Valentine). It's a little brother/sister love story.
My most recent story is The Third Ring -- Tamsin of Sky Village, a story inspired by the legendary character of Yellow Woman.
I was seduced by two dead flappers, so next up is a ghost story named "Love is Enough."
  Reply With Quote

Old 11-30-2017, 05:43 PM   #18
SimonDoom
Literotica Guru
 
SimonDoom is offline
Join Date: Apr 2015
Location: USA
Posts: 1,873
Quote:
Originally Posted by RubenR View Post
It is possible to sort on the score, so you can stop at your limit
I don't understand what this means, or how you do this. ??
__________________
My stories are at https://www.literotica.com/stories/m...ge=submissions.
  Reply With Quote

Old 11-30-2017, 05:47 PM   #19
RubenR
Literotica Guru
 
RubenR's Avatar
 
RubenR is offline
Join Date: Aug 2015
Location: Hidden
Posts: 1,382
Quote:
Originally Posted by NotWise View Post
Lets say that you have 86 votes and a total of 347 *'s (rounded off score of 4.03), then you receive one 5* vote. You now have 87 votes a total of 352 *'s and an average score is 4.05.

Now back-calculate that vote. You had 86*4.03 stars (346.58) and now you have 87*4.05 stars (352.35). That's a change of 5.77 stars. It looks like you just got a 6* vote. You didn't.
I disagree. If you had a score of 4.03 with 86 votes, you can calculate it were 347 stars (you need to round). If you get a score of 4.05 with 87 votes, you end up with 352 stars (rounded)
__________________
My Stories and Poems
  Reply With Quote

Old 11-30-2017, 05:55 PM   #20
RubenR
Literotica Guru
 
RubenR's Avatar
 
RubenR is offline
Join Date: Aug 2015
Location: Hidden
Posts: 1,382
Quote:
Originally Posted by SimonDoom View Post
I don't understand what this means, or how you do this. ??
If you go to 'search', then select 'advanced search', you can choose a category, and sort on score. Then, without entering any word to filter for, click on the magnifying glass, and you'll get all stories from that category, sorted on score
__________________
My Stories and Poems
  Reply With Quote

Old 11-30-2017, 06:31 PM   #21
SimonDoom
Literotica Guru
 
SimonDoom is offline
Join Date: Apr 2015
Location: USA
Posts: 1,873
Quote:
Originally Posted by RubenR View Post
If you go to 'search', then select 'advanced search', you can choose a category, and sort on score. Then, without entering any word to filter for, click on the magnifying glass, and you'll get all stories from that category, sorted on score
Sure. But that doesn't give one the information I'm talking about. You'll get a gazillion stories in a given category ranked from highest score to lowest but it's not helpful in terms of easily providing the information I'm talking about.

What would be helpful would be to be able to do a search for stories within a given score range. One could then easily determine the percentile of the stories in that range. That's not possible with the available search tools.
__________________
My stories are at https://www.literotica.com/stories/m...ge=submissions.
  Reply With Quote

Old 11-30-2017, 06:58 PM   #22
NotWise
Snipe hunter
 
NotWise's Avatar
 
NotWise is offline
Join Date: Sep 2015
Location: On the high desert
Posts: 4,452
Quote:
Originally Posted by RubenR View Post
I disagree. If you had a score of 4.03 with 86 votes, you can calculate it were 347 stars (you need to round). If you get a score of 4.05 with 87 votes, you end up with 352 stars (rounded)
In this case it gives you the right result. More generally, using round-off at intermediate steps in the calculations increases the number of errors. That is not only true in this case, it is a general computational rule; you destroy the precision in your results if you round off at intermediate steps in a calculation.

I've built my spreadsheets both ways. If you round off the estimated number of *'s then you will see errors in the result even below fifty votes.

Getting a 6* result doesn't necessarily mean that the right result is a 5* vote. It could be (for instance) a 3* vote and 4* vote added and a 1* vote removed by the site. The net result looks like an error; it's one vote and 6*'s.
__________________
My stories

My personal favorites are The Third Ring and Oscar's Place.
My Valentines Day contest entry was Her Bodyguard (and his Dirty Valentine). It's a little brother/sister love story.
My most recent story is The Third Ring -- Tamsin of Sky Village, a story inspired by the legendary character of Yellow Woman.
I was seduced by two dead flappers, so next up is a ghost story named "Love is Enough."

Last edited by NotWise : 11-30-2017 at 07:03 PM.
  Reply With Quote

Old 11-30-2017, 07:14 PM   #23
SimonDoom
Literotica Guru
 
SimonDoom is offline
Join Date: Apr 2015
Location: USA
Posts: 1,873
I am sort of following the dialogue between NotWise and RubenR -- barely -- but my question is, why would one care about total stars? What's interesting is the distribution of scores, and unless you have followed the scoring of your story very closely from the beginning you cannot discern that from the information this site provides. If you have 100 votes and a score of 4.6, you don't know how the scores are distributed. You can figure out the minimum number and the maximum number of 5s that you have, and the maximum and the minimum number of 1s that you have, but that's it.
__________________
My stories are at https://www.literotica.com/stories/m...ge=submissions.
  Reply With Quote

Old 11-30-2017, 07:29 PM   #24
NotWise
Snipe hunter
 
NotWise's Avatar
 
NotWise is offline
Join Date: Sep 2015
Location: On the high desert
Posts: 4,452
Quote:
Originally Posted by SimonDoom View Post
I am sort of following the dialogue between NotWise and RubenR -- barely -- but my question is, why would one care about total stars? What's interesting is the distribution of scores, and unless you have followed the scoring of your story very closely from the beginning you cannot discern that from the information this site provides. If you have 100 votes and a score of 4.6, you don't know how the scores are distributed. You can figure out the minimum number and the maximum number of 5s that you have, and the maximum and the minimum number of 1s that you have, but that's it.
Tracking the votes is the only way I know of to get the distribution of votes. I think that will remain true unless Manu can provide that information.

Having tracked votes for almost two years, I think most people would find the results uninteresting. One thing that does pop out is that 1* bombs on high-rated stories show up like a sore thumb.

A simple model for the vote distributions is that the # of votes in a category is approximately a constant times the votes in the next higher category. If the average score is above three then the constant is less than one. If the average is three then the constant is 1. If the average is below three then the constant is greater than 1.

Trolling breaks this simple pattern and it seems like the sweeps tend to restore it.

If you were to do a bar graph, then stories with a score over three would have a graph with regularly increasing heights toward 5* votes. A story with a 3* score would have a completely flat graph. A story with a score under three would have a graph with regularly increasing heights toward 1* votes.

I don't have any stories at three or below, so that's a feature of that simple model that I can't vouch for.
__________________
My stories

My personal favorites are The Third Ring and Oscar's Place.
My Valentines Day contest entry was Her Bodyguard (and his Dirty Valentine). It's a little brother/sister love story.
My most recent story is The Third Ring -- Tamsin of Sky Village, a story inspired by the legendary character of Yellow Woman.
I was seduced by two dead flappers, so next up is a ghost story named "Love is Enough."
  Reply With Quote

Old 11-30-2017, 07:30 PM   #25
LoquiSordidaAdMe
Really Really Experienced
 
LoquiSordidaAdMe's Avatar
 
LoquiSordidaAdMe is offline
Join Date: Aug 2017
Location: Washington, DC
Posts: 471
Quote:
Originally Posted by SimonDoom View Post
I am sort of following the dialogue between NotWise and RubenR -- barely -- but my question is, why would one care about total stars? What's interesting is the distribution of scores, and unless you have followed the scoring of your story very closely from the beginning you cannot discern that from the information this site provides. If you have 100 votes and a score of 4.6, you don't know how the scores are distributed. You can figure out the minimum number and the maximum number of 5s that you have, and the maximum and the minimum number of 1s that you have, but that's it.
I did pull together a quick spreadsheet using the formulas from the CarlusMagnus article mentioned above. The results were kind of interesting once I started calculating percentages so that I could compare a story with under 70 votes to a story with over 700.

But I have to agree with SD above. What I really want to know is if the story got a 4.5 score because half the readers loved it (5*) and half thought it was pretty good (4*), or if it got a 4.5 because almost everybody loved it (5*), but a few thought it was shit (1*).

I don't know that it would make any real difference, but it would satisfy my curiosity. Guess I'll have to get used to disappointment.
__________________
My latest story:
Time to Breathe (Sci-Fi; 6 pages)
Low on air. Far from aid. How do you spend your final hours?
Proudly part of the 2018 Geek Pride Day Anthology

The rest of my prosaic little stroke stories
  Reply With Quote
Reply


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump



All times are GMT -4. The time now is 06:54 AM.

Copyright 1998-2013 Literotica Online. Literotica is a registered trademark.