Rating
From P2P-Fusion
| Rating
| |
|---|---|
Rating (or voting) is a method when some kind of numerically representable score is binded to a given material.
Contents |
Description
Rating is similiar to ranking, in the view of that both of them are for present an order of elements.
However, rating can be multidimensional ("You have great voice, my son, but you just don't have the appereance"), as it's used to represent quaility measures of materials.
Data
Input
We can speak of:
- Explicity, numerical rating
- when you choose an answer from 1 to 5
- Explicit, symbolical rating
- when there's meaning binded to every possible value (wonderful;good;mediocre;bad;terrible)
- Implicit
- when it's about number of viewers, number of recommendations, etc.
Storage
Certain peer-to-peer systems collect ratings in a peer-to-peer fashion, often in some kind of metadata.
A typical peer-to-peer problem about sharing rating is that it's hard to have a representative pattern of rating broadcasts.
Output
Rating can be used for
- Users
- Materials
- Comments
- Ratings(!)
Dependencies
Tools used
- User identification (not necessarily)
- Automatic collection of user events
- Trust system/ social network / buddy list, for emphasis calculation
Tools using this tool
Recommendation Commenting
Management
A rating can be
- given
- (in some systems) revoken
- dimensioned
Interface
Usually interface is a list of choices, sometimes "merged" (like five stars,and if you select the third one, it means you selected three of them).
In Slashdot, a rating dimension (interesting, funny) should also be given.
Prevalence
Rating is one of the easiest explicit social processing activities. Our numbers show that there's 150-200% of users who rate things rather than comment.
Technical aspects
Handling of anonymous rating could be difficult in peer-to-peer systems. A rating is unique for:
- The material
- The user who did the rating
Thus, it can be represented in a tuple like
- Material ID
- User ID
- score
A typical storage would be a list of such records.
For faster computation, a wrapper object who calculates average, summary with faster (aggregated) algorhytms on new ratings added could be used.
Probably it could be collected aggregated for each material, but it would mean, that since ratings could not be differentiated from each other, some ratings could be collected twice or more, so emphasis would go on these.
Social aspects
Community
On Slashdot, it's a community custom for select random regular users (moderators) for a given post's comments to rate.
There are also metamoderators choosen to rate moderators.
Norms and rules
- If someone's materials gets bad ratings in a row, posting new materials could be blocked temporary
- If someone rates bad, emphasis of ratings could be lowered
- Noone should have much more authority than any other
Incentives and sanctions
There should be incentives to use explicit rating, like it means faster response times, or it gives some revenue for the author of material, and there should be sanctions for spamming rating system (like trying to rate something twice, in order to emphasis our opinion).
Techniques
Problems
On YouTube, it's usual that most viewed videos get an average rating of 3 of 5. It could mean different things:
- It divides its audience
- It's simply really mediocre
- There are cultural differences in handling such system (somewhere, 1 means best, at hungary, 5)
Existing examples
- Slashdot uses a complex rating system to filter comments
- MySpace uses a "hot-to-cold" rating for users' materials
- YouTube has a star-based rating system, used to collect top lists, and implicitly to honor uploaders
P2P file sharing examples
Tribler uses a rating mechanism for materials.
Application in Fusion
For audio/video files
Rating isn't based on type of materials.
In P2P systems
- Wipe out fake materials
Scenarios
- I've seen this film, and it was awesome, I want to recommend it
- I want this author to win (in some competition), or gain more access, therefore I rate it
- It was so bad, I want to express my opinion
Communities
Communities with a great number of materials can use rating for sorting.
