I've been thinking again about the karma thresholds for user permissions, and the numerical values attached to badges . . . I know these are configurable, but I wonder if it would be useful for the defaults to be percentages of the total site activity, rather than specific values. Then new communities using askbot wouldn't have to re-set the thresholds as they grow (if they even bother to lower them in the first place). Of course there would have to be some absolute minimum values, for when the site is brand new, but I think these should be small.
Here's one proposal: Let U be the top 50% of users (that is, the set of their karma values). Then set the following thresholds to gain the following priveleges:
Since a user may fall outside of a given percentage (as the community grows), there should be some (lower) threshold to lose each privelege. It could be zero, if you think that people should never lose a privelege once they've gained it, but the minimum value of U would probably be a more reasonable threshold. Also, U could be recalculated monthly rather than, say, daily or hourly, to make the numbers fluctuate less. Or, if you want to take this idea to an extreme, U could be recalculated every t days, where t is 10% of the site lifetime.
A similar principle could be applied to the badges: getting the "nice question" badge could require having your answer upvoted by 10% of the total number of users.
As a last remark, I think that the particular thresholds should still be configurable; the new feature here is being able to set them by percentage, rather than by absolute number only, and then setting the defaults that way (better for new askbot communities). (And, by the way, I haven't actually looked at a single line of askbot code, so forgive me and let me know if this is already possible. :)
answered 2010-10-18 11:06:35 -0500ccanonc
In addition to my comments above, I think another useful metric of positive activity is a moving average of the first derivative of karma with respect to time, and possibly other variables with respect to time (Recent Karma Velocity!). A moving average, however weighted, has some advantages (as long as you have that sliding window of time, it keeps people incentivized to keep contributing.) Perhaps a first step towards this would be to show the moving average of the first derivative (with site configurable time interval of course) in the karma history. Then perhaps draw up some proposals based upon observed behavior.
This can be experimented with, the easiest approach will be to re-assess the barriers automatically about once a day. It's a lot easier than hard-coding the logic into a whole bunch of tests and assertions of type
If anyone is interested to make this work - one can write a management command that analyzes the karma of users and adjusts the settings accordingly.
Management commands are located in directory
Available minimum rep settings are in
Say if you want to update setting
MIN_REP_TO_VOTE_UP you could code like:
#import askbot live settings from askbot.conf import settings settings.update('MIN_REP_TO_VOTE_UP', some_new_value)
The management command is then run via cron job:
python manage.py reassess_karma_barriers
It's best to try and see how this will work. It's not obvious how people will react to having some privileges come and go based on their "karma" standing relative to others.
This is a very interesting idea, but you would need to exclude a significant subset of the user base when calculating
Based on my own observations of various Q&A sites including StackExchange, askbot.org and my hosted site, the median karma/reputation amount (i.e. minimum amount of karma to be in the top 50%) tends to be 1.
For example, on askbot.org, as much as 60% of the user base have only 1 karma — it would take a lot of participation by people who posted once and never returned to raise the median karma above 1.
To work around this problem, you could simply change the calculation to be the median karma of users who have more than 1 karma.
For askbot.org, if you were to exclude all 1-karma users from the median calculation, you'd end up probably with a
U value between 50 and 60 (as of the time this was posted, although it would be interesting to see if this changes over time).
Create your Q&A site at askbot.com. Managed Askbot hosting at just $15/mo. Dedicated hosting, support contracts, consulting services.create your Q&A site
Asked: 2010-10-18 09:55:44 -0500
Seen: 82 times
Last updated: Jul 29 '12