First time here? Check out the FAQ!
2

How scalable is askbot?

Could it run on really large websites, like Stackoverflow..

What are the biggest sites?

Tuta's avatar
45
Tuta
asked 2011-12-15 17:07:50 -0500, updated 2011-12-15 18:04:18 -0500
edit flag offensive 0 remove flag close merge delete

Comments

To answer this we'll need to look at Stackoverflow numbers, we'll try to look up tomorrow.

Evgeny's avatar Evgeny (2011-12-15 17:47:06 -0500) edit
add a comment see more comments

1 Answer

5

To date (Dec 2011) the biggest public site is http://answers.ros.org and probably the second biggest http://ask.fedoraproject.org.

It seems that on stackoverflow there are several content writes per minute - in single digits - a single database and an application server will handle that, askbot can do that too - easily.

According to this post (published in March 2011) - http://highscalability.com/blog/2011/3/3/stack-overflow-architecture-update-now-at-95-million-page-vi.html - stackoverflow takes about 100 million pageviews per month - about 40 pageviews per second on average.

Askbot takes 200 ms to generate some pages without caching - that gives only 4 page views per second (on heavy pages, probably 6 if you count in statistics of various page loads). So you'll need 10 read servers working in parallel and one master database server to match performance of stackoverflow with askbot. Possible, but you will need resources and a sys admin.

We are working on serious caching support and the numbers will improve significantly.

Right now I think the pressure from the users is to better support concurrent reads - so we will solve this problem first. For concurrent writes - we'll think of that when some client proves that they actually have that problem.

Evgeny's avatar
13.2k
Evgeny
answered 2011-12-15 18:07:45 -0500, updated 2011-12-16 09:17:38 -0500
edit flag offensive 0 remove flag delete link

Comments

Thank you, Evgeny! good answer!

Tuta's avatar Tuta (2011-12-16 10:08:34 -0500) edit

Aren't these numbers too optimistic? I tried pingdom and other tools (webpagetest): common pages (such as this page, or the main /questions/) always start rendering >1s, and a complete load time is usually above 3s.

piskvorky's avatar piskvorky (2011-12-16 14:40:30 -0500) edit

Actually the numbers I listed are measured on the server side - the time to render page by the server. The webpagetest will measure entire round trip between the web browser and the server. Try answers.ros.org or ask.sagemath.org those are faster. Also, you should only hit the complete load time once - to load all the js, which loads at the bottom of the page.

Evgeny's avatar Evgeny (2011-12-16 15:43:18 -0500) edit
Tuta's avatar Tuta (2011-12-16 16:48:02 -0500) edit

Interesting discussion! :) I don't think speed is very important at the moment, but for the record, webpagetest measures both "first view" and "repeat view", and breaks down the times for different activities/resources -- so it's not just "full load time for uncached view".

piskvorky's avatar piskvorky (2011-12-16 21:10:59 -0500) edit
add a comment see more comments