How many servers are used to host a commercial website like StackOverflow? Are there caching appliances involved?
2 Answers 2
Here is an update, from https://blog.stackoverflow.com:
For more information, see the Blog post.
-
I thought the HAProxy box was a virtualized UNIX server, so I don't know it would count as an additional "box".JMP– JMP11/04/2009 23:03:43Commented Nov 4, 2009 at 23:03
-
Well, it is still involved. I'll clarify.John Gietzen– John Gietzen11/04/2009 23:07:48Commented Nov 4, 2009 at 23:07
This is the server configuration, IIRC:
- web (stackoverflow.com)
- web (stackoverflow.com)
- web (serverfault.com / careers)
- web (superuser.com)
- web (meta / sstatic.net) / HAproxy load balancer for stackoverflow.com in a VM / cacti monitoring / etc
- database (all sites)
There's also a backup appliance for regular database backups. Caching is done on the individual web servers (not shared) so one of the goals for HAproxy is to attempt to route users to the same server for repeated requests through IP hashing.
Email traffic is hosted with Google Apps.
-
Where is sstatic hosted?Ólafur Waage– Ólafur Waage11/04/2009 23:05:32Commented Nov 4, 2009 at 23:05
-
Wait, am I understanding this correctly? There are just 2 front end web servers for serving all of Stack Overflow's traffic?orokusaki– orokusaki01/29/2010 04:20:26Commented Jan 29, 2010 at 4:20
-
@orokusaki: there are now three - the third was added just a few weeks ago. the real miracle is that all the sites run off of one database server.01/29/2010 05:59:14Commented Jan 29, 2010 at 5:59
-
That is incredible. I've always wondered what it takes to run such a large website. That makes Digg look like even more of an epic fail considering that years ago when their traffic was just a fraction of what it is now, they were running 17 servers and barely making it. It's very exciting, for my application that I'm working on slowly, that one DB server could handle all that. Do you know how much Ram / Procs / Other hardware specs there are?orokusaki– orokusaki01/29/2010 16:32:26Commented Jan 29, 2010 at 16:32
-
@orokusaki this should answer your questions blog.stackoverflow.com/2009/12/… . it mentions two database servers, but one is a backup in case of failure in the primary one.01/29/2010 22:08:20Commented Jan 29, 2010 at 22:08