5

How many servers are used to host a commercial website like StackOverflow? Are there caching appliances involved?

asked Nov 4, 2009 at 22:35
0

2 Answers 2

11

Here is an update, from https://blog.stackoverflow.com:

For more information, see the Blog post.

answered Nov 4, 2009 at 22:48
2
  • I thought the HAProxy box was a virtualized UNIX server, so I don't know it would count as an additional "box". Commented Nov 4, 2009 at 23:03
  • Well, it is still involved. I'll clarify. Commented Nov 4, 2009 at 23:07
9

This is the server configuration, IIRC:

  • web (stackoverflow.com)
  • web (stackoverflow.com)
  • web (serverfault.com / careers)
  • web (superuser.com)
  • web (meta / sstatic.net) / HAproxy load balancer for stackoverflow.com in a VM / cacti monitoring / etc
  • database (all sites)

There's also a backup appliance for regular database backups. Caching is done on the individual web servers (not shared) so one of the goals for HAproxy is to attempt to route users to the same server for repeated requests through IP hashing.

Email traffic is hosted with Google Apps.

answered Nov 4, 2009 at 22:57
5
  • Where is sstatic hosted? Commented Nov 4, 2009 at 23:05
  • Wait, am I understanding this correctly? There are just 2 front end web servers for serving all of Stack Overflow's traffic? Commented Jan 29, 2010 at 4:20
  • @orokusaki: there are now three - the third was added just a few weeks ago. the real miracle is that all the sites run off of one database server. Commented Jan 29, 2010 at 5:59
  • That is incredible. I've always wondered what it takes to run such a large website. That makes Digg look like even more of an epic fail considering that years ago when their traffic was just a fraction of what it is now, they were running 17 servers and barely making it. It's very exciting, for my application that I'm working on slowly, that one DB server could handle all that. Do you know how much Ram / Procs / Other hardware specs there are? Commented Jan 29, 2010 at 16:32
  • @orokusaki this should answer your questions blog.stackoverflow.com/2009/12/… . it mentions two database servers, but one is a backup in case of failure in the primary one. Commented Jan 29, 2010 at 22:08

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.