I remember the reddit guys said they were very happy with HAProxy in front of ~20 servers; I believe 37signals uses it as well