HAProxy interferes with app_offline. See http://superuser.com for how it's supposed to work.