ah @pmylund and @cebjyre are correct; I guess all the robots.txt directives are reset in each section. Wow, that's not intuitive at all.