Short answer: The homepage was already allowed in search. What a crawler could not do was quote it, or find the map of the site. /robots.txt and /sitemap.xml never reached WordPress, so both were Apache 404s. A real robots.txt now points at the sitemap WordPress already knew how to…
Learn extensively, Understand deeply, Discern clearly, and Act resolutely.