Robots.txt & Sitemap Tester

Check if a specific path is allowed for a given user-agent. Fetch and display the robots.txt.