Robots.txt Checker

Fetch and display the robots.txt file of a website to analyze crawler directives for SEO.