Crawling & Indexing

Checks whether HTTP response headers accidentally block indexing with X-Robots-Tag.

Samples internal homepage links and checks whether they still lead to working pages.

Checks whether robots.txt blocks CSS, JavaScript or asset paths needed for rendering.

Shows whether search engines are being guided sensibly instead of blocked by accident.

Shows whether the site gives search engines a clean roadmap to important URLs.