Guide

What should we do about robots blocks ai bots?

robots.txt blocks one or more AI crawlers. Decide which ones you want reading the site. Fix that page first, then rerun the scan.

What strong looks like

Strong looks like the suggestion no longer applies the next time you run the check.

What to do first

robots.txt blocks one or more AI crawlers.

Start the check