Search engines and AI crawlers can read your site
| What we looked at | What we found |
|---|---|
| robots.txt | https://blackmine.dev/robots.txt |
| meta robots | (none) |
| AI crawlers blocked | none |
| X-Robots-Tag header | (none) |
| blocks all crawlers | no |
| sitemap referenced in robots | yes |