# Crawlability

> Crawlability is whether a particular crawler can reach and fetch a page and the resources it needs.

*Source: [https://contentcucumber.com/aeo-glossary/crawlability/](https://contentcucumber.com/aeo-glossary/crawlability/)*

*Topic: Getting found. Also called: Crawling, Crawler access, AI crawlers*

---

## Why it matters

A page can work in your browser while a firewall, authentication step, or robots rule prevents a crawler from reaching it.

## Example (illustrative, not a client result)

A public guide returns a normal page to people, but a security rule challenges automated requests.

## What to check

Check response codes, robots rules, and security logs for the relevant crawler, and verify crawler identities against the provider’s documentation.

## What this does not tell you

Access does not guarantee indexing or citation, and different crawlers can have different permissions and purposes.

## Sources

- [Google Search Central: how Search works](https://developers.google.com/search/docs/fundamentals/how-search-works) (Platform documentation)

*Evidence type: Documented concept. Sources checked on 2026-11-19*

## Related terms

- [robots.txt](https://llms.contentcucumber.com/aeo-glossary/robots-txt.md)
- [Indexability](https://llms.contentcucumber.com/aeo-glossary/indexability.md)
