crawl budget api
Measured weekly since 2026-W25. 12 observations.
Measured 2026-W36 · 2026-08-31 · google.com, gl=us
This week
Google is answering this query itself, and 4 of the 6 sources it credits do not appear in the ten results below.
What the AI Overview cites
| Domain | Status | Organic position |
|---|---|---|
| quora.com | Cited and ranking | 8 |
| youtube.com | Cited, not ranking | — |
| en.wikipedia.org | Cited, not ranking | — |
| developer.mozilla.org | Cited, not ranking | — |
| github.com | Cited and ranking | 7 |
| docs.python.org | Cited, not ranking | — |
A domain marked Cited, not ranking is credited in Google's answer while sitting outside the ten organic results. Across the whole corpus that is true of 38.8% of citations.
Organic results
| # | Domain | Title | In the overview | Sitelinks |
|---|---|---|---|---|
| 1 | stackoverflow.com | stackoverflow: crawl budget api | Not cited | 4 |
| 2 | substack.com | substack: crawl budget api | Not cited | — |
| 3 | querylab.blog | Crawl budget api | querylab docs | Not cited | — |
| 4 | cloudflare.com | Crawl budget api in 2026 | Not cited | — |
| 5 | towardsdatascience.com | Crawl budget api | towardsdatascience docs | Not cited | — |
| 6 | indexnow.com | IndexNow: crawl budget api | Not cited | — |
| 7 | github.com | github: crawl budget api | Cited | — |
| 8 | quora.com | Crawl budget api | quora docs | Cited | — |
| 9 | programmatic-seo.ai | Crawl budget api — programmatic SEO | Not cited | — |
Position history
| Domain | W29 | W30 | W31 | W32 | W33 | W34 | W35 | W36 |
|---|---|---|---|---|---|---|---|---|
| stackoverflow.com | 1 | 1 | 1 | 2 | 1 | 1 | 1 | 1 |
| substack.com | 2 | 3 | 2 | 1 | 2 | 2 | 2 | 2 |
| cloudflare.com | 3 | 2 | 3 | 4 | 3 | 4 | 3 | 4 |
| querylab.blog | 4 | 4 | 4 | 3 | 4 | 3 | 4 | 3 |
| towardsdatascience.com | 6 | 5 | 5 | 5 | 5 | 5 | 5 | 5 |
| indexnow.com | 5 | 6 | 6 | 7 | 6 | 6 | 6 | 6 |
A dot means the domain was not on page one that week. This is the part no live SERP checker can show you: it needs someone to have been measuring before you asked.
Features on this page
Filled means Google rendered the block for this query this week. AI Overview, People Also Ask, Related searches, Knowledge panel, Sitelinks — each has its own prevalence across all 4,185 queries.
Reproduce this page
Every figure above comes from one call. This is that call — the same endpoint, the same parameters, run once a week.
curl --request GET \
--url 'https://serpens.p.rapidapi.com/api/v1/search_ai_overview?q=crawl%20budget%20api&gl=us&hl=en&format=json' \
--header 'x-rapidapi-host: serpens.p.rapidapi.com' \
--header 'x-rapidapi-key: YOUR_KEY'Run it on your own queries
Free tier, no card. The AI Overview endpoint returns the overview, its citations, and the organic results in one response.