open source web scraping
Measured weekly since 2026-W25. 12 observations.
Measured 2026-W36 · 2026-08-31 · google.com, gl=us
This week
Google is not answering this query itself as of 2026-W36. The 10 results below are the whole page.
Organic results
| # | Domain | Title | Sitelinks |
|---|---|---|---|
| 1 | brightdata.com | Open source web scraping in 2026 | — |
| 2 | colly.com | Open source web scraping — Colly | 2 |
| 3 | npmjs.com | Open source web scraping — npmjs | — |
| 4 | en.wikipedia.org | en: open source web scraping | — |
| 5 | puppeteer.io | Open source web scraping — Puppeteer | — |
| 6 | playwright.com | Open source web scraping in 2026 | — |
| 7 | g2.com | g2: open source web scraping | — |
| 8 | protoguide.org | protoguide: open source web scraping | — |
| 9 | quora.com | Open source web scraping in 2026 | — |
| 10 | zapier.com | Open source web scraping in 2026 | — |
Position history
| Domain | W29 | W30 | W31 | W32 | W33 | W34 | W35 | W36 |
|---|---|---|---|---|---|---|---|---|
| brightdata.com | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| colly.com | 3 | 2 | 3 | 2 | 3 | 2 | 2 | 2 |
| en.wikipedia.org | 4 | 3 | 4 | 4 | 4 | 4 | 3 | 4 |
| npmjs.com | 2 | 4 | 2 | 3 | 2 | 3 | 4 | 3 |
| puppeteer.io | 5 | 6 | 5 | 6 | 5 | 5 | 5 | 5 |
| playwright.com | 6 | 5 | 6 | 5 | 6 | 7 | 6 | 6 |
A dot means the domain was not on page one that week. This is the part no live SERP checker can show you: it needs someone to have been measuring before you asked.
The same query in other countries
| Country | AI Overview | Overlap with US | Top three domains |
|---|---|---|---|
| United Kingdom | None | 38% | devhandbook.gb, colly.com, npmjs.com |
| Germany | None | 29% | brightdata.com, colly.com, npmjs.com |
| France | None | 46% | leanledger.fr, colly.com, npmjs.com |
| India | None | 50% | brightdata.com, wideledger.in, npmjs.com |
| Brazil | None | 27% | nimblebrief.br, signaldigest.br, npmjs.com |
| Japan | None | 36% | brightdata.com, colly.com, npmjs.com |
| Australia | None | 25% | soliddesk.au, kernelpress.au, npmjs.com |
| Canada | None | 46% | brightdata.com, colly.com, npmjs.com |
| Spain | None | 67% | brightdata.com, colly.com, vectorwire.es |
Overlap is the share of domains the two result sets have in common. Most rank tracking quietly assumes one country; this is what that assumption costs.
Features on this page
Filled means Google rendered the block for this query this week. AI Overview, People Also Ask, Related searches, Knowledge panel, Sitelinks — each has its own prevalence across all 4,185 queries.
Reproduce this page
Every figure above comes from one call. This is that call — the same endpoint, the same parameters, run once a week.
curl --request GET \
--url 'https://serpens.p.rapidapi.com/api/v1/search_ai_overview?q=open%20source%20web%20scraping&gl=us&hl=en&format=json' \
--header 'x-rapidapi-host: serpens.p.rapidapi.com' \
--header 'x-rapidapi-key: YOUR_KEY'Run it on your own queries
Free tier, no card. The AI Overview endpoint returns the overview, its citations, and the organic results in one response.