fix: fetch Google SERP multiple pages#2244
Conversation
|
Preview for this PR was built for commit |
|
Preview for this PR was built for commit |
|
Preview for this PR was built for commit |
|
@danpoletaev just out of curiosity, could you run that copy-skill for this docs, that was introduced at our last all-hands by docs team? :) |
|
Preview for this PR was built for commit |
|
I noticed yesterday that we had slightly wrong folder structure for skills to be available for Claude Code, I merged master cause we've pushed a fix for that |
|
Preview for this PR was built for commit |
|
I'm not sure of the review skill checks this, but there's a typo in the PR title: mutliple -> multiple |
Fixed |
|
|
||
| ## Fetch more than one page of results | ||
|
|
||
| By default, Google returns up to _10 search results per page_. To retrieve additional results beyond the first page, use the `numPages` query parameter. This allows you to fetch multiple pages of search results in a single request. |
There was a problem hiding this comment.
This sentence feels like filler, we already convey that you can fetch more in previous one
| By default, Google returns up to _10 search results per page_. To retrieve additional results beyond the first page, use the `numPages` query parameter. This allows you to fetch multiple pages of search results in a single request. | |
| By default, Google returns up to _10 search results per page_. To retrieve additional results beyond the first page, use the `numPages` query parameter. |
TC-MO
left a comment
There was a problem hiding this comment.
Some changes requested
I've simplified the language a bit
got rid of double admonition
removed filler words/phrases
| ::: | ||
|
|
||
| :::info Manual pagination with the `start` parameter | ||
| You can also use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). |
There was a problem hiding this comment.
| You can also use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). | |
| Use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). |
| Google has deprecated the `num` query parameter, which previously controlled the number of results displayed per page. | ||
|
|
||
| :::caution Ignored parameter | ||
| If you include the `num` parameter in your requests, it will be completely ignored. Google no longer supports this parameter, and Google SERP proxy does not process it. |
There was a problem hiding this comment.
| If you include the `num` parameter in your requests, it will be completely ignored. Google no longer supports this parameter, and Google SERP proxy does not process it. | |
| If you include the `num` parameter in your requests, it will be ignored. Google no longer supports this parameter, and Google SERP proxy does not process it. |
| :::caution Pricing for multi-page requests | ||
| Each page counts as a separate request. A request with `numPages=10` is priced as 10 requests. | ||
| ::: | ||
|
|
||
| :::info Manual pagination with the `start` parameter | ||
| You can also use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). | ||
| ::: |
There was a problem hiding this comment.
Double admonition is really bad practice. I recommend we keep :::caution admonition and remove :::info by remaking it into general prose
| :::caution Pricing for multi-page requests | |
| Each page counts as a separate request. A request with `numPages=10` is priced as 10 requests. | |
| ::: | |
| :::info Manual pagination with the `start` parameter | |
| You can also use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). | |
| ::: | |
| :::caution Pricing for multi-page requests | |
| Each page counts as a separate request. A request with `numPages=10` is priced as 10 requests. | |
| ::: | |
| Use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3). | |
|
|
||
| When you specify `numPages`, the proxy makes multiple requests in the background and merges them into a single HTML response. | ||
|
|
||
| ### Usage |
There was a problem hiding this comment.
| ### Usage | |
| ### `numPages` parameter |
| If you include the `num` parameter in your requests, it will be completely ignored. Google no longer supports this parameter, and Google SERP proxy does not process it. | ||
| ::: | ||
|
|
||
| To retrieve more than 10 results, use the `numPages` parameter described above instead. |
There was a problem hiding this comment.
Please do not use directional language
| To retrieve more than 10 results, use the `numPages` parameter described above instead. | |
| To retrieve more than 10 results, use the `numPages` parameter described before instead. |
|
Preview for this PR was built for commit |
This PR updated our documentation to include information about how to fetch multiple pages from Google in 1 request
Note
Low Risk
Documentation-only change with no runtime or behavioral impact to the proxy/service.
Overview
Updates
google_serp_proxy.mdto clarify pagination behavior for Google SERP requests.Documents that Google’s
numquery parameter is deprecated/ignored, and introduces a supportednumPagesparameter (1–10) that fetches multiple result pages in one request, including pricing implications and an alternative using Google’sstartparameter.Written by Cursor Bugbot for commit 41ac9ee. Configure here.