Data for AI 
Back
Parameter Description
1.Basic parameters
The parameters of different scrapes are different in context and need to be included in it
| Parameter Name | Description | Type | Required |
| locale | Language/Region setting – e.g., "en-US" | string | No |
| source | Data source type | string | Yes |
| geo | Region | string | No |
| format | Required return format | []string | No |
| js_render | Enable JS rendering – false: disabled, true: enabled (default: false) | boll | No |
| context | Query context container | object | Yes |
2.Youtube scraping parameters
| Function Name | Parameter Name | Description | Type | Required |
| YouTube-Video Details | url_list ├─ url |
Video URL list – Array containing multiple video objects | array<object> | Yes |
| Single YouTube video URL | string | Yes | ||
| Youtube-Video Search | keyword | Search keywords | string/null | Yes |
| continuation | Search result pagination cursor – Used to fetch more results | string/null | No | |
| Youtube-Video Subtitles | url | Full YouTube video link | string/null | Yes |
| output_format | Caption output format – Currently supports "srt" | string | No | |
| Youtube-User Information Acquisition | url_list ├─ url |
User profile URL list – Contains multiple user objects | array<object> | Yes |
| Single YouTube user profile URL | string | Yes |
The following example uses YouTube subtitle extraction:
"request_example": { "locale": "en", "context": { "video_url": "https://www.youtube.com/watch?v=N0p05Tq7oq0", "output_format": "srt" } } youtube subtitles download
3.Facebook scraping parameters
| Function Name | Parameter Name | Description | Type | Required |
| Facebook-User Profile | url_list | List of Facebook user or page URLs to extract profile information from | list | Yes |
| list | A valid Facebook profile or page URL | string | Yes |
Here we take the example of grabbing FB user information:
"request_example": { "locale": "en-US", "source": "facebook_user_profile", "context": { "url_list": [ { "url": "https://www.facebook.com/zuck/" } ] } }
4.Amazon scraping parameters
| Function Name | Parameter Name | Description | Type | Required |
| Amazon-Product Search | keyword_list ├─ keyword |
Search keyword list – Supports multiple keywords for scraping | list (object[]) | Yes |
| Single search keyword to scrape | string | Yes | ||
| start_pages | Start page number – The page number to start scraping from (e.g., 1 for the first page) | number | No | |
| pages | Number of pages to scrape – Total number of pages to scrape | number | No | |
| Amazon-Best Seller | category_list ├─ category_id |
Category ID list – Array containing multiple category objects | array<object> | Yes |
| Category unique identifier | string | Yes | ||
| start_page | Start page number – Page number to start scraping from | integer | No | |
| pages | Total pages to scrape – Number of pages to scrape | integer | No | |
| Amazon product reviews | product_url_list ├─ product_url |
Product URL list – Contains multiple product objects | array<object> | Yes |
| Single product URL | string | Yes | ||
| Amazon product listings | product_url_list ├─ product_url |
Product URL list – Contains multiple product objects (duplicate entry) | array<object> | Yes |
| Single product URL (duplicate entry) | string | Yes |
Here we take the example of crawling Amazon product keywords:
"request_example": { "geo": "US", "format": false, "locale": "en-US", "source": "amazon_search", "context": { "pages": 2, "start_page": 1, "keyword_list": [ { "keyword": "1077068" } ] }, "js_render": false }
5.TikTok scraping parameters
| Function Name | Parameter Name | Description | Type | Required |
| TK Video Search | keyword | Search for a keyword; the system will find videos based on that keyword. | string | Yes |
| TK Comments | video_id | TikTok video ID, used to locate the video. | string | Yes |
| cursor | Cursor, used to paginate and retrieve more replies. | string | No | |
| count | Limits the number of replies returned per page. | integer | No | |
| TK User Information Search | url_list ├─ user_url |
User URL list (an array containing multiple user objects). | array<object> | Yes |
| A single TikTok user's homepage URL. | string | Yes |
Here we take the capture of TK video information as an example:
"request_example": { "source": "tiktok_video", "context": { "sec_uid": "911proxy" } }
6.X scraping parameters
| Function Name | Parameter Name | Description | Type | Required |
| X tweet information | user_id | The ID of a Twitter user, used to get tweets from that user | string | Yes |
Here we take the example of grabbing X tweet information:
"request_example": { "locale": "en-US", "source": "twitter_tweets", "context": { "url_list": [ { "tweet_id": "44196397" } ] } }
7.Google scraping parameters
| Function Name | Parameter Name | Description | Type | Required | Optional |
| Google Job Search | job_name | Job title keywords | string | Yes | - |
| job_location_list ├job_location |
Location List | array<object> | No | - | |
| experiences | Work experience screening value | array<string> | No | INTERN_AND_APPRENTICE EARLY MID ADVANCED DIRECTOR_PLUS |
|
| has_remote | Is this a remote position? | boolean | No | - | |
| skills | Skill keywords (comma separated) | string | No | - | |
| degree | Educational qualification screening value | array<string> | No | PURSUING_DEGREE ASSOCIATE BACHELORS MASTERS DOCTORATE |
|
| employment_type | Position Type | array<string> | No | FULL_TIME PART_TIME TEMPORARY INTERN |
|
| sort_by | Sort fields (relevance/time) | string | No | relevance date |
|
| page | Pagination page number (starting from 1) | integer (建议) / string | No | - | |
| Google Events | keywords_list | Keyword list (array, containing keyword field) | array<object> | Yes | - |
| start_page | Starting page number (from which page to start crawling) | integer | No | - | |
| end_page | End page number (the page to be captured) | integer | No | - | |
| Google Images | keywords_list ├keyword |
An array of keyword objects, used to specify search keywords | array<object> | Yes | - |
| Search keywords | string | Yes | - | ||
| start_page | Starting page number (the page from which the crawl starts) | integer / null | No | - | |
| end_page | End page number (the page to be captured) | integer / null | No | - | |
| Google Auto-association | keywords_list ├keyword |
array of keyword objects | array<object> | Yes | - |
| Search keywords to get auto-complete suggestions | string | Yes | - | ||
| Google Finance | keywords_list ├keyword |
array of keyword objects | array<object> | Yes | - |
| Search keywords (such as company name, stock code, etc.) | string | Yes | - | ||
| Google Search | keywords_list ├keyword |
Search keyword object array | array<object> | Yes | - |
| Search keyword strings (such as product names, brand names, etc.) | string | Yes | - | ||
| start_page | Starting search results page number, from which page to start searching (such as 1) | int/null | No | - | |
| end_page | End search results page number, the page to end the search on (e.g. 3) | int/null | No | - |
Here we take scraping Google job as an example:
"request_example": { "locale": "en-US", "source": "google_job_search", "context": { "page": "1", "degree": "BACHELOR", "skills": "python, sql", "sort_by": "date", "job_name": "software engineer", "locations": [ { "location": "London" } ], "has_remote": true, "experience_list": [ { "experience": "MID" } ], "employment_type_list": [ { "employment_type": "FULL_TIME" } ] } }, "response_example": { "result": [ { "job_href": "jobs/results/108913291534705350-senior-software-engineer-generative-ai-google-workspace?q=Software&has_remote=true&page=1", "job_title": "Senior Software Engineer, Generative AI, Google Workspace", "job_detail": "Minimum qualifications....", "job_remote": "Remote eligible", "job_company": "Google", "job_location": "New York, NY, USA; Boulder, CO, USA; +4 more; +3 more" } ] }
Updated 10 hour ago
Contact UsUsage Method 
ISO/IEC 27001:2017 Certified Product Start Your Efficient Proxying and Scraping Journey.
CONTACT US
[email protected]CONTACT US
[email protected]
Due to policy reasons,Proxy must be used in non-Mainland China Internet environment!Smart Innovation Technology LimitedUNIT1021, BEVERLEY COMMERCIAL CENTRE, 87-105 CHATHAM ROAD SOUTH, TSIM SHA TSUI, KOWLOON
This website uses cookies to improve the user experience. To learn more about our cookie policy or withdraw from it, please check our Privacy Policy and Cookie Policy.
Chat
Email
Contact us with email
Tips:
Provide your account number or email.
Provide Screenshots or vedios, and simply describe the problem.
We’ll reply to your question within 24h.
Send Email
