Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that provides infrastructure for scraping, crawling, and searching the web at scale without being blocked. This toolkit exposes Bright Data's capabilities through Arcade tools for general web scraping, search engine querying, and structured data extraction from major platforms.
Capabilities
- Web scraping: Fetch any public webpage and return its content as clean Markdown.
- Multi-engine search: Query Google, Bing, or Yandex with configurable result counts, search types (web, images), and country targeting.
- Structured data feeds: Extract pre-parsed, schema'd data from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, ZoomInfo, and Booking.com — no custom parsing required.
Secrets
This toolkit requires no OAuth flow. Access is controlled entirely by two secrets passed directly to Bright Data's API.
BRIGHTDATA_API_KEY
Your Bright Data account API key, used to authenticate all requests. Obtain it from the Bright Data dashboard under Account Settings → API Token. Any Bright Data account tier can generate one; higher tiers unlock greater request volume and additional dataset types.
BRIGHTDATA_ZONE
Identifies the Bright Data proxy zone or dataset zone your requests are routed through. Zones are created and named in the Bright Data control panel under Proxies & Scraping Infrastructure. The zone name must match a zone that is active on your account and has the permissions needed for the operations you intend to use (scraping browser, SERP API, datasets, etc.).
For details on storing secrets for use with Arcade tools, see the Arcade secrets guide. You can manage stored secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |