vaaya / recipes / Search & scrape the internet

Search & scrape the internet

Give your agent the whole web as a tool. It runs semantic searches, reads source pages, crawls entire sites, and extracts clean structured data, even from pages with no API, and drives a real browser when a site fights back.

Services this recipe uses

Every call runs through Vaaya. No per-vendor signup, API keys, or billing.

Exa x402

Semantic search and page-content retrieval over the live web.

searchcontents

Firecrawl mpp

Scrape, crawl, and map sites, returning clean markdown or structured JSON.

scrapecrawlmapextractsearch

Browserbase x402

Drive a real browser to reach sites and directories with no API.

create_sessionextend_sessionrelease_session

How your agent runs it

The exact play your agent executes unattended once Vaaya is installed.

Find and extract structured data

1an agent calls exa.search to find the right pages
2then firecrawl.scrape to pull clean content from each
3then firecrawl.extract to return JSON against your schema

Crawl a whole site

1an agent calls firecrawl.map to enumerate every URL
2then firecrawl.crawl to fetch them in bulk
3then browserbase.create_session for any page that needs a real browser

Part of a bigger ecosystem

These and hundreds more services are reachable through Vaaya.

Run this recipe from your agent.

Install Vaaya and your agent reaches every service above, and hundreds more. $100 free credit to start.

npx @vaaya/mcp install