vaaya / workflows / Search & scrape the internet
Search & scrape the internet
Search for sources, read pages, crawl a site, or extract structured data. Your agent can use a hosted browser when a task needs clicks or other page interactions.
What you get
- Semantic search across the live web, plus clean content pulled from any source page.
- Whole sites crawled and turned into structured JSON against your schema.
- A real browser drives through sites with no API when one fights back.
Start with a prompt
Copy one of these prompts into Claude, Cursor, ChatGPT, or another agent connected to Vaaya.
Use Vaaya to search the web for the top project-management tools and give me a clean list with pricing.
Use Vaaya to crawl competitor.com, pull every pricing tier and feature into a JSON table against this schema, and for pages that block scrapers, drive a real browser to read them.
You can also try the prompt in Vaaya chat. It uses the same account and tools, with nothing to install.
Tools this workflow uses
Every call runs through Vaaya. No per-vendor signup, API keys, or billing.
Part of a bigger ecosystem
These and hundreds more tools are reachable through Vaaya.
Run this workflow from your agent.
Connect your agent, review the services in this workflow, and set a budget before you start.
npx @vaaya/mcp install
Related workflows