vaaya / workflows / Search & scrape the internet

Search & scrape the internet

Search for sources, read pages, crawl a site, or extract structured data. Your agent can use a hosted browser when a task needs clicks or other page interactions.

What you get

  • Semantic search across the live web, plus clean content pulled from any source page.
  • Whole sites crawled and turned into structured JSON against your schema.
  • A real browser drives through sites with no API when one fights back.

Start with a prompt

Copy one of these prompts into Claude, Cursor, ChatGPT, or another agent connected to Vaaya.

Simple

Use Vaaya to search the web for the top project-management tools and give me a clean list with pricing.

Detailed

Use Vaaya to crawl competitor.com, pull every pricing tier and feature into a JSON table against this schema, and for pages that block scrapers, drive a real browser to read them.

You can also try the prompt in Vaaya chat. It uses the same account and tools, with nothing to install.

Tools this workflow uses

Every call runs through Vaaya. No per-vendor signup, API keys, or billing.

Exa Firecrawl Browserbase

Part of a bigger ecosystem

These and hundreds more tools are reachable through Vaaya.

Run this workflow from your agent.

Connect your agent, review the services in this workflow, and set a budget before you start.

npx @vaaya/mcp install

Related workflows