The gold standard of web scraping now speaks MCP

Introducing the Import.io Web Scraper MCP: years of enterprise extraction, one endpoint, any AI.

Web scraping has been an arms race for twenty years. Pages went dynamic. Sites learned to spot bots. Captchas arrived, then got smarter. Content started changing depending on which country asked for it. Every year the web gets better at hiding, and every year someone has to get better at reading it anyway.

For fourteen years, that someone has been Import.io. Our engine pulls data from the websites that defend hardest, for enterprise data teams and some of the world's largest retailers, through every generation of anti-bot technology the web has produced.

Today we're handing that engine to your AI.

The Import.io Web Scraper MCP is a hosted server built on the Model Context Protocol, the open standard that lets AI tools discover and call external tools. Connect Claude, ChatGPT, Cursor, Windsurf, VS Code or any other MCP client to one endpoint, and your agent gets what took us fourteen years to build: managed browsers, proxy routing from data center to residential, captcha handling, country targeting, and extraction that returns fields instead of pages. We run the engine. You just connect.

Key takeaways

  • The Import.io Web Scraper MCP puts fourteen years of enterprise web extraction behind a single Model Context Protocol endpoint, so Claude, ChatGPT, Cursor, Windsurf, VS Code and other MCP clients can pull structured data without anyone building or hosting a scraper.
  • Browsing and scraping are different jobs. Built-in AI browsing reads a page or two of loose text, while the MCP renders each page in a managed browser, routes through data center and residential proxies, handles captchas, and returns only the fields you asked for.
  • Location changes the answer, so the MCP lets an agent name a country and get back data that reflects that market's prices, stock and content.
  • Field-level extraction keeps token cost flat. The agent describes the fields it needs and gets structured JSON back, which keeps the signal clean and the context small instead of feeding whole pages into the model.
  • Pricing is usage based and starts free. The first 10,000 successful calls cost nothing with no payment method, then it is a flat $0.0002 per successful call, so a million successful calls comes to $200, and blocked or failed calls are never billed.

Why can't my AI just browse the web?

Because browsing was never scraping. Three problems separate them, and agents hit all three on day one.

Modern sites need a browser. Most pages worth scraping render with JavaScript, load content as you scroll, or show data only after interaction. A plain fetch returns an empty shell. The MCP renders every page in a managed browser before anything gets extracted.

Location changes the answer. Prices, stock and content shift by country. An agent asking from the wrong place gets the wrong data. With the MCP, your agent names the country and the result reflects the market that matters.

Raw pages waste model context. Feeding whole pages into a model burns tokens and buries the signal. The MCP returns only the fields your agent asked for, as structured data it can use immediately.

Built-in browsing reads a page or two and hands back messy text. That's fine for looking something up. It collapses the moment you need data, at volume, in structure, from sites that fight back.

Built-in AI browsing vs the Import.io Web Scraper MCP

What matters Built-in AI browsing Import.io Web Scraper MCP
Dynamic, JavaScript pages Often returns an empty shell Renders every page in a managed browser before extracting
Anti-bot, Cloudflare, captchas Blocked quickly Proxy routing from data center to residential, with captcha handling built in
Location of the request Reflects the agent's default location Name a country and get that market's prices, stock and content
What comes back Loose text or raw HTML Structured JSON with only the fields you asked for
Token cost Whole pages burn tokens and bury the signal Field-level extraction keeps token cost flat
Working at volume Fine for a page or two Built for volume across sites that defend hard
Setup and hosting Built into the client One hosted endpoint, nothing to install or run

What does it do?

Three core tools carry the work. importio_render loads any page through the engine, fully executed, dynamic content present. importio_extract_data returns structured data containing only the fields you asked for. importio_get_html hands over the full page when you want to parse it yourself. Around them sits a complete set of browser actions - clicks, form input, scrolling, pagination, screenshots, captcha handling, so your agent can work a site the way a person would, then extract like a machine.

In practice, you point your agent at a page and say what you want:

"Load this product page as seen from Germany and return name, price, currency, and availability as JSON."

The answer comes back shaped like this:

JSON
name "…"
price 149.00
currency "EUR"
in_stock true

No HTML. No boilerplate. No cleanup step. The difference between browsing and extraction, in four lines.

Because it speaks the Model Context Protocol, it works with every MCP-compatible client, the ones named above and anything else built on the standard.

How is this different from other scraping MCPs?

Most scraping MCPs are new tools meeting old problems. This is the opposite: an engine that has already survived the web's defenses, now speaking a new protocol.

Anti-bot capability isn't a feature you ship. It's a war you've either fought or you haven't. Every proxy strategy, every captcha workflow, every rendering trick in this engine exists because a website, somewhere, stopped an enterprise data pipeline and we had to get it moving again. New scraping tools will learn those lessons one blocked request at a time. Ours came pre-paid.

How do I connect it?

Add the hosted endpoint to your client:

https://mcp.import.io/mcp

Most clients open the sign-in flow automatically; clients that use bearer tokens take an Import.io API key in the authorization header. Two minutes, nothing to install, nothing to host. A one-click Claude plugin install is on the way.

Then ask for data in plain language: point the agent at a page, say what you want, get structure back.

What does it cost?

Your first 10,000 successful calls are free. No payment method, no configuration, no commitment - sign up, connect, scrape.

After that, a flat $0.0002 per successful tool call, billed monthly. Only calls that work are billed: setup requests, malformed requests, blocked requests and failed upstream calls cost nothing. You pay for results, not attempts. A million successful calls is $200.

That shape is deliberate. Agent workloads are spiky and experimental, and you shouldn't have to guess your volume or buy a subscription to find out. Test free, pay per result, scale when it works.

Get started

The web has spent twenty years learning to keep automated readers out. Your AI now arrives with fourteen years of experience getting in, legitimately, at scale, for public data. Connect a client, spend your free calls on the sites you actually care about, and see what an agent can do when the web stops being the hard part.

Frequently asked questions about web scraping with AI agents

What is the difference between an AI agent browsing the web and web scraping?

Browsing usually reads one or two pages and hands back loose text, which works for a quick look. Web scraping renders pages properly, works around blocks, and returns clean structured records at volume, which is what data teams rely on.

Read web scraping explained →

Which web scraping techniques work on sites that block bots?

Reliable collection on defended sites combines managed browsers that execute JavaScript, proxy rotation from data center to residential addresses, captcha handling, and extraction that adapts when a site changes its layout.

See modern web scraping techniques →

Why does the location of a request change the data you collect?

Many retailers show different prices, stock levels, and content depending on the visitor's country. Collecting from the wrong location returns numbers that never match the market a team is actually watching.

Read about competitive price monitoring →

What is web scraping as a service?

Web scraping as a service means a provider runs the browsers, proxies, and extraction logic for you and delivers structured data on a schedule, so your team consumes clean records instead of maintaining scrapers.

Explore web scraping as a service →

When should a team use managed web data delivery?

Managed delivery fits teams that need many sources refreshed often, validated, and kept running as websites change, without spending engineering time on constant maintenance.

Learn about managed services →

How is structured web data used for pricing decisions?

Pricing teams use structured price, promotion, and availability data to watch competitors, protect margins, and react quickly when the market moves.

Read about pricing intelligence tools →

How does AI turn raw web data into decisions?

AI helps structure messy pages, match products across retailers, and flag meaningful changes in price and availability, which shortens the path from collection to a decision someone can act on.

Read how AI is changing pricing and digital shelf intelligence →

How do brands monitor their products across retailers?

Digital shelf monitoring tracks availability, content accuracy, ratings, search ranking, and pricing across the retailers and marketplaces where a brand sells, so issues get caught before they affect sales.

See digital shelf monitoring →
bg effect