← All integrations
Import.io + Google Cloud Storage

Web data delivered into Google Cloud Storage

Managed Services deliver each feed into your bucket on schedule. On self-service plans, a small Cloud Run function on the webhook does the same.

Connects via
ManagedWebhook
Setup
10 min
Available on
Managed: Managed Services and ApertureWebhooks: every plan
Talk to salesSee Managed Services
Paths
Managed       Import.io Managed Services → gs://your-bucket/importio/…
Self-service  Extractor webhook → Cloud Run function → gs://your-bucket/importio/latest.ndjson

How it connects.

Source

The web

Any public page, rendered, through managed proxies

Engine

Import.io

Rendering, proxy routing, captcha handling, extraction

Path

Managed delivery

Built, run and QA’d under an SLA

Destination

Google Cloud Storage

Managed delivery into your GCS bucket, ready for BigQuery.

Also connects via webhooks.

What teams do with it.

BigQuery external tables

Query deliveries in place or load them on arrival.

Vertex AI pipelines

Training and evaluation data staged where your pipelines read.

Cross-team sharing

Grant bucket access instead of copying files around.

Set it up.

  1. Create a bucket for Import.io deliveries.
  2. Managed: share the bucket details with your Import.io team.
  3. Self-service: deploy the Cloud Run function from the Google Cloud guide as the extractor’s webhook.

Questions.

Can we get BigQuery tables instead of files?

Yes. Managed Services deliver directly into BigQuery as well.

Who sets up managed delivery?

Your Managed Services team. They agree destination, format, schedule and schema with you, then build, run, monitor and QA the feed under an SLA.

Which destinations can Managed Services deliver into?

Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, Snowflake, BigQuery, API, email and Slack alerts. Aperture delivers into the same destinations.

When does the webhook fire?

Every time a crawl run finishes successfully. Import.io POSTs to your URL with the extractor ID, total URL count and links to the run’s JSON, CSV and Excel outputs. You can view a sample payload in the extractor’s settings.

How do I secure the webhook?

Webhooks accept custom headers. Add a shared-secret header in the extractor’s webhook settings and reject any request that doesn’t carry it.

Related integrations.

All 50 integrations

S3 / SFTPManaged

Amazon S3

Every run delivered into your bucket, on schedule.

Setup 10 minManaged

Azure Blob Storage

Managed delivery into your Azure storage account.

Set up at onboardingS3 / SFTPManaged

SFTP

Files on your server, for systems that read from a drop folder.

Setup 10 minManagedEndpoint

BigQuery

NDJSON loads natively; managed delivery lands it for you.

Setup 10 min

Fresh web data
in Google Cloud Storage.

Talk to salesSee Managed Services