← All integrations
Import.io + Amazon S3

Web data delivered into Amazon S3

Each run lands in your bucket as files, on the extractor’s schedule. Self-service on Professional and Advanced; fully managed on any Managed Services contract.

Connects via
S3 / SFTPManaged
Setup
10 min
Available on
S3 / SFTP: Professional and AdvancedManaged: Managed Services and Aperture
Start free trialTalk to sales
IAM policy
{
  "Version": "2012-10-17",
  "Statement": [{
    "Effect": "Allow",
    "Action": ["s3:PutObject"],
    "Resource": "arn:aws:s3:::your-bucket/importio/*"
  }]
}

How it connects.

Source

The web

Any public page, rendered, through managed proxies

Engine

Import.io

Rendering, proxy routing, captcha handling, extraction

Path

File delivery

Each run into S3 or SFTP

Destination

Amazon S3

Every run delivered into your bucket, on schedule.

Also connects via managed delivery.

What teams do with it.

A landing zone for the lake

Glue, Athena, Redshift and Databricks read straight from the prefix.

An archive of every run

Keep every delivery for audit and backtesting.

Event-driven processing

S3 event notifications start Lambda or Step Functions on each new file.

Set it up.

  1. Create a bucket and a prefix for Import.io deliveries.
  2. Issue credentials that can only write to that prefix.
  3. Add S3 as the extractor’s delivery destination, or give the details to your Managed Services team.

Questions.

Which plans include S3?

Professional and Advanced self-service plans, and every Managed Services contract.

Which plans include S3 and SFTP delivery?

Professional and Advanced. Managed Services deliver into S3, SFTP and every other supported destination on any contract.

Who sets up managed delivery?

Your Managed Services team. They agree destination, format, schedule and schema with you, then build, run, monitor and QA the feed under an SLA.

Which destinations can Managed Services deliver into?

Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, Snowflake, BigQuery, API, email and Slack alerts. Aperture delivers into the same destinations.

Related integrations.

All 50 integrations

Managed

Azure Blob Storage

Managed delivery into your Azure storage account.

Set up at onboardingManagedWebhook

Google Cloud Storage

Managed delivery into your GCS bucket, ready for BigQuery.

Setup 10 minS3 / SFTPManaged

SFTP

Files on your server, for systems that read from a drop folder.

Setup 10 minS3 / SFTPManaged

Amazon Redshift

Files land in S3; COPY loads them into Redshift.

Setup 15 min

Fresh web data
in Amazon S3.

Start free trialTalk to sales