← All integrations
Import.io + Amazon Redshift

Web data in Amazon Redshift

Import.io Managed Services delivers each run into your S3 bucket. One COPY command loads it into Redshift.

Connects via
S3 / SFTPManaged
Setup
15 min
Available on
S3 / SFTP: Professional and AdvancedManaged: Managed Services and Aperture
Talk to salesSee Managed Services
SQL
COPY web_data.competitor_prices
FROM 's3://your-bucket/importio/competitor-prices/'
IAM_ROLE 'arn:aws:iam::123456789012:role/RedshiftCopy'
FORMAT AS JSON 'auto'
TIMEFORMAT 'auto';

How it connects.

Source

The web

Any public page, rendered, through managed proxies

Engine

Import.io

Rendering, proxy routing, captcha handling, extraction

Path

File delivery

Each run into S3 or SFTP

Destination

Amazon Redshift

Files land in S3; COPY loads them into Redshift.

Also connects via managed delivery.

What teams do with it.

A web data schema in your warehouse

Competitor, catalog and review tables alongside your own.

Incremental loads

COPY each new delivery prefix on a schedule.

Spectrum for history

Query the full S3 archive without loading it.

Set it up.

  1. Set up S3 delivery (Professional and Advanced, or Managed Services).
  2. Create an IAM role Redshift can use to read the bucket.
  3. COPY the delivery prefix into your table.

Questions.

Can Import.io load Redshift directly?

The delivery lands in S3; Redshift loads from S3 with COPY. That keeps the load under your IAM policies.

Which plans include S3 and SFTP delivery?

Professional and Advanced. Managed Services deliver into S3, SFTP and every other supported destination on any contract.

Who sets up managed delivery?

Your Managed Services team. They agree destination, format, schedule and schema with you, then build, run, monitor and QA the feed under an SLA.

Which destinations can Managed Services deliver into?

Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, Snowflake, BigQuery, API, email and Slack alerts. Aperture delivers into the same destinations.

Related integrations.

All 50 integrations

ManagedEndpoint

Snowflake

Delivered into Snowflake by our team, or loaded with write_pandas.

Setup 15 minManagedEndpoint

BigQuery

NDJSON loads natively; managed delivery lands it for you.

Setup 10 minS3 / SFTPManaged

Databricks

Auto Loader picks up every delivery into a Delta table.

Setup 15 minS3 / SFTPManaged

Amazon S3

Every run delivered into your bucket, on schedule.

Setup 10 min

Fresh web data
in Amazon Redshift.

Talk to salesSee Managed Services