Competitor prices next to your sales
Join market prices with orders and margin in one query.
← All integrations
Import.io + Snowflake
Web data in Snowflake
Managed Services and Aperture deliver straight into Snowflake on your schedule. On self-service plans, load the latest run with the Snowflake Python connector.
Destination Snowflake share, or tables in your account
Built by your named Import.io team
Schedule hourly to monthly, your choice
Schema agreed up front, typed columns
QA checked before every delivery
Terms SLA with fees at riskimport io, os, requests
import pandas as pd
# "CSV from latest successful run" on the extractor's Integrate tab
csv = requests.get(os.environ["IMPORTIO_CSV_URL"]).content.decode("utf-8-sig")
df = pd.read_csv(io.StringIO(csv))
import snowflake.connector
from snowflake.connector.pandas_tools import write_pandas
conn = snowflake.connector.connect(
account=os.environ["SF_ACCOUNT"], user=os.environ["SF_USER"],
authenticator="SNOWFLAKE_JWT", private_key_file=os.environ["SF_KEY_PATH"],
warehouse="LOAD_WH", database="WEB_DATA", schema="RAW")
write_pandas(conn, df, "COMPETITOR_PRICES", auto_create_table=True)How it connects.
Source
The web
Any public page, rendered, through managed proxies
Engine
Import.io
Rendering, proxy routing, captcha handling, extraction
Path
Managed delivery
Built, run and QA’d under an SLA
Destination
Snowflake
Delivered into Snowflake by our team, or loaded with write_pandas.
Also connects via data endpoints.
What teams do with it.
A governed web data layer
Typed tables with a schema contract, refreshed under an SLA.
History for modeling
Every delivery appended, ready for elasticity and forecasting models.
Set it up.
- Managed: give your Import.io team the target database and schema; they deliver on schedule.
- Self-service:
pip install "snowflake-connector-python[pandas]" requests. - Read the latest-run CSV and call
write_pandas.
Questions.
Can Import.io share data into our account?
Yes. Managed Services and Aperture deliver into Snowflake, including by share, so the data appears in your account without a pipeline to run.
Who sets up managed delivery?
Your Managed Services team. They agree destination, format, schedule and schema with you, then build, run, monitor and QA the feed under an SLA.
Which destinations can Managed Services deliver into?
Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, Snowflake, BigQuery, API, email and Slack alerts. Aperture delivers into the same destinations.
Do endpoint downloads count as queries?
No. The latest-run CSV, JSON and Google Sheets endpoints return data your extractor already collected, so they don’t count toward your plan. Only the Live Query API runs an extraction per request.
How fresh is the data?
As fresh as your schedule. Run the extractor hourly, daily or weekly and the endpoint always serves the latest successful run.
Related integrations.
ManagedEndpoint
BigQuery
NDJSON loads natively; managed delivery lands it for you.
Setup 10 minS3 / SFTPManagedDatabricks
Auto Loader picks up every delivery into a Delta table.
Setup 15 minS3 / SFTPManagedAmazon Redshift
Files land in S3; COPY loads them into Redshift.
Setup 15 minEndpointManagedTableau
Web data in Tableau through Google Sheets or your warehouse.
Setup 10 min