Statistical price analysis
Model price elasticity or promotion frequency on live market data.
Fetch the Import.io extractor’s latest-run CSV with httr2 and read it with readr. Schedule the extractor and every script starts from fresh data.
library(httr2)
library(readr)
csv <- request(Sys.getenv("IMPORTIO_CSV_URL")) |>
req_perform() |>
resp_body_string()
prices <- read_csv(I(csv))
head(prices)Any public page, rendered, through managed proxies
Rendering, proxy routing, captcha handling, extraction
Latest successful run, CSV or JSON
Extractor results into a tibble with httr2 and readr.
Also connects via the REST API.
Model price elasticity or promotion frequency on live market data.
Quarto and R Markdown reports that re-read the latest run when they knit.
Collect web data for academic and journalistic work with a documented source.
install.packages(c("httr2", "readr")).IMPORTIO_CSV_URL.Yes. List runs with GET https://api.import.io/crawlruns/ and download one with /crawlruns/{id}/csv.
No. The latest-run CSV, JSON and Google Sheets endpoints return data your extractor already collected, so they don’t count toward your plan. Only the Live Query API runs an extraction per request.
As fresh as your schedule. Run the extractor hourly, daily or weekly and the endpoint always serves the latest successful run.
Pass your API key as the _apikey query parameter. Copy it from account settings at app.import.io.
Yes. The trial and Standard include rate-limited API access. Professional and Advanced include full API access and webhooks.
Latest-run data into a DataFrame in three lines.
Setup 5 minREST APIEndpointStart extractors, list runs and download results from api.import.io.
Setup 15 minEndpointREST APIFetch extractor results in Node with the built-in fetch.
Setup 5 minEndpointManagedWeb data in Tableau through Google Sheets or your warehouse.
Setup 10 min