Import.io User Guide

Scheduling your extractor


Use schedule your extractor to extract data from a website on a regular basis. Set up schedules to keep your database or application updated with the latest information to monitor changes in data over time or just because you systematically need to get data from the web. Results of a scheduled run appear in the Run history tab, just as manual runs do.

 

Note: Scheduling extractor runs is only available with paid subscriptions.

 

Note: To schedule a run using the API, refer to the Import.io API Reference.

 

To access the scheduler, perform the following steps:

  • On the dashboard, select the desired extractor.
  • Click the Settings tab.
  • Scroll down to Schedule your Extractor.

Setting the run frequency

Set your extractor to run on an hourly, daily, weekly, monthly, or custom basis, or to not run on a schedule at all..

Hourly

Set your schedule to Hourly to run your extractor at a certain minute of every hour.

Daily

Set your schedule to Daily to run your extractor every day at a certain time of the day.

Weekly

Set your schedule to Weekly to run your extractor every week at a certain time of a given day.

Monthly

Set your schedule to Monthly to run your extractor once a month at a certain date and time.

Advanced

Set your schedule to Advanced for custom control of the schedule, from months and days of the week up to the minute. For example,

  • Run every hour between 9am and 6pm on Monday, Wednesday, and Friday.
  • Run once a day during the months of Jan, Feb, and March.
  • Run three times a week at 9:00am.

Custom scheduling enables you to choose exactly when you wish to extract data.

 

Click the scheduler boxes to see legal syntax for the box and the results of your current customization settings.

 

The following examples demonstrate custom scheduling. An asterisk in a box indicates the extractor run every time that unit of time changes. For example, asterisk in every box instruct the extractor to run at every minute or every hour of every day of every week of every month.

Note: Import.io does not recommend using all asterisks because you will quickly exhaust your plan quota.

 

The following example demonstrates how to mimic a Daily schedule using Advanced schedule customization. To run only at 7:00 am each day, set the minute box to 0 and the hour box to 7, as shown in the following screenshot:

 

To run at 5:00 am and 7:00 am each day, set the minute box to 0 and the hour box to 5,7. Use commas to separate values, as shown in the following screenshot:

 

To run Mondays and Sundays in February at 5:00 and 7:00, use the following configuration:

 

Step values allow you to skip a time period. For example, start on Monday and run every other day, use the following configuration:

Setting Ranges

Ranges do not wrap. The following table indicates the necessary way to enter ranges:

Range

Range Edges    

Doesn’t Work     

Works

Days of week

Mon to Sun

Fri-Mon

Fri-Sun, Mon

Days of month    

1 to 31

20-5

20-31,1-5

Months

Jan to Dec

Nov-Apr

Nov-Dec, Jan-Apr