User Guide User Guide

Welcome to the User Guide. This user guide describes how you can utilize the SaaS product to transform the web into data. extractors enable you to obtain information from thousands of pages or a single page. Using a straightforward point-and-click interface, enables anyone to transform the web into data.

This user guide covers how to fully use, from creating your first extractor, to how to manage your account, to using our online dashboard.

The following list outlines the typical scenario for using

  1. Start on the dashboard to create an extractor using a single URL and select the data you want from the first page the editor displays.
  2. Provide a few similar pages from the same website to the editor as training URLs to teach your extractor how to extract data from that website.
  3. Save your extractor, return to the dashboard, and perform a test run of the extractor.
  4. Add multiple URLs to the extractor from the dashboard Settings tab and set up a schedule to run your extractor.

The user guide consists of the following chapters:

Chapter 1. Getting Started

This chapter gives a general introduction to our software, including what is, examples of what can be extracted, some terminology specific to, our FAQ, instructions for creating an account and creating new extractors, the layout of the online dashboard, and a tutorial to get you started that helps you to easily create and run your first extractor.

Chapter 2. Editing and Training Extractors

This chapter covers editing and training your extractors using the editor. Subjects covered are managing columns, selecting data from a website, managing data within columns, and adding training URLs.

Chapter 3. Managing and Running Extractors

This chapter covers how to utilize the online dashboard to manage and run your extractors. Subjects covered are adding multiple URLs so you can run your extractors, receive email notifications, and view change reports when runs complete, how to access your run history, which shows key information about your extractor runs and how to schedule extractor runs so they run when you want them to, and how to download your data.

Chapter 4. Best Practices, Tips, and Tricks

This chapter covers how to resolve common issues that occur. For example, resolving issues with infinite scrolling websites, hidden elements on webpages, and even getting data from behind a login. The chapter provides a chaining tutorial that uses one extractor to collect links (for example, product search results) and passes the links to a second extractor to capture the details.

Chapter 5. Accessing the API

This chapter introduces the API, covering how to locate your API key and extractor GUIDs, JSON-formatted API responses, API endpoints, and using API requests to retrieve an extractor’s name, details, and list of URLs.

Chapter 6. Integrating with Third-Party Products

This chapter covers using the API to integrate your data with other programs across the web. For example, Google Sheets, Tableau, and Zapier.

Chapter 7. Managing your Account

This chapter provides information on managing your account and subscription and billing details.

Chapter 8. Troubleshooting

This chapter provides runtime error messages, log file codes, and tips for extractor runs that fail to execute.