The Developer Studio contains all of the tools necessary for building hardened, versioned, tested, enterprise-ready web data extractors and robots. Not only is Import.io’s award-winning, no-code application interface available for building web data extractors but the code+config WDI Dev Framework upon which it is built is available for direct development. One unified code library for Web Data Integration.
Developer Studio
Build robust, testable web data extractors and robots
WDI Dev Framework
Extractors interact dynamically with websites in search of target web pages. They then parse and structure the content that is available, including from open web APIs if present.
Turn your extractors into templates with common logic so that you can write web data extraction once and use anywhere. Extractors are instances of robots.
Extractors inherit logic from robots, which can also be extended for specific websites. Robots and extractors are modular and parameterized allowing for massive reuse.
Standardized schemas can be created and used across projects and organizations, allowing for increased dataset quality because best practices for data entities can be easily shared.
Develop locally and observe how extractors run in a local instance of Chrome. Use puppeteer syntax to develop and test robots and extractors written in the WDI Dev Framework.
Create unit tests from your saved extractions. Unit tests will run every time you deploy, allowing you to quickly tell if a change you have made negatively impacts other extracts.