Those regular blog readers among you will remember my previous batch search webinar in which I showed you how to use the Google Sheet I created to upload a lot of URLs (or search terms) into an extractor (or connector). It was an extremely popular post and I got lots of comments and questions about it. Well, there is now….a NEW version!
I’ve updated the spreadsheet to include some of the feedback I received and generally improve the its performance. So, let me introduce you to Batch Search v0.3.5…
What is batch search?
First of all – for anyone who doesn’t know – a batch search is when you query multiple URLs at once. At the moment, in the current data set page, you can add multiple URLs to your Extractor, but you have to do it one at a time. Which, if you have 50 or 100 URLs can be a slow process.
Google Sheets to the rescue
Using my GS you can input many URLs at once and pass them through any import.io connector or extractor with just the press of a button.
Make a copy
In order to use the Batch Search sheet for yourself, you will first need to make a copy of it in your own Google Drive. Open this Google Sheet and click “File > Make a copy…”
You should now be able to edit the sheet.
Select your Extractor (or Connector)
Next you need to choose the extractor (or connector) that you want to pass URLs through. Simply head over to your My Data page, click the extractor you want and copy the corresponding URL – you can also use the GUID for that extractor (the part of the URL after “id=”).
Then, paste that URL into the source box in the GS and click “Get Source”. The GS will go and fetch all the relevant information for that extractor and display it below. Next, enter all the URLs (or search terms for Connectors) into column A starting in row 20 (one per line) and click “Get results”.
Note: The first time you use the sheet, Google should prompt you to allow the script
Once you click “Get results”, the GS will pass each or those URLs through the extractor you chose and display the corresponding data in a new tab on the GS.
Is there anything it can’t do?
Batch search is a pretty powerful tool, but it isn’t perfect! The script that Google runs will automatically time out after 6 minutes so if you upload a LOT of URLs it may time out.
Turn the web into data for free
Create your own datasets in minutes, no coding required
Powerful data extraction platform
Point and click interface
Export your data in any format
Unlimited queries and APIs