Today’s webinar is a really exciting one because I am joined by none other than Caspar from Silk.co. Silk is a data publishing platform which helps you visualize data in a fun and unique way. Together we’re going to be analysing the San Francisco housing market - a place I’d love to move (hint, hint import).Read More
What is grey literature?
Typically when policy-makers and practitioners need to understand how something works, for example a painkiller or a particular method of conserving an endangered species, they would commission a piece of research to investigate and provide an answer. This research can be very time-consuming and expensive, and would likely just be one case study. I work in an area of research called secondary synthesis. Essentially this means getting the most out of research we already have, rather than commissioning new research. By looking at what has already been done and published we can combine lots of smaller studies into one large experiment, using data that exists in research articles.Read More
This morning a stumbled across Tagul, an online word cloud creation tool which has a couple of really cool features. The first, is you can upload your own image for it to put your words in (I obviously immediately uploaded our pink owl - Owen). The second is that you can put in a URL for it to pull the words off of.Read More
Those regular blog readers among you will remember my previous batch search webinar in which I showed you how to use the Google Sheet I created to upload a lot of URLs (or search terms) into an extractor (or connector). It was an extremely popular post and I got lots of comments and questions about it. Well, there is now….a NEW version!
I’ve updated the spreadsheet to include some of the feedback I received and generally improve the sheet’s performance. So, let me introduce you to Batch Search v0.3.5…Read More
Crawling can be a bit of a mystery if you're not familiar with the principle. I've done a few (rather long) full "How to Crawl" tutorials, but to keep things simple; here are the 5 questions you should ask yourself while building a crawler...
Do I need to crawl in the first place?
Is the data you need dispersed across more than 10 pages? If not, then the crawler tool probably isn’t the one for you. In that case, it would be far more efficient to use our extractor tool and simply add the URLs you need to get the data from with in your dataset page.Read More
I’ll be the first to admit that data sets aren’t exactly the most exciting things to look at. They’re great for running analysis on, but spotting trends and patterns can be pretty difficult when everything is just lined up in rows and columns. Which is why data visualization tools are so important! Now, we’re not trying to reinvent the wheel over here at import (we’ll probably never make a viz tool), but we realize that getting the data is only half the story. So, we’ve set up a direct line to the guys over at Plot.ly (a web-based graphing platform), to let you send your data straight into an awesome viz. In this webinar, I’m going to give you an overview of how it works...Read More
Yesterday (January 19th) I went down to the headquarters of the Guardian newspaper to give a joint masterclass on how to use import.io alongside Sophie Sparkes, data analyst at Tableau public, who spoke about using the data I’d extracted to create an awesome visualisation.
The class was designed for anyone who is interested in web data, and therefore the skill level of the participants was extremely varied.
Given that, I decided there were 3 main points I wanted the audience to take away from the masterclass:
Why we extract data
What import.io does
How to do it
Hey guys! We are super excited to announce our first EVER partner integration!
Working with the team at Plot.ly in the week leading up to Christmas, we were able to put together a slick beta version of an integration that lets you send static data directly to Plot.ly’s awesome web-based graphing platform. Now that we’ve returned from Christmas and given it a little polish, we’re ready to hand it over to you guys!Read More
Silk’s CEO Salar al Khafaji was invited to attend the DLD confab this year. It's a great conference with entrepreneurs, scientists, and politician. Salar likes to organize his conference forays in advance and connect with people he hopes to meet for coffee or a chat. This isn’t as straightforward as it sounds. Often, the directories that conferences provider are static and hard to filter. This can make viewing speakers and figuring out who to contact cumbersome.Read More