The number of web pages on the internet is somewhere north of two billion, perhaps as many as double that. It's a huge amount of raw information. By comparison, there are only roughly 10,000 web APIs- ...

Web scraping can be an invaluable skill to possess when working on data-related projects because many interesting analytics projects often start not with over-explored internal data, but with the ...

[James Turk] has a novel approach to the problem of scraping web content in a structured way without needing to write the kind of page-specific code web scrapers usually have to deal with. How? Just ...

A new Y Combinator-backed startup called Kimono wants to make it easier to access data from the unstructured web with a point-and-click tool that can extract information from webpages that don’t have ...

For years, website owners have leveraged the federal Computer Fraud & Abuse Act (CFAA) as a tool to combat unauthorized scraping of data and other content from their websites. Due to a circuit court ...

In the aftermath of the Cambridge Analytica scandal, Facebook promised to investigate other apps with access to large amounts of user data. The app developer investigation is ongoing, but today, ...