scraping/etc. open data in R
Scott Chamberlain (
@sckottie
/
@ropensci
)
UC Berkeley / rOpenSci
scotttalks.info/oddpdx
exploring
data . gov is on CKAN
Wikipedia clients
WikipediaR
wikipediatrend
WikidataR
WikidataQueryServiceR
WikipediR
WikiSocio
http
the clients
curl
RCurl
crul
httr
request
async
scraping
scraping: parsing data DIY
html =>
xml2
xml =>
xml2
json =>
jsonlite
csv/tsv/etc =>
readr
/
data.table::fread
ftp
ftp - can totally use http clients
if you want something specific to ftp ...
demos!
steven bedrick's
python demo
from yesterday:
code
code + text
pretty output
scotttalks.info/oddpdx
Made w/:
reveal.js v3.2.0
Some Styling:
Bootstrap v3.3.5
Icons by:
FontAwesome v4.4.0