Skip to content
You signed in with another tab or window. to refresh your session.
You signed out in another tab or window. to refresh your session.
You switched accounts on another tab or window. to refresh your session.
👁 BIG LOCAL NEWS
It’s too hard for local journalists to access public records about policing, public health, government and other vital topics.
From its base at Stanford University, Big Local News gathers data, builds tools and collaborates with reporters to produce journalism that makes an impact. Its website at biglocalnews.org offers a free archiving service for journalists to store and share data.
Staff
Members of our team on GitHub
Open-source software
🔢 Data scraping
Repositories that gather public records from the web.
🧮 Data analysis
Code that uses data to conduct an investigation
🌎 biglocalnews.org
Tools that connect to our platform at biglocalnews.org
Popular repositories
Loading
-
Scrapers for U.S. county court sites.
Python
79
20
-
Tools for downloading agendas, minutes and other documents produced by local government
Python
64
23
-
Command-line interface for downloading WARN Act notices of qualified plant closings and mass layoffs from state government websites
Python
41
17
-
A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.
Python
19
1
-
US Addresses Sampler
Svelte
12
-
Scraper library and CLI tool to harvest police bodycam footage and other files as part of the Community Law Enforcement Accountability Project (CLEAN)
Python
10
10
Repositories
Showing 10 of 37 repositories
-
warn-github-flow
Public
GitHub Action workflow for automating a WARN Act notice ETL pipeline
-
usc-crime-reports-scraper
Public
A GitHub Action workflow for automating the collection of crime and fire logs posted by the University of Southern California's Department of Public Safety.
Jupyter Notebook
1
MIT
1
1
0
Updated
-
warn-scraper
Public
Command-line interface for downloading WARN Act notices of qualified plant closings and mass layoffs from state government websites
-
Python
7
Apache-2.0
5
11
1
Updated
-
warn-transformer
Public
Consolidate, enrich and republish the data gathered by warn-scraper
-
civic-scraper
Public
Tools for downloading agendas, minutes and other documents produced by local government
-
clean-scraper
Public
Scraper library and CLI tool to harvest police bodycam footage and other files as part of the Community Law Enforcement Accountability Project (CLEAN)
Python
10
Apache-2.0
10
22
5
Updated
-
ice-data
Public
Big Local News deportation data project sharing site
-
sync-fed-contracts
Public
Download U.S. government contract cancelations for convenience from FPDS; sync with Big Local News
-
upload-files
Public
Upload comma-delimited files to biglocalnews.org in your GitHub Action
Python
3
Apache-2.0
1
0
0
Updated
You can’t perform that action at this time.
