simonw Follow

Simon Willison simonw

Follow

3k followers · 133 following

Datasette
San Francisco, CA
https://simonwillison.net/
@simonw

Sponsors

Sponsoring

Achievements

Achievements

Highlights

Developer Program Member
5 discussions answered

Block or Report

Block or report simonw

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

simonw/README.md

Currently working on Datasette and associated projects. Read my blog or follow @simonw on Twitter.

Recent releases

datasette-hashed-urls 0.2 - 2022-03-16

datasette-publish-vercel 0.12.1 - 2022-03-15

shot-scraper 0.9 - 2022-03-14

image-diff 0.2.1 - 2022-03-11

sqlite-utils 3.25.1 - 2022-03-11

django-sql-dashboard 1.0.2 - 2022-03-08

geojson-to-sqlite 1.0 - 2022-03-04

xml-analyser 1.3 - 2022-03-01

More recent releases

On my blog

Instantly create a GitHub repository to take screenshots of a web page - 2022-03-14

Scraping web pages from the command line with shot-scraper - 2022-03-14

Weeknotes: Distracted by Playwright - 2022-03-12

shot-scraper: automated screenshots for documentation, built on Playwright - 2022-03-10

Why I invented "dash encoding", a new encoding scheme for URL paths - 2022-03-05

Weeknotes: Datasette Tutorials - 2022-02-27

More on simonwillison.net

TIL

Concatenating strings and newlines in Google Sheets - 2022-03-15

pytest coverage with context - 2022-03-05

Natural Earth in SpatiaLite and Datasette - 2022-03-04

Installing Python on macOS with the official Python installer - 2022-02-28

Running the latest SQLite in Datasette using Homebrew - 2022-02-28

More on til.simonwillison.net

Pinned

datasette Public

An open source multi-tool for exploring and publishing data

Python 5.9k 405
sqlite-utils Public

Python CLI utility and library for manipulating SQLite databases

Python 721 61
dogsheep/twitter-to-sqlite Public

Save data from Twitter to a SQLite database

Python 311 16
dogsheep/github-to-sqlite Public

Save data from GitHub to a SQLite database

Python 180 28
s3-credentials Public

A tool for creating credentials for accessing S3 buckets

Python 104 7
git-history Public

Tools for analyzing Git history using SQLite

Python 90 6

5,039 contributions in the last year

Learn how we count contributions

Less More

Activity overview

Contributed to CAVaccineInventory/vial, simonw/datasette, simonw/sqlite-utils and 5 other repositories

Contribution activity

March 2022

Created 197 commits in 25 repositories

Created 10 repositories

simonw/datasette-hashed-urls Python Mar 15
simonw/ijson Python Mar 15
simonw/simonwillison-net-shot Mar 14
simonw/scrape-hacker-news-by-domain JavaScript Mar 14
simonw/scrape-soe-wwd Roff Mar 13
simonw/shot-scraper-template Built by Mar 13
simonw/image-diff Python Mar 11
simonw/rure-python Rust Mar 11
simonw/shot-scraper-demo Mar 9
simonw/shot-scraper Python • Built by Mar 8

Created a pull request in simonw/datasette that received 7 comments

Use dash encoding for table names and row primary keys in URLs

Refs #1439. Build dash_encode / dash_decode functions Use dash encoding for row primary keys Use dash encoding for ?_next= pagination tokens U…

+183 −55 • 7 comments

Opened 2 other pull requests in 2 repositories

ICRAR/ijson 1 merged

Fix link to YAJL Mar 15

simonw/datasette 1 merged

Tilde encoding Mar 15

Reviewed 1 pull request in 1 repository

simonw/datasette 1 pull request

Tilde encoding Mar 15

Created an issue in simonw/shot-scraper that received 20 comments

Initial prototype

The initial prototype of this will involve a YAML file that defines multiple screenshots to be taken, and a GitHub Actions workflow that takes thos…

20 comments

Opened 77 other issues in 12 repositories

simonw/shot-scraper 33 closed 7 open

shot-scraper GitHub repository template implementation Mar 14
shot-scraper GitHub repository template Mar 14
Mechanism for polling for new scraping updates without restarting Chromium Mar 14
Do nothing if shots.yml contains no data Mar 13
Make output: optional in YAML Mar 13
Mechanism to accept JavaScript from a file or standard input Mar 13
Support returning output from evaluated JavaScript, including as status code Mar 13
Support local files for pdf and accessibility as well Mar 13
Idea: JavaScript macros in the YAML file Mar 13
--devtools option for opening browser devtools Mar 12
Support retina mode for screenshots Mar 12
Don't write binary to terminal by default Mar 12
shot-scraper shot --interactive Mar 12
Option for scripted authentication Mar 12
Extract examples from YAML into shell script Mar 12
Validate YAML mini-language using Pydantic Mar 12
YAML configuration for PDF shots Mar 12
More options for shot-scraper pdf Mar 12
shot-scraper accessibility -o option Mar 12
shot-scraper pdf command for taking a PDF screenshot Mar 12
Add --javascript option to shot-scraper accessibility Mar 10
shot-scraper accessibility URL command for dumping accessibility tree Mar 10
Support taking a shot that boxes multiple selectors Mar 10
Add the Promise pattern to the docs Mar 10
if the CSS selector is used and the container is taller than the viewport, it seems to cut it Mar 10
Some issues not shown.

simonw/datasette 4 open 6 closed

simonw/datasette-hashed-urls 7 closed

Maybe use link rel=preload for the redirects Mar 16
Plugin setting to configure cache TTL Mar 16
Extend the explanation in the README Mar 15
Use cache header that is compatible with Vercel Mar 15
Use hyphen instead of underscore for compatibility with old hash URL mode Mar 15
Deploy and test a live demo Mar 15
Initial design Mar 15

simonw/datasette.io 2 open 4 closed

Use shot-scraper to create tutorial screenshots Mar 14
Search page is broken - 500/404 Mar 12
Speed up homepage with faster YouTube embed Mar 8
Add code of conduct Mar 7
Faceted tag search for plugins and tools Mar 4
Adjust heading levels in release notes to fit Mar 3

simonw/image-diff 1 open 3 closed

simonw/sqlite-utils 2 closed 1 open

I forgot to include the changelog in the 3.25.1 release Mar 11
Display autodoc type information more legibly Mar 11
Optional Pandas integration Mar 5

simonw/scrape-hacker-news-by-domain 2 closed

Days ago being recorded as num comments Mar 14
Tracking minutes/hours ago as number of comments Mar 14

simonw/datasette-publish-vercel 1 closed

Ensure ds.invoke_startup() runs on startup Mar 15

simonw/datasette-cluster-map 1 open

Pick up more name pairs, e.g. long,lat Mar 14

simonw/museums 1 closed

Twitter cards aren't displaying Mar 13

simonw/shot-scraper-demo 1 closed

Remove "5 hours ago" from owlsnearme.com demo to avoid tiny diffs Mar 12

simonw/datasette-psutil 1 closed

Move CI to GitHub Actions Mar 6

59 contributions in private repositories Mar 1 – Mar 15