Data & Developer Hub
![]() |
This page in a nutshell: This draft is a proposal to create a Developer Hub to house all Wikimedia developer community related content. (Discuss) |
Group: | Platform, UX, Analytics/Research and Data |
Start: | 2013-12 |
End: | |
Team: | Moiz Syed, Dario Taraborelli, Juliusz Gonera, Jared Zimmerman, Brad Jorsch |
Lead: | Sumana Harihareswara |
Status: | See updates |
In an effort to support transparency and dissemination of our knowledge base, the Wikimedia Foundation has developed a number of repositories of free and open datasets, as well as made its APIs freely available. However these APIs and their documentation are currently scattered across several projects, with no central location for people to learn about and build upon them.
Our proposal is for a central "Wikimedia Developer Hub", which will house all Wikimedia developer community related content. Once built, we propose to host the project on dev.wikimedia.org.
Contents
- 1 Goals
- 2 Areas of focus
- 3 Get involved
- 4 Structure
- 5 Requirements
- 6 Internal resources for developers
- 7 External examples
- 7.1 Data Sets
- 7.2 Developer hubs & API documentation
- 7.2.1 Programmable Web
- 7.2.2 Twitter
- 7.2.3 Google
- 7.2.4 Facebook
- 7.2.5 Evernote
- 7.2.6 LinkedIn
- 7.2.7 GitHub
- 7.2.8 Amazon
- 7.2.9 Dropbox
- 7.2.10 Instagram
- 7.2.11 Stripe
- 7.2.12 Paypal
- 7.2.13 Tumblr
- 7.2.14 Last.fm
- 7.2.15 Twillio
- 7.2.16 Vimeo
- 7.2.17 Pinterest
- 7.2.18 The Guardian
- 7.2.19 New York Times
- 7.2.20 Mendeley
- 7.2.21 Flickr
- 7.3 Best in Class human readable API documentation
- 7.4 Sandbox Examples
- 8 Project status
Goals[edit | edit source]
- To inspire developers everywhere to build new things using data available from Wikimedia projects.
- To be the central resource where developers can find a way to contribute to Wikimedia projects and build new things on top of the Wikimedia data.
- To be a friendly and inviting sandbox environment where new and experienced developers can try out different Wikimedia APIs.
Areas of focus[edit | edit source]
- Project showcase, examples
- Sandbox & widgets
- Data sets
- OAuth
- APIs
- Documentation
- Related news and announcements
- Community Help
Get involved[edit | edit source]
- GitHub Repo: https://github.com/jgonera/wddh (temporary)
- Prototype: http://juliuszgonera.com/wddh/ (temporary)
- IRC channel: irc://irc.freenode.net/wikimedia-ddh
- Live notes: https://etherpad.wikimedia.org/p/wddh
Structure[edit | edit source]
The hub as currently proposed would be divided into three sections:
- "Inspire": where cool projects are showcased; links to more detailed project description pages
- "Explore": where users can play with the API in a functional sandbox
- "Build": where all the static official documentation and pointers to data sets reside
Requirements[edit | edit source]
Inspire[edit | edit source]
- A curated collection of projects created using data from Wikimedia projects.
- Means of submitting a project to be considered for showcase.
Build[edit | edit source]
- Documentation at different technical levels.
- An organized list of APIs and datasets available.
Community[edit | edit source]
- Way of requesting new datasets and/or APIs.
- Related news, features, and announcements.
- A way for the community to get in touch with WMF folks for help on projects.
Internal resources for developers[edit | edit source]
The following is a list of resources housed across multiple locations to help developers build using Wikimedia data. Feel free to add to the list below.
Documentation[edit | edit source]
- https://www.mediawiki.org/wiki/API
- /w/api.php output (self-documenting MediaWiki entry point on every wiki)
- https://meta.wikimedia.org/wiki/Research:Data
- https://meta.wikimedia.org/wiki/Research:Data#API
- http://gdash.wikimedia.org/
- https://www.mediawiki.org/wiki/How_to_contribute
- https://www.mediawiki.org/wiki/API:Client_code/Gold_standard (best practices for web API client library development)
- https://doc.wikimedia.org/ (automatically-generated PHP, JavaScript and CSS documentation)
- CSS documentation currently at http://tools.wmflabs.org/styleguide/
API Sandbox[edit | edit source]
- https://www.mediawiki.org/wiki/Extension:ApiSandbox
- https://en.wikipedia.org/wiki/Special:ApiSandbox
- https://www.wikidata.org/wiki/Special:ApiSandbox
Existing APIs[edit | edit source]
- rcStream API (new)
- Content API (new)
- Flow API
- Echo API
- GeoData API
- Parsoid API
- Wikidata API
- Upload API
- Commons API
- Mediawiki API
- Mobile (content) API
- Language API
- Account Creation API (new)
Other Internal(ish) Projects[edit | edit source]
- http://stats.wikimedia.org/EN/TablesWikipediaEN.htm#editdistribution
- http://infodisiac.com/
- http://seealso.org/
- API:Client code (third-party client libraries for the MediaWiki web API)
- API:Client code/Evaluations Features, maintenance status, documentation.
External examples[edit | edit source]
Data Sets[edit | edit source]
- https://www.quora.com/Data/Where-can-I-find-large-datasets-open-to-the-public (big list)
- http://www.reddit.com/r/datasets (another big list)
- https://www.google.com/publicdata/directory
- http://www.findthedata.org/
- http://www.data.gov/
- http://data.gov.uk/
- https://www.opensciencedatacloud.org/publicdata/
- http://www.pewinternet.org/datasets/
- https://nycopendata.socrata.com/
- http://www.quandl.com/
Developer hubs & API documentation[edit | edit source]
Programmable Web[edit | edit source]
Twitter[edit | edit source]
- https://engineering.twitter.com/
- http://twitter.github.io/
- https://dev.twitter.com/
- https://dev.twitter.com/docs
- https://dev.twitter.com/docs/api/1.1
- https://dev.twitter.com/docs/streaming-apis
Google[edit | edit source]
- http://developers.google.com
- https://developers.google.com/products/
- http://developers.google.com/apis-explorer/
- https://developers.google.com/oauthplayground/
- https://developers.google.com/maps/
- http://www.google.com/drive/apps.html#fusiontables
Facebook[edit | edit source]
- https://developers.facebook.com/
- https://developers.facebook.com/docs/
- https://developers.facebook.com/docs/graph-api/
- https://developers.facebook.com/docs/reference/apis/
Evernote[edit | edit source]
- http://dev.evernote.com/
- http://dev.evernote.com/doc/
- http://dev.evernote.com/doc/reference/
- http://dev.evernote.com/doc/articles/authentication.php
LinkedIn[edit | edit source]
- https://developer.linkedin.com/
- https://developer.linkedin.com/documents/authentication
- https://developer.linkedin.com/rest
GitHub[edit | edit source]
Amazon[edit | edit source]
Dropbox[edit | edit source]
- https://www.dropbox.com/developers
- https://www.dropbox.com/developers/sync
- https://www.dropbox.com/developers/datastore
- https://www.dropbox.com/developers/core
- https://www.dropbox.com/developers/dropins/chooser/js
- https://www.dropbox.com/developers/dropins/saver
Instagram[edit | edit source]
Stripe[edit | edit source]
Paypal[edit | edit source]
- https://developer.paypal.com/
- https://developer.paypal.com/docs/
- https://developer.paypal.com/docs/api/
Tumblr[edit | edit source]
Last.fm[edit | edit source]
Twillio[edit | edit source]
- https://www.twilio.com/
- https://www.twilio.com/docs
- https://www.twilio.com/docs/api
- https://www.twilio.com/docs/quickstart
Vimeo[edit | edit source]
Pinterest[edit | edit source]
The Guardian[edit | edit source]
New York Times[edit | edit source]
Mendeley[edit | edit source]
Flickr[edit | edit source]
- https://www.flickr.com/services/api/
- https://www.flickr.com/services/developer/
- https://www.flickr.com/services/apps/about/
- https://www.flickr.com/services/apps/create/
Best in Class human readable API documentation[edit | edit source]
Open Street Maps (writing style , but not layout or design)