Site performance and architecture

Wikimedia engineering activity

Site performance and architecture

Various initiatives geared toward improving site responsiveness, decreasing resource consumption, and/or improving site maintainability

Group:	Platform
Start:
End:
Team:	Ori Livneh, Aaron Schulz, Antoine Musso, Andrew Garrett
Lead:	Tim Starling
Status:	See updates

Status

[edit status] • [add new]

2014-05-monthly:

Aaron Schulz has been reviewing the Petition extension for deployment to the cluster, working with Peter Coombe to improve its performance. In addition, the reliability and speed of media uploads was increased by removing many failure cases on Commons. There were many other minor fixes over the course of the month.

Rationale

Many small architectural changes and improvements are being done all of the time without a lot of fanfare. This is a general activity area where we communicate changes made along these lines.

Roadmap

April-June 2013

• JobQueue improvements
• Eqiad migration wrapup
  • Migrate fenari to tin.eqiad.wmnet
  • Migration to Ceph - still running sync scripts, possible split-brain issues with memcache
  • Migrate hume to terbium.eqiad.wmnet

July-September 2013

punt

October-December 2013

• New deployment system (replacing scap)
• Caching improvements
  • bug 46770 - Rewrite jobs-loop.sh in a proper programming language
  • bug 27935 - Redirect to canonical encoding
  • bug 22390 - When a commons image is updated, update the pages that use it
  • bug 17577 - Include version in thumbnail URL
  • bug 5382 - Queue refreshLinks jobs on template deletion
  • bug 48835 - Separate Cache-Control header for proxy and client
• bug 15583 - Enable importing across all Wikimedia projects
• bug 47490 - resetUserTokens.php not usable on large wikis

January-March 2014

• HipHop
  • Implement Lua extension
  • Develop prodution configuration