Editing Quality Assurance/Browser testing/Examples

Browser tests can identify problems at every level in ways that unit tests and integration tests cannot. Here are some examples of issues we have identified by way of failing browser tests that point to problems with a code mistake, how code manifested in a particular browser, and how the underlying environment itself was configured. 

A [https://github.com/wikimedia/qa-browsertests/blob/master/features/guided_tour.feature recent collaboration].  This is a great test, it's javascript-heavy and involves navigating through the application.  
* Paired with the E3 team on an acceptance test. 
* A little while later the test found [https://bugzilla.wikimedia.org/show_bug.cgi?id=45781 a pretty important bug]
** Note that E3 is actively testing this feature.  Browser tests find bugs when humans aren't looking
** We have video of all of our test runs.  [https://saucelabs.com/jobs/076ed6588f314cfea816f4d70f2fe826 This one] clearly shows the error.

An [https://github.com/wikimedia/qa-browsertests/blob/master/features/aftv5.feature older test] 
* This particular feature worked correctly [https://bugzilla.wikimedia.org/show_bug.cgi?id=42551 in every browser except for IE9]  

A [https://github.com/wikimedia/qa-browsertests/blob/master/features/math.feature simple test that found a configuration bug] unrelated to software.
* After the EQIAD data center migration this test discovered that the "texvc" library had not been migrated to the new data center.

A [https://github.com/wikimedia/qa-browsertests/blob/master/features/accept_language.feature recent collaboration] with some challenges:  
* Paired with Language team.  This test is in process, the way the browser determines whether the Serbian language is presented in Latin characters or Cyrillic characters is complicated. 
* We're telling the browser that we want Serbian in Latin characters, but the browser shows us pages in Serbian using Cyrillc characters

We have [https://github.com/wikimedia/mediawiki-extensions-MobileFrontend/tree/master/tests/acceptance/features Mobile browser tests] too
* They need some love