Difference between revisions of "Test Triage and Intermittent Test techniques"
From CitconWiki
Jump to navigationJump to search (Created page with "Attendance * Tyler @macetw * Emil * @RobPark ==Test Triage Techniques== Often tests appear without clear reason, many commits into a single build. Unreliable machines or fram...") |
|||
| Line 6: | Line 6: | ||
==Test Triage Techniques== | ==Test Triage Techniques== | ||
Often tests appear without clear reason, many commits into a single build. Unreliable machines or frameworks, how do we respond? | Often tests appear without clear reason, many commits into a single build. Unreliable machines or frameworks, how do we respond? | ||
| + | |||
| + | Problems: | ||
| + | * Not enough information in the log | ||
| + | |||
| + | Smoke test: | ||
| + | * Impose a time limit on a smoke test | ||
| + | |||
| + | 1 team might be dedicated to triaging | ||
| + | * Build sheriff | ||
| + | * Assign person responsible | ||
| + | * File ticket | ||
| + | |||
| + | Assumed: Does everyone care that a build is red? Is a build/test cycle easy enough to reproduce? | ||
Revision as of 08:39, 24 August 2013
Attendance
- Tyler @macetw
- Emil
- @RobPark
Test Triage Techniques
Often tests appear without clear reason, many commits into a single build. Unreliable machines or frameworks, how do we respond?
Problems:
- Not enough information in the log
Smoke test:
- Impose a time limit on a smoke test
1 team might be dedicated to triaging
- Build sheriff
- Assign person responsible
- File ticket
Assumed: Does everyone care that a build is red? Is a build/test cycle easy enough to reproduce?
