Make build-time test failures fatal again, if reproducible

Require at least 3 successes out of 5 for now.
This commit is contained in:
Simon McVittie 2017-08-29 18:14:32 +01:00
parent d4496b9005
commit 005ac671d0
2 changed files with 6 additions and 1 deletions

2
debian/changelog vendored
View File

@ -10,6 +10,8 @@ ostree (2017.10-1) UNRELEASED; urgency=medium
* Add patches to make the tests pass again when /var/tmp is on tmpfs, * Add patches to make the tests pass again when /var/tmp is on tmpfs,
which does not support user xattrs which does not support user xattrs
* Add patch to remove useless #! from bash completions * Add patch to remove useless #! from bash completions
* Make build-time test failures fatal again, but only if they are
reproducible (at least 3 times out of 5) for now
-- Simon McVittie <smcv@debian.org> Tue, 29 Aug 2017 16:08:09 +0100 -- Simon McVittie <smcv@debian.org> Tue, 29 Aug 2017 16:08:09 +0100

5
debian/test.sh vendored
View File

@ -29,7 +29,10 @@ fi
# There are several race conditions that cause intermittent failures. # There are several race conditions that cause intermittent failures.
# They are not actually a regression - we've just been luckier in the # They are not actually a regression - we've just been luckier in the
# past - so let newer versions build reliably. # past - so let newer versions build reliably.
if [ "$failed" -gt 0 ]; then if [ "$failed" -gt 2 ]; then
echo "Failed $failed out of $try_tests test runs; that seems bad"
exit 1
elif [ "$failed" -gt 0 ]; then
echo "Failed $failed out of $try_tests test runs; continuing anyway" echo "Failed $failed out of $try_tests test runs; continuing anyway"
else else
echo "All tests passed" echo "All tests passed"