Make build-time test failures non-fatal if 3 out of 5 attempts succeed

There are several upstream bugs that cause intermittent test failures,
and can intermittently be reproduced in real use. However, these are not
regressions, so we should not FTBFS just because we happen to have been
unlucky during build.
This commit is contained in:
Simon McVittie 2016-12-01 12:33:59 +00:00
parent 86345424f3
commit 384b7abbd9
2 changed files with 18 additions and 1 deletions

12
debian/changelog vendored
View File

@ -1,3 +1,15 @@
ostree (2016.14-2) UNRELEASED; urgency=medium
* Make build-time test failures non-fatal, as long as at least
3 out of 5 attempts succeed.
There are several upstream bugs that cause intermittent test
failures, and can intermittently be reproduced in real use.
However, these are not regressions, so we should not FTBFS just
because we happen to have been unlucky during build.
-- Simon McVittie <smcv@debian.org> Thu, 01 Dec 2016 12:29:00 +0000
ostree (2016.14-1) unstable; urgency=medium
* Switch the build-dependency on libgpgme11-dev (which no longer exists

7
debian/test.sh vendored
View File

@ -34,13 +34,18 @@ if pgrep lt-ostree || pgrep --full "gpg-agent --homedir /var/tmp/tap-test."; the
pgrep lt-ostree | xargs --no-run-if-empty ps ww
fi
if [ "$failed" -gt 0 ]; then
# There are several race conditions that cause intermittent failures.
# They are not actually a regression - we've just been luckier in the
# past - so let newer versions build reliably.
if [ "$failed" -gt 2 ]; then
echo "Failed $failed out of $try_tests test runs"
if [ -z "$ignore" ]; then
exit 1
else
echo "Ignoring test failure for this architecture"
fi
elif [ "$failed" -gt 0 ]; then
echo "Failed $failed out of $try_tests test runs; continuing anyway"
fi
exit 0