[PATCH] Make test output coloring more intuitive
From: Adam Spiers <hidden>
Date: 2016-06-15 22:54:46
Subsystem:
the rest · Maintainer:
Linus Torvalds
1. Change the color of individual known breakages from bold green to
bold yellow. This seems more appropriate when considering the
universal traffic lights coloring scheme, where green conveys the
impression that everything's OK, and amber that something's not
quite right.
2. Likewise, change the color of the summarized total number of known
breakages from bold red to bold yellow to be less alarmist and more
consistent with the above.
3. Change color of unexpectedly fixed known breakages to bold red. An
unexpectedly passing test indicates that the test is wrong or the
semantics of the code being tested have changed. Either way this
is an error which is arguably as bad as a failing test, and as such
is now counted in the totals too.
The end result of these changes is that:
- red is _only_ used for things which have gone unexpectedly wrong:
test failures, unexpected test passes, and failures with the
framework,
- yellow is _only_ used for known breakages, and
- green is _only_ used for things which have gone to plan and
require no further work to be done.
Signed-off-by: Adam Spiers <redacted>
---
t/t0000-basic.sh | 7 ++++---
t/test-lib.sh | 13 ++++++++-----
2 files changed, 12 insertions(+), 8 deletions(-)
mode change 100644 => 100755 t/test-lib.sh
diff --git a/t/t0000-basic.sh b/t/t0000-basic.sh
index ae6a3f0..4e111b4 100755
--- a/t/t0000-basic.sh
+++ b/t/t0000-basic.sh@@ -81,9 +81,10 @@ test_expect_success 'pretend we have fixed a known breakage (run in sub test-lib ./passing-todo.sh >out 2>err && ! test -s err && sed -e 's/^> //' >expect <<-\\EOF && - > ok 1 - pretend we have fixed a known breakage # TODO known breakage - > # fixed 1 known breakage(s) - > # passed all 1 test(s) + > ok 1 - pretend we have fixed a known breakage # TODO known breakage vanished + > # fixed 1 known breakage(s); please update test(s) + > # still have 1 known breakage(s) + > # passed all remaining 0 test(s) > 1..1 EOF test_cmp expect out)
diff --git a/t/test-lib.sh b/t/test-lib.sh
old mode 100644
new mode 100755
index f8e3733..9907035
--- a/t/test-lib.sh
+++ b/t/test-lib.sh@@ -183,10 +183,12 @@ then tput bold; tput setaf 1;; # bold red skip) tput bold; tput setaf 2;; # bold green + warn) + tput bold; tput setaf 3;; # bold yellow pass) tput setaf 2;; # green info) - tput setaf 3;; # brown + tput setaf 3;; # yellow/brown *) test -n "$quiet" && return;; esac
@@ -276,12 +278,13 @@ test_failure_ () { test_known_broken_ok_ () { test_fixed=$(($test_fixed+1)) - say_color "" "ok $test_count - $@ # TODO known breakage" + test_broken=$(($test_broken+1)) + say_color error "ok $test_count - $@ # TODO known breakage vanished" } test_known_broken_failure_ () { test_broken=$(($test_broken+1)) - say_color skip "not ok $test_count - $@ # TODO known breakage" + say_color warn "not ok $test_count - $@ # TODO known breakage" } test_debug () {
@@ -371,11 +374,11 @@ test_done () { if test "$test_fixed" != 0 then - say_color pass "# fixed $test_fixed known breakage(s)" + say_color error "# fixed $test_fixed known breakage(s); please update test(s)" fi if test "$test_broken" != 0 then - say_color error "# still have $test_broken known breakage(s)" + say_color warn "# still have $test_broken known breakage(s)" msg="remaining $(($test_count-$test_broken)) test(s)" else msg="$test_count test(s)"
--
1.7.12.147.g6d168f4