Re: [PATCH] tools/rtla: Add basic test suite

On Thu,  9 Jan 2025 14:38:52 +0100
Tomas Glozar [off-list ref] wrote:

Implement a simple TAP-based test engine in bash and a few basic tests
using it, to be used to check for bugs and regressions.

A new "check" target is added to the rtla Makefile that runs the test suite
using the "prove" command implemented by Test::Harness.

The only test format currently supported is running rtla with defined
command arguments per test, checking its exit code. In case the exit
code is non-zero, the output of rtla is displayed.

The test cases are adopted from rtla tests in the Continuous Kernel
Integration (CKI) project [1] with the authors' approval.

[1] https://gitlab.com/redhat/centos-stream/tests/kernel/kernel-tests/-/blob/main/rt-tests/us/rtla/

Signed-off-by: Tomas Glozar <tglozar@redhat.com>

I tested this out, and it failed the last test:

make[1]: Leaving directory '/work/git/linux.git/tools/tracing/rtla'
RTLA=/work/git/linux.git/tools/tracing/rtla/rtla prove -o -f tests/
tests/hwnoise.t ... ok      
tests/osnoise.t ... ok   
tests/timerlat.t .. 9/9 
not ok 9 - hist test in nanoseconds
# 
tests/timerlat.t .. Failed 1/9 subtests 

Test Summary Report
-------------------
tests/timerlat.t (Wstat: 0 Tests: 9 Failed: 1)
  Failed test:  9
Files=3, Tests=20, 451 wallclock secs ( 0.07 usr  0.11 sys + 10.57 cusr 74.09 csys = 84.84 CPU)
Result: FAIL
make: *** [Makefile:89: check] Error 1

-- Steve