Thread (6 messages) 6 messages, 4 authors, 2017-05-15

Re: Announcing blktests

From: Omar Sandoval <osandov@osandov.com>
Date: 2017-05-15 17:35:51

On Mon, May 15, 2017 at 03:13:52PM +0300, Dmitry Monakhov wrote:
Omar Sandoval [off-list ref] writes:
quoted
Hi, everyone,

At LSF/MM, we talked about the need for somewhere to dump tests for the
block layer/storage stack. I've put together a test suite inspired by
xfstests here: https://github.com/osandov/blktests.

I started out with the opinion that we should reuse xfstests for this,
but it became clear that the requirements for testing block devices are
slightly different, and it diverged significantly from there. In
particular, blktests supports:

- Per-device tests. You can configure a list of test devices and the
  per-device tests will run on each one (currently in serial, we can
  support parallel runs in the future if needed).
- No-device tests. Some tests don't need to run on real hardware, and we
  can just set up a null-blk or scsi-debug device.
- Performance numbers. In addition to the output comparison pass/fail
  that xfstests supports, blktests can also report arbitrary test
  metrics which don't affect whether the test passes but can be useful
  for spotting regressions.
Cool. Thank you.
It would be nice to have hermetic kvm environment similar to
xfstests-bld [1] . I'm a volunteer to do that.
Fine with me. Currently I think the only things we shell out to besides
basic coreutils and util-linux stuff are fio and parted.
Also I'm interested in adding my t10-dif csum tests.
Is this ok to add it to separate ./tests/t10-dif group ?
Yeah, I think that'd make sense as its own group.
Side observations:
Observation #1
I've run this on fresh fedora kernel and it hit panic on the very first tests,
which is very good sign for regression test framework.
Awesome! Any idea which test it was? There is a marker in dmesg before
each test is run.

Thanks!
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help