r21707: Finally merge my (long-living) perlselftest branch.
authorJelmer Vernooij <jelmer@samba.org>
Mon, 5 Mar 2007 21:28:55 +0000 (21:28 +0000)
committerGerald (Jerry) Carter <jerry@samba.org>
Wed, 10 Oct 2007 19:49:15 +0000 (14:49 -0500)
commit38f867880beb40c691e9713f854426031310629c
tree22cd0190c1288fbd54e5287e81405546311feb06
parente4cf8f1dea9063b9b83e629ea0e7a116bf4fc5f7
r21707: Finally merge my (long-living) perlselftest branch.

This changes the main selftest code to be in perl rather than in shell script.

The selftest script is now no longer a black box but a regular executable that takes
--help.

This adds the following features:

 * "make test TESTS=foo" will run only the tests that match the regex "foo"
 * ability to deal with expected failures. the suite will not warn about tests
   that fail and are known to fail, but will warn about other failing tests and
   tests that are succeeding tests but incorrectly marked as failing.
 * ability to print a summary with all failures at the end of the run

It also opens up the way to the following features, which I hope to implement later:
 * "environments", for example having a complete domains with DCs and domain members
 in a testenvironment
 * only set up smbd if necessary (not when running LOCAL tests, for example)
 * different mktestsetup scripts per target. except for the mktestsetup script, we can
   use the same infrastructure for samba 3 or windows.
26 files changed:
source/build/smb_build/makefile.pm
source/lib/socket_wrapper/config.m4
source/main.mk
source/samba4-knownfail
source/script/tests/Samba4.pm [new file with mode: 0644]
source/script/tests/SocketWrapper.pm [new file with mode: 0644]
source/script/tests/mk-fedora-ds.sh [changed mode: 0644->0755]
source/script/tests/mk-keyblobs.sh [changed mode: 0644->0755]
source/script/tests/mk-openldap.sh [changed mode: 0644->0755]
source/script/tests/mktestsetup.sh.share_ldb [changed mode: 0644->0755]
source/script/tests/selftest.pl
source/script/tests/selftest.sh [deleted file]
source/script/tests/test_ejs.sh
source/script/tests/test_ldap.sh
source/script/tests/test_nbt.sh
source/script/tests/testenv.pl [new file with mode: 0755]
source/script/tests/tests_net.sh [deleted file]
source/script/tests/tests_quick.sh
source/script/tests/tests_xterm.sh [changed mode: 0644->0755]
source/torture/basic/delaywrite.c
source/torture/raw/oplock.c
source/torture/smbtorture.c
source/torture/torture.c
source/torture/ui.c
source/torture/ui.h
testprogs/blackbox/test_ldb.sh