1
0
mirror of https://github.com/samba-team/samba.git synced 2024-12-27 03:21:53 +03:00
Commit Graph

29 Commits

Author SHA1 Message Date
Jelmer Vernooij
72d88d158a r21707: Finally merge my (long-living) perlselftest branch.
This changes the main selftest code to be in perl rather than in shell script.

The selftest script is now no longer a black box but a regular executable that takes
--help.

This adds the following features:

 * "make test TESTS=foo" will run only the tests that match the regex "foo"
 * ability to deal with expected failures. the suite will not warn about tests
   that fail and are known to fail, but will warn about other failing tests and
   tests that are succeeding tests but incorrectly marked as failing.
 * ability to print a summary with all failures at the end of the run

It also opens up the way to the following features, which I hope to implement later:
 * "environments", for example having a complete domains with DCs and domain members
 in a testenvironment
 * only set up smbd if necessary (not when running LOCAL tests, for example)
 * different mktestsetup scripts per target. except for the mktestsetup script, we can
   use the same infrastructure for samba 3 or windows.
(This used to be commit 38f867880b)
2007-10-10 14:49:15 -05:00
Jelmer Vernooij
cf09c00c4e r21055: Fix executable bit.
(This used to be commit 7512270ffa)
2007-10-10 14:44:26 -05:00
Jelmer Vernooij
d3400402d5 r21040: Remove subunit runner (now written in perl in my perlselftest branch)
(This used to be commit afe0d170b0)
2007-10-10 14:44:23 -05:00
Jelmer Vernooij
d8cd73563e r19537: Report correct test names when tests failed.
(This used to be commit 7b93b3c8be)
2007-10-10 14:24:45 -05:00
Jelmer Vernooij
1d3663c230 r19387: Exit with 0 if failures were expected
(This used to be commit b4fc06aeaf)
2007-10-10 14:21:23 -05:00
Jelmer Vernooij
4517b7af0e r19381: Print out the specific tests that failed after a smbtorture run.
Support listing known failures as a list of wildcards in the file
`KNOWN_FAILURES'.
(This used to be commit 23f66efd56)
2007-10-10 14:21:22 -05:00
Jelmer Vernooij
ac698cc283 r19378: Add another type of test result 'error'
(This used to be commit 77d13056bf)
2007-10-10 14:21:20 -05:00
Jelmer Vernooij
1e818c463a r19377: Simplify report functions.
(This used to be commit 0061f3c47e)
2007-10-10 14:21:20 -05:00
Jelmer Vernooij
67abfc4981 r19376: Remove unused helper function.
(This used to be commit 88c589940d)
2007-10-10 14:21:19 -05:00
Jelmer Vernooij
d60c86364c r19372: Fix segfault for ui's that don't support comments.
(This used to be commit 0eef6dabc6)
2007-10-10 14:21:19 -05:00
Jelmer Vernooij
b58deeea69 r19350: Properly list LOCAL-TALLOC under the "LOCAL" header.
Support directories for subcategories in tests.
Several small other fixes.
(This used to be commit bde00d9706)
2007-10-10 14:21:14 -05:00
Jelmer Vernooij
52e3f69a36 r19343: Add support for external scripts/binaries that write results using the
'subunit' protocol. This allows us to easily plug EJS scripts or binaries that
can't depend on -ltorture into smbtorture. The protocol is very simple:

- write "comments" to stderr

Example output on stdout:
test: foo
success: foo
test: bar
success: bar
test: blah
failure: blah [
dummy.c:30: Expression 1 != 2 failed!
]
test: blie
skip: blie [
Iconv support not built in
]

I've already converted the talloc testsuite.
(This used to be commit e1742c14a2)
2007-10-10 14:21:13 -05:00
Jelmer Vernooij
8773e743c5 r19339: Merge my 4.0-unittest branch. This adds an API for more fine-grained
output in the testsuite rather than just True or False for a
set of tests.

The aim is to use this for:
 * known failure lists (run all tests and detect tests that
						started working or started failing). This
   would allow us to get rid of the RPC-SAMBA3-* tests
 * nicer torture output
 * simplification of the testsuite system
 * compatibility with other unit testing systems
 * easier usage of smbtorture (being able to run one test
						and automatically set up the environment for that)

This is still a work-in-progress; expect more updates over the next couple of
days.
(This used to be commit 0eb6097305)
2007-10-10 14:21:12 -05:00
Andrew Tridgell
a719444f68 r19298: make sure torture_fail() gives a useful message
Jelmer, is there a better approach for this?
(This used to be commit 67e2cf9217)
2007-10-10 14:21:04 -05:00
Andrew Tridgell
0541807adf r18517: I find it less confusing if tests are run in the order they are
added.
(This used to be commit 3e1844b2b2)
2007-10-10 14:18:41 -05:00
Jelmer Vernooij
0329d755a7 r17930: Merge noinclude branch:
* Move dlinklist.h, smb.h to subsystem-specific directories
 * Clean up ads.h and move what is left of it to dsdb/
   (only place where it's used)
(This used to be commit f7afa1cb77)
2007-10-10 14:16:54 -05:00
Andrew Bartlett
cb93d28e7c r16489: Because the torture/ui.h file isn't automaticly generated, the
prototypes in it need to use the PRINTF_ATTRIBUTE() macro, rather than
_PRINTF_ATTRIBUTE() (which becomes PRINTF_ATTRIBUTE() only in proto
files, but not C files).

This found a number of missing descriptions in the LOCAL-SOCKET test.

Andrew Bartlett
(This used to be commit 1009d55c8c)
2007-10-10 14:09:30 -05:00
Stefan Metzmacher
a94f2fc7e7 r16441: - give old tests a chance to report errors
- display the correct test name

metze
(This used to be commit 7d62b0b7e9)
2007-10-10 14:09:14 -05:00
Jelmer Vernooij
835d8ed2f6 r16332: Fix two small bugs found by the buildfarm.
(This used to be commit 3decb34bb6)
2007-10-10 14:09:11 -05:00
Jelmer Vernooij
920c1ca95c r16328: Wrap all existing tests in simple single-function testsuites.
(This used to be commit 7e811adf59)
2007-10-10 14:09:10 -05:00
Jelmer Vernooij
5b7ee5e7d6 r16321: Add suite_start/suite_finish hooks, support --format=quiet
(This used to be commit 6da39533d7)
2007-10-10 14:09:10 -05:00
Jelmer Vernooij
69270cfff6 r16315: Convert to new API.
(This used to be commit 0e52a831ed)
2007-10-10 14:09:09 -05:00
Jelmer Vernooij
582d46ec42 r16304: Improve testing UI API. This now allows registering the full
test suite tree, looks a bit more like other unit testing API's,
fixes some memory responsibility issues, introduces testcases,
and removes the need for tests to call torture_ok().
(This used to be commit 0445b1a56a)
2007-10-10 14:09:09 -05:00
Jelmer Vernooij
02aee3000d r16174: Couple of fixes to the UI code - make 'torture_ok()' optional, be more verbose by default.
(This used to be commit 8ef13a50b9)
2007-10-10 14:09:05 -05:00
Jelmer Vernooij
b78ebdbfc0 r16165: Add some more helper utilities
(This used to be commit 584cd50d2b)
2007-10-10 14:09:03 -05:00
Jelmer Vernooij
f76eafe7d7 r15818: Improve UI utilities: allow format strings and add some convenience macros.
(This used to be commit f0a4547b76)
2007-10-10 14:08:27 -05:00
Jelmer Vernooij
13ea7bb753 r14723: Keep statistics
(This used to be commit 9d6eefad3a)
2007-10-10 13:59:14 -05:00
Jelmer Vernooij
909b111f58 r14720: Add torture_context argument to all torture tests
(This used to be commit 3c7a5ce291)
2007-10-10 13:59:13 -05:00
Jelmer Vernooij
6c5853aa8d r14718: Add initial work on a standardized UI for smbtorture
(This used to be commit a15a8d87b5)
2007-10-10 13:59:13 -05:00