1
0
mirror of https://github.com/samba-team/samba.git synced 2024-12-22 13:34:15 +03:00
samba-mirror/selftest
Jo Sutton bff728a842 third_party/heimdal: Import lorikeet-heimdal-202406240121 (commit 4315286377278234be2f3b6d52225a17b6116d54)
This lets us match the Windows FAST reply when the password is expired.

Windows clients were upset by the NTSTATUS field in the edata,
apparently interpreting it to mean “insufficient resource”.

BUG: https://bugzilla.samba.org/show_bug.cgi?id=15655

Signed-off-by: Jo Sutton <josutton@catalyst.net.nz>
Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
(cherry picked from commit fe90576871)

Autobuild-User(v4-20-test): Jule Anger <janger@samba.org>
Autobuild-Date(v4-20-test): Wed Jul  3 10:06:33 UTC 2024 on atb-devel-224
2024-07-03 10:06:32 +00:00
..
expectedfail.d selftest/knownfail: move more parts to expectedfail.d/ntlm-auth 2023-12-10 21:24:38 +00:00
flapping.d tests/ntacls: unblock failing gitlab pipelines because test_setntacl_forcenative 2024-05-30 09:47:15 +00:00
gnupg
knownfail.d auth/credentials: don't ignore "client use kerberos" and --use-kerberos for machine accounts 2024-06-19 14:07:17 +00:00
manage-ca selftest: Fix code spelling 2023-07-05 06:34:32 +00:00
ns selftest: Fix code spelling 2023-07-05 06:34:32 +00:00
sanitizer selftest: Add Address Sanitizer suppressions 2022-09-08 22:34:36 +00:00
target s4:nbt_server: simulate nmbd and provide unexpected handling 2024-05-30 10:57:04 +00:00
checkpassword_arg1.sh selftest: Reformat shell scripts 2022-03-03 00:59:34 +00:00
create_smb1_fail_skipfile.txt selftest: Fix code spelling 2023-07-05 06:34:32 +00:00
devel_env.sh selftest: Update devel_env.sh for SAMBA_DCERPCD_DONT_LOG_STDOUT=1 2023-01-26 14:10:36 +00:00
filter-subunit
flapping
format-subunit selftest: be less confident in commending st/summary 2022-12-01 22:56:39 +00:00
format-subunit-json
gdb_backtrace selftest: Reformat shell scripts 2022-03-03 00:59:34 +00:00
gdb_backtrace_test.c
gdb_run selftest: Reformat shell scripts 2022-03-03 00:59:34 +00:00
in_screen selftest: Reformat shell scripts 2022-03-03 00:59:34 +00:00
knownfail selftest/knownfail: move more parts to expectedfail.d/ntlm-auth 2023-12-10 21:24:38 +00:00
knownfail_heimdal_kdc third_party/heimdal: Import lorikeet-heimdal-202406240121 (commit 4315286377278234be2f3b6d52225a17b6116d54) 2024-07-03 10:06:32 +00:00
knownfail_mit_kdc tests/krb5: Add tests for errors produced when logging in with unusable accounts 2024-07-03 08:49:13 +00:00
knownfail_mit_kdc_1_20 selftest: Remove knownfail entries for non‐existent tests 2023-11-30 00:02:33 +00:00
knownfail-32bit torture:charset: use < and > assertions for strncasecmp_m 2024-06-10 13:24:16 +00:00
no-python-tests.txt
perf_tests.py perftest: ndr_pack runs in none environment 2024-02-12 10:53:13 +00:00
quick
README
save.env.sh selftest: Reformat shell scripts 2022-03-03 00:59:34 +00:00
selftest.pl selftest: Report time at which testsuite starts 2023-08-22 00:36:52 +00:00
selftest.pl.1
selftesthelpers.py tests: Make timelimit available to test scripts 2023-06-01 21:00:36 +00:00
skip tests: Create symlinks using posix extensions 2023-09-08 16:27:39 +00:00
skip_mit_kdc s4:mitkdc: Add support for S4U2Self & S4U2Proxy 2022-03-04 14:05:31 +00:00
skip-32bit gitlab-ci: do some basic testing on ubuntu1804-32bit 2022-11-24 12:05:26 +00:00
skip.no-GSS_KRB5_CRED_NO_CI_FLAGS_X
skip.opath-required smbd: use safe_symlink_target_path() in symlink_target_below_conn() 2024-01-22 10:53:29 +00:00
slow
slow-none
SocketWrapper.pm
Subunit.pm selftest: Fix subunit reporting the time incorrectly 2023-08-21 23:37:29 +00:00
subunithelper.py selftest: Use now() instead of utcnow() 2023-10-13 03:50:31 +00:00
tap2subunit selftest: Don’t use invalid escape sequences 2023-08-30 02:15:29 +00:00
tests.py tests: add test for chunked encoding with http cli library 2024-04-11 11:20:16 +00:00
TODO
todo_smb2_tests_to_port.list selftest: Fix code spelling 2023-07-05 06:34:32 +00:00
ubsan.supp selftest: Remove ubsan suppressions 2023-10-25 22:23:37 +00:00
valgrind_run
wscript selftest: add an expectedfail directory 2023-12-10 21:24:38 +00:00

# vim: ft=rst

This directory contains test scripts that are useful for running a
bunch of tests all at once.

There are two parts to this:

 * The test runner (selftest/selftest.pl)
 * The test formatter

selftest.pl simply outputs subunit, which can then be formatted or analyzed
by tools that understand the subunit protocol. One of these tools is
format-subunit, which is used by default as part of "make test".

Available testsuites
====================
The available testsuites are obtained from a script, usually
source{3,4}/selftest/tests.py. This script should for each testsuite output
the name of the test, the command to run and the environment that should be
provided. Use the included "plantest" function to generate the required output.

Testsuite behaviour
===================

Exit code
------------
The testsuites should exit with a non-zero exit code if at least one
test failed. Skipped tests should not influence the exit code.

Output format
-------------
Testsuites can simply use the exit code to indicate whether all of their
tests have succeeded or one or more have failed. It is also possible to
provide more granular information using the Subunit protocol.

This protocol works by writing simple messages to standard output. Any
messages that can not be interpreted by this protocol are considered comments
for the last announced test.

For a full description of the subunit protocol, see the README file in the subunit
repository at http://github.com/testing-cabal/subunit.

The following commands are Samba extensions to Subunit:

start-testsuite
~~~~~~~~~~~~~~~
start-testsuite: name

The testsuite name is used as prefix for all containing tests.

skip-testsuite
~~~~~~~~~~~~~~
skip-testsuite: name

Mark the testsuite with the specified name as skipped.

testsuite-success
~~~~~~~~~~~~~~~~~
testsuite-success: name

Indicate that the testsuite has succeeded successfully.

testsuite-fail
~~~~~~~~~~~~~~
testsuite-fail: name

Indicate that a testsuite has failed.

Environments
============
Tests often need to run against a server with particular things set up,
a "environment". This environment is provided by the test "target": Samba 3,
Samba 4 or Windows.

The environments are currently available include

 - none: No server set up, no variables set.
 - dc,s3dc: Domain controller set up. The following environment variables will
   be set:

     * USERNAME: Administrator user name
     * PASSWORD: Administrator password
     * DOMAIN: Domain name
     * REALM: Realm name
     * SERVER: DC host name
     * SERVER_IP: DC IPv4 address
     * SERVER_IPV6: DC IPv6 address
     * NETBIOSNAME: DC NetBIOS name
     * NETIOSALIAS: DC NetBIOS alias

 - member,s4member,s3member: Domain controller and member server that is joined to it set up. The
   following environment variables will be set:

     * USERNAME: Domain administrator user name
     * PASSWORD: Domain administrator password
     * DOMAIN: Domain name
     * REALM: Realm name
     * SERVER: Name of the member server

See Samba.pm, Samba3.pm and Samba4.pm for the full list.

Running tests
=============

To run all the tests use::

   make test

To run a quicker subset run::

   make quicktest

To run a specific test, use this syntax::

   make test TESTS=testname

for example::

   make test TESTS=samba4.BASE-DELETE