1
0
mirror of https://github.com/systemd/systemd.git synced 2024-12-22 17:35:35 +03:00
systemd/test
Zbigniew Jędrzejewski-Szmek fe85f2bb9c test: move TEST-01-BASIC setup to static files
After this commit, only tests that were converted will work, because the
interface to test_run() changed.
2020-03-28 11:46:47 +01:00
..
fuzz Merge pull request #15136 from yuwata/network-dhcp4-use-gateway 2020-03-17 16:51:18 +01:00
hwdb.d Rename udev's hwdb/ to hwdb.d/ 2019-10-10 00:53:09 +01:00
journal-data test-journal-importer: add a test case with broken input 2017-02-15 00:31:55 -05:00
mocks treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-01-BASIC test: move TEST-01-BASIC setup to static files 2020-03-28 11:46:47 +01:00
TEST-02-CRYPTSETUP treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-03-JOBS treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-04-JOURNAL treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-05-RLIMITS treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-06-SELINUX treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-07-ISSUE-1981 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-08-ISSUE-2730 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-09-ISSUE-2691 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-10-ISSUE-2467 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-11-ISSUE-3166 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-12-ISSUE-3171 treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-13-NSPAWN-SMOKE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-14-MACHINE-ID treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-15-DROPIN treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-16-EXTEND-TIMEOUT treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-17-UDEV-WANTS treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-18-FAILUREACTION treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-19-DELEGATE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-20-MAINPIDGAMES treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-21-SYSUSERS treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-22-TMPFILES treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-23-TYPE-EXEC treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-24-UNIT-TESTS treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-25-IMPORT treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-26-SETENV treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-27-STDOUTFILE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-28-PERCENTJ-WANTEDBY treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-29-UDEV-ID_RENAMING treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-30-ONCLOCKCHANGE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-31-DEVICE-ENUMERATION treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-32-OOMPOLICY treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-33-CLEAN-UNIT treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-34-DYNAMICUSERMIGRATE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-35-NETWORK-GENERATOR treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-36-NUMAPOLICY core: add support for setting CPUAffinity= to special "numa" value 2020-03-16 08:57:28 +01:00
TEST-37-RUNTIMEDIRECTORYPRESERVE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-39-EXECRELOAD treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-40-EXEC-COMMAND-EX treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-41-ONESHOT-RESTART treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-42-EXECSTOPPOST treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-43-PRIVATEUSER-UNPRIV treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-44-LOG-NAMESPACE treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-45-REPART treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-46-HOMED treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
TEST-47-ISSUE-14566 test: wait a bit after starting the test service 2020-03-16 12:28:14 +09:00
test-execute test: ignore IAB capabilities in test-execute 2020-03-09 18:22:16 +01:00
test-network test-network: add a test case for DHCPv4.UseGateway=no 2020-03-16 19:34:47 +09:00
test-path test: replace symlinks with actual unit files 2020-03-22 10:22:42 +01:00
test-resolve test: move resolved test data into test/ 2017-02-13 22:23:48 +01:00
test-umount test-umount: add a simple test for swap_list_get() 2018-03-16 10:12:50 +01:00
units test: move TEST-01-BASIC setup to static files 2020-03-28 11:46:47 +01:00
.gitignore update .gitignore 2013-01-28 03:54:49 +01:00
create-sys-script.py tree-wide: use proper unicode © instead of (C) where we can 2018-06-14 10:20:20 +02:00
hwdb-test.sh Rename udev's hwdb/ to hwdb.d/ 2019-10-10 00:53:09 +01:00
meson.build meson: use install_subdir() to install files 2020-03-22 10:22:42 +01:00
mkosi.build.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
mkosi.default.networkd-test tree-wide: drop printk.devkmsg=on setting in various places 2020-03-03 15:02:53 +01:00
mkosi.nspawn.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
networkd-test.py test-network: suppress logs in status command 2020-01-07 22:20:43 +09:00
README.testsuite tree-wise: standarize on "auto-detection" spelling 2019-11-30 17:42:13 +01:00
rule-syntax-check.py rule-syntax-check: add CONST 2019-10-18 10:02:35 +09:00
run-integration-tests.sh treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
run-unit-tests.py run-unit-tests: add option to run unsafe tests too 2018-09-24 15:42:50 +02:00
splash.bmp sd-boot: add EFI boot manager and stub loader 2015-02-17 14:36:59 +01:00
sys-script.py tree-wide: use proper unicode © instead of (C) where we can 2018-06-14 10:20:20 +02:00
sysv-generator-test.py codespell: fix spelling errors 2019-04-29 16:47:18 +02:00
test-efi-create-disk.sh treewide: more portable bash shebangs 2020-03-05 17:27:07 +01:00
test-exec-deserialization.py test: give systemd chance to actually start the unit 2020-02-08 11:38:24 +01:00
test-functions test: move TEST-01-BASIC setup to static files 2020-03-28 11:46:47 +01:00
udev-test.pl test: add test cases for empty string match 2019-09-11 09:06:15 +09:00

The extended testsuite only works with UID=0. It contains of several
subdirectories named "test/TEST-??-*", which are run one by one.

To run the extended testsuite do the following:

$ ninja -C build  # Avoid building anything as root later
$ sudo test/run-integration-tests.sh
ninja: Entering directory `/home/zbyszek/src/systemd/build'
ninja: no work to do.
--x-- Running TEST-01-BASIC --x--
+ make -C TEST-01-BASIC BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run
make: Entering directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
TEST CLEANUP: Basic systemd setup
TEST SETUP: Basic systemd setup
...
TEST RUN: Basic systemd setup [OK]
make: Leaving directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
--x-- Result of TEST-01-BASIC: 0 --x--
--x-- Running TEST-02-CRYPTSETUP --x--
+ make -C TEST-02-CRYPTSETUP BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run

If one of the tests fails, then $subdir/test.log contains the log file of
the test.

To run just one of the cases:

$ sudo make -C test/TEST-01-BASIC clean setup run

Specifying the build directory
==============================

If the build directory is not detected automatically, it can be specified
with BUILD_DIR=:

$ sudo BUILD_DIR=some-other-build/ test/run-integration-tests

or

$ sudo make -C test/TEST-01-BASIC BUILD_DIR=../../some-other-build/ ...

Note that in the second case, the path is relative to the test case directory.
An absolute path may also be used in both cases.

Configuration variables
=======================

TEST_NO_QEMU=1
    Don't run tests under QEMU

TEST_NO_NSPAWN=1
    Don't run tests under systemd-nspawn

TEST_NO_KVM=1
    Disable QEMU KVM auto-detection (may be necessary when you're trying to run the
    *vanilla* QEMU and have both qemu and qemu-kvm installed)

TEST_NESTED_KVM=1
    Allow tests to run with nested KVM. By default, the testsuite disables
    nested KVM if the host machine already runs under KVM. Setting this
    variable disables such checks

QEMU_MEM=512M
    Configure amount of memory for QEMU VMs (defaults to 512M)

QEMU_SMP=1
    Configure number of CPUs for QEMU VMs (defaults to 1)

KERNEL_APPEND='...'
    Append additional parameters to the kernel command line

NSPAWN_ARGUMENTS='...'
    Specify additional arguments for systemd-nspawn

QEMU_TIMEOUT=infinity
    Set a timeout for tests under QEMU (defaults to infinity)

NSPAWN_TIMEOUT=infinity
    Set a timeout for tests under systemd-nspawn (defaults to infinity)

INTERACTIVE_DEBUG=1
    Configure the machine to be more *user-friendly* for interactive debuggung
    (e.g. by setting a usable default terminal, suppressing the shutdown after
    the test, etc.)

The kernel and initramfs can be specified with $KERNEL_BIN and $INITRD.
(Fedora's or Debian's default kernel path and initramfs are used by default)

A script will try to find your QEMU binary. If you want to specify a different
one with $QEMU_BIN.

Debugging the qemu image
========================

If you want to log in the testsuite virtual machine, you can specify additional
kernel command line parameter with $KERNEL_APPEND and then log in as root.

$ sudo make -C test/TEST-01-BASIC KERNEL_APPEND="systemd.unit=multi-user.target" run

Root password is empty.

Ubuntu CI
=========

New PR submitted to the project are run through regression tests, and one set
of those is the 'autopkgtest' runs for several different architectures, called
'Ubuntu CI'.  Part of that testing is to run all these tests.  Sometimes these
tests are temporarily blacklisted from running in the 'autopkgtest' tests while
debugging a flaky test; that is done by creating a file in the test directory
named 'blacklist-ubuntu-ci', for example to prevent the TEST-01-BASIC test from
running in the 'autopkgtest' runs, create the file
'TEST-01-BASIC/blacklist-ubuntu-ci'.

The tests may be disabled only for specific archs, by creating a blacklist file
with the arch name at the end, e.g.
'TEST-01-BASIC/blacklist-ubuntu-ci-arm64' to disable the TEST-01-BASIC test
only on test runs for the 'arm64' architecture.

Note the arch naming is not from 'uname -m', it is Debian arch names:
https://wiki.debian.org/ArchitectureSpecificsMemo

For PRs that fix a currently blacklisted test, the PR should include removal
of the blacklist file.