2011-12-04 03:09:04 +04:00
# This file contains a list of regular expressions matching the names of
# tests that are flapping. In other words, they sometimes succeed and
# sometimes fail, depending on external factors.
#
# "make test" will not report failures or successes for tests listed here.
#
# DO NOT ADD TESTS HERE UNLESS THEY ARE ACTUALLY FLAPPING
#
# It is much better to add known failing tests to 'knownfail', so the
2011-12-04 17:56:13 +04:00
# test system can warn when they actually start passing.
2011-12-04 03:09:04 +04:00
^samba3.raw.mux.* #This test is flaky on the async lock time
^samba3.smbtorture_s3.*OPLOCK4 # fails sometimes on sn-devel
^samba4.nbt.winsreplication.owned # fails sometimes, timing related
2012-02-14 14:42:16 +04:00
^samba3.rpc.spoolss.*printserver.enum_printers_old # fails on some hosts due to timing issues ?
^samba3.rpc.spoolss.printer.*addprinterex.print_test # another intermittent failure
^samba3.rap.printing # fails sometimes on sn-devel
2012-04-24 02:28:48 +04:00
^samba3.rpc.spoolss.printer.*addprinter.print_test # fails on some hosts due to timing issues ?
2014-11-10 17:16:31 +03:00
^samba3.rpc.spoolss.printer.addprinter.print_job_enum # fails on some hosts due to bug 10930
^samba3.rpc.spoolss.printer.addprinterex.print_job_enum # fails on some hosts due to bug 10930
2015-03-06 11:34:11 +03:00
^samba3.rpc.lsa.privileges.lsa.Privileges\(nt4_dc\) # fails sometimes on sn-devel
2012-03-14 16:10:43 +04:00
^samba4.blackbox.gentest # is flakey due to timing
2015-03-05 20:08:43 +03:00
^samba3.smb2.acls.INHERITANCE\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
^samba3.smb2.acls.DYNAMIC\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
^samba3.raw.acls.dynamic\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
^samba3.raw.acls.inheritance\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
^samba3.raw.samba3checkfsp.samba3checkfsp\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
^samba3.raw.samba3closeerr.samba3closeerr\(ad_dc\) # Seems to flap - succeeds on sn-devel, fails on Fedora 16
selftest: the tombstone_reanimation test is currently flakey.
See
https://git.samba.org/autobuild.flakey/2015-03-18-0456/samba.stdout
[1657(10627)/1735 at 1h37m36s] samba4.tombstone_reanimation.python(fl2003dc)
Test Container reanimation
UNEXPECTED(failure): samba4.tombstone_reanimation.python.tombstone_reanimation.RestoreContainerObjectTestCase.test_container(fl2003dc)
REASON: Exception: Exception: Traceback (most recent call last):
File "bin/python/samba/tests/__init__.py", line 113, in run
testMethod()
File "/memdisk/autobuild/fl/b2199/samba/source4/dsdb/tests/python/tombstone_reanimation.py", line 541, in test_container
self.assertAttributesEqual(obj, attr_orig, obj_restore, attr_rest)
File "/memdisk/autobuild/fl/b2199/samba/source4/dsdb/tests/python/tombstone_reanimation.py", line 86, in assertAttributesEqual
self.assertEqual(attrs_orig, attrs_rest, "Actual object does not have expected attributes")
AssertionError: Actual object does not have expected attributes
FAILED (1 failures, 0 errors and 0 unexpected successes in 0 testsuites)
There are more occurrences:
https://git.samba.org/autobuild.flakey/2015-03-17-1952/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-17-1350/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-16-0452/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-16-0156/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-15-1654/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-14-2253/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-14-1400/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-14-0153/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-13-2251/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-13-1059/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-13-0759/samba.stdout
Note that this fails in all environments it is configured to run in.
Signed-off-by: Michael Adam <obnox@samba.org>
Reviewed-by: Stefan Metzmacher <metze@samba.org>
2015-03-18 01:00:03 +03:00
^samba4.tombstone_reanimation.python.tombstone_reanimation.RestoreContainerObjectTestCase.test_container # flakey on sn-devel
selftest: the drs.delete_object is currently flakey.
See
https://git.samba.org/autobuild.flakey/2015-03-18-0813/samba.stdout
[1692(11281)/1735 at 1h54m29s] samba4.drs.delete_object.python(promoted_dc)(promoted_dc)
Testing for DrsDelObjUser_1426658948 with GUID 80f07b62-7edd-4175-8e5c-f44b6081f39c
UNEXPECTED(failure): samba4.drs.delete_object.python(promoted_dc).delete_object.DrsDeleteObjectTestCase.test_ReplicateDeletedObject1(promoted_dc)
REASON: Exception: Exception: Traceback (most recent call last):
File "bin/python/samba/tests/__init__.py", line 113, in run
testMethod()
File "/memdisk/autobuild/fl/b21901/samba/source4/torture/drs/python/delete_object.py", line 214, in test_ReplicateDeletedObject1
self._check_obj(sam_ldb=self.ldb_dc2, obj_orig=user_orig, is_deleted=True)
File "/memdisk/autobuild/fl/b21901/samba/source4/torture/drs/python/delete_object.py", line 82, in _check_obj
self.assertEquals(name_cur, name_orig + "\nDEL:" + guid_str)
AssertionError: 'DrsDelObjUser_1426658948' != 'DrsDelObjUser_1426658948\nDEL:80f07b62-7edd-4175-8e5c-f44b6081f39c'
FAILED (1 failures, 0 errors and 0 unexpected successes in 0 testsuites)
There are many more occurrences:
https://git.samba.org/autobuild.flakey/2013-08-02-1537/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-04-1536/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-05-0336/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-09-1141/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-13-1537/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-14-0936/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-14-1736/samba.stdout
https://git.samba.org/autobuild.flakey/2013-08-15-1936/samba.stdout
...
https://git.samba.org/autobuild.flakey/2014-05-01-1707/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-03-1411/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-03-1710/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-04-1710/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-13-0507/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-23-1113/samba.stdout
https://git.samba.org/autobuild.flakey/2014-05-29-0213/samba.stdout
https://git.samba.org/autobuild.flakey/2014-06-02-0513/samba.stdout
https://git.samba.org/autobuild.flakey/2014-06-08-1713/samba.stdout
https://git.samba.org/autobuild.flakey/2014-06-09-0512/samba.stdout
https://git.samba.org/autobuild.flakey/2014-06-14-0214/samba.stdout
...
https://git.samba.org/autobuild.flakey/2015-03-02-0213/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-02-0813/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-03-0513/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-04-0811/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-07-1113/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-07-1713/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-08-2013/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-09-0813/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-09-2008/samba.stdout
https://git.samba.org/autobuild.flakey/2015-03-12-0807/samba.stdout
Signed-off-by: Michael Adam <obnox@samba.org>
Reviewed-by: Stefan Metzmacher <metze@samba.org>
Autobuild-User(master): Michael Adam <obnox@samba.org>
Autobuild-Date(master): Wed Mar 18 15:20:57 CET 2015 on sn-devel-104
2015-03-18 11:51:02 +03:00
^samba4.drs.delete_object.python.*.delete_object.DrsDeleteObjectTestCase.test_ReplicateDeletedObject1 # flakey on sn-devel