rpm-ostree/tests/compose-tests
Colin Walters 5879b96a64 jigdo V5: Use number of objects as cache invalidation trigger
Changes in a server-side tree can cause the need for clients to import different
objects from packages. For example, turning on documentation. Another more
subtle case is where an object might "move" from package A to B by being deleted
from A - then the jigdo build process will pick the B version.

We need a "cache validation key"; a way for the server to tell the client that
the objects it should import from the package have changed. Initially I was
thinking of using the libostree "content hash" but that would be awkward as we'd
have to do an import on the server side too.

After more consideration I realized a simple *count* of the number of objects
actually works, because (as I note in a comment) changing a file in the tree
will result in it ending up in the jigdoRPM (and count as a deletion).  And
obviously adding or removing objects changes the count too.

In fact we could have done this *without* breaking the format by just having the
client start recording the number of xattr entries, but this adds greater
flexibility down the line since we can in theory change how we do cache
invalidation if we *really* need to (but at the cost of triggering clients to
redownload packages).

Note the client logic got moved around as now we need to parse all the xattrs
before we decide what packages to download.

My test case here is turning on docs - I noticed this actually affects *every*
package which was surprising to me; I expected at least some packages wouldn't
have docs. I'll double check this.

It'd be good to have a "moving object" case too which I may look at.

Closes: https://github.com/projectatomic/rpm-ostree/issues/1197

Closes: #1256
Approved by: jlebon
2018-02-16 18:45:51 +00:00
..
libbasic-test.sh core,compose: Fix unified core pkgcache labeling 2018-01-09 16:59:19 +00:00
libcomposetest.sh tests/compose: Various fixes 2018-01-10 15:16:18 +00:00
test-basic-unified.sh compose: Do relabel before downloading in --ex-unified-core 2017-11-20 15:35:21 +00:00
test-basic.sh compose: Add --ex-unified-core 2017-11-17 18:59:34 +00:00
test-boot-location-new.sh tests/compose: f is valid in a hex checksum 2018-02-13 17:26:54 +00:00
test-compose2jigdo.sh compose: Add --ex-jigdo-output-set 2018-01-10 19:18:40 +00:00
test-install-langs.sh postprocess: Unlink our treecompose-post out of the final /bin 2017-08-31 03:06:11 +00:00
test-installroot.sh bin/compose: Expose phases as [install, postprocess, commit] cmds 2017-10-25 17:43:09 +00:00
test-jigdo-e2e.sh jigdo V5: Use number of objects as cache invalidation trigger 2018-02-16 18:45:51 +00:00
test-misc-tweaks.sh tests/compose: Rework caching to cache RPMs 2017-12-01 19:20:40 +00:00
test-mutate-os-release.sh Fix "releasever" option, test it by default 2018-01-23 15:18:52 +00:00
test-write-commitid.sh tests/compose: Add a test for --write-commitid-to 2017-12-20 15:39:47 +00:00