iv/linux
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,215,510 Commits 104 Branches 1,843 Tags
Commit Graph

69 Commits

Author SHA1 Message Date
Kent Overstreet
2cbe5cfe27 bcachefs: Rework calling convention for marking overwrites 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:25 -04:00
Kent Overstreet
e3d3a9d91a bcachefs: trans_get_key() now works correctly for extents 
More prep work for reflink: for extents, we're not looking for an exact
mach on pos, rather that the pos is within the range of the key the
iterator points to.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:24 -04:00
Kent Overstreet
0c04f5eb0d bcachefs: Don't overflow trans with iters from triggers 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:24 -04:00
Kent Overstreet
8d591d5da4 bcachefs: Convert some assertions to fsck errors 
Actual repair code will come later, but this is a start

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:24 -04:00
Kent Overstreet
91052b9de8 bcachefs: Refactor trans_(get|update)_key 
these are still pretty ugly...

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:23 -04:00
Kent Overstreet
88767d65d8 bcachefs: Update path now handles triggers that generate more triggers 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:23 -04:00
Kent Overstreet
6e738539cd bcachefs: Improve key marking interface 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:22 -04:00
Kent Overstreet
4ee202e2b7 bcachefs: better BTREE_INSERT_NO_CLEAR_REPLICAS 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:22 -04:00
Kent Overstreet
3838be7841 bcachefs: Don't use a fixed size buffer for fs_usage_deltas 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:22 -04:00
Kent Overstreet
6fb076e60d bcachefs: Fix spurious inconsistency in recovery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:22 -04:00
Kent Overstreet
7cfac5f506 bcachefs: Fix for the stripes mark path and gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:21 -04:00
Kent Overstreet
460651ee86 bcachefs: Various improvements to bch2_alloc_write() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:21 -04:00
Kent Overstreet
932aa83745 bcachefs: bch2_trans_mark_update() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:21 -04:00
Kent Overstreet
5e82a9a1f4 bcachefs: Write out fs usage consistently 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:21 -04:00
Kent Overstreet
fca1223ccf bcachefs: Avoid write lock on mark_lock 
mark_lock is a frequently taken lock, and there's also potential for
deadlocks since currently bch2_clear_page_bits which is called from
memory reclaim has to take it to drop disk reservations.

The disk reservation get path takes it when it recalculates the number
of sectors known to be available, but it's not really needed for
consistency.  We just want to make sure we only have one thread updating
the sectors_available count, which we can do with a dedicated mutex.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:21 -04:00
Kent Overstreet
94f651e2c7 bcachefs: Return errors from for_each_btree_key() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
201a4d4cbe bcachefs: fix triggers for stripes btree 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
c6dd04f8f5 bcachefs: Mark overwrites from journal replay in initial gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
a1d58243f9 bcachefs: add ability to run gc on metadata only 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
36e916e13b bcachefs: Caller now responsible for calling mark_key for gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
3a0e06db71 bcachefs: Assorted preemption fixes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
4d8100daa9 bcachefs: Allocate fs_usage in do_btree_insert_at() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
0dc17247f1 bcachefs: kill struct btree_insert 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
59928c1220 bcachefs: Don't BUG_ON() on bucket sector count overflow 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
ecf37a4a80 bcachefs: fs_usage_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
768ac63924 bcachefs: Add a mechanism for blocking the journal 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8fe826f90a bcachefs: Convert bucket invalidation to key marking path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
73c27c6095 bcachefs: fixes for cached data accounting 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8777210b92 bcachefs: refactor key marking code a bit 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
2ecc6171a3 bcachefs: Fix double counting when gc is running 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
39fbc5a49f bcachefs: gc lock no longer needed for disk reservations 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
76f4c7b0c3 bcachefs: Fix oldest_gen handling 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
3577df5f7f bcachefs: serialize persistent_reserved 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
3e0745e283 bcachefs: initialize fs usage summary in recovery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
4c97e04aa8 bcachefs: percpu utility code 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
bdba6c29ff bcachefs: fix inode counting 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
61c8d7c8eb bcachefs: Persist stripe blocks_used 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
430735cd1a bcachefs: Persist alloc info on clean shutdown 
- Does not persist alloc info for stripes yet
 - Also does not yet include filesystem block/sector counts yet, from
struct fs_usage
 - Not made use of just yet

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
7ef2a73a58 bcachefs: Fix check for if extent update is allocating 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
d0cc3defba bcachefs: More allocator startup improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
23f80d2b3b bcachefs: Factor out acc_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
06b7345cc2 bcachefs: Include summarized counts in fs_usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
5663a41521 bcachefs: refactor bch_fs_usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
641ab73643 bcachefs: improve/clarify ptr_disk_sectors() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
9166b41db1 bcachefs: s/usage_lock/mark_lock 
better describes what it's for, and we're going to call a new lock
usage_lock

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
8eb7f3ee46 bcachefs: move dirty into bucket_mark 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
f0cfb963ec bcachefs: Track nr_inodes with the key marking machinery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
26609b619f bcachefs: Make bkey types globally unique 
this lets us get rid of a lot of extra switch statements - in a lot of
places we dispatch on the btree node type, and then the key type, so
this is a nice cleanup across a lot of code.

Also improve the on disk format versioning stuff.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
eeb83e25bb bcachefs: Hold usage_lock over mark_key and fs_usage_apply 
Fixes an inconsistency at the end of gc

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
dfe9bfb32e bcachefs: Stripes now properly subject to gc 
gc now verifies the contents of the stripes radix tree, important for
persistent alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00