iv/linux
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
linux/io_uring
History
Pavel Begunkov 27122c079f io_uring: fix unprotected iopoll overflow 
[   71.490669] WARNING: CPU: 3 PID: 17070 at io_uring/io_uring.c:769
io_cqring_event_overflow+0x47b/0x6b0
[   71.498381] Call Trace:
[   71.498590]  <TASK>
[   71.501858]  io_req_cqe_overflow+0x105/0x1e0
[   71.502194]  __io_submit_flush_completions+0x9f9/0x1090
[   71.503537]  io_submit_sqes+0xebd/0x1f00
[   71.503879]  __do_sys_io_uring_enter+0x8c5/0x2380
[   71.507360]  do_syscall_64+0x39/0x80

We decoupled CQ locking from ->task_complete but haven't fixed up places
forcing locking for CQ overflows.

Fixes: ec26c225f06f5 ("io_uring: merge iopoll and normal completion paths")
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2023-09-07 09:02:29 -06:00
..
advise.c
io_uring: always go async for unsupported fadvise flags
2023-01-29 15:18:26 -07:00
advise.h
…
alloc_cache.h
io_uring/rsrc: consolidate node caching
2023-04-12 12:09:41 -06:00
cancel.c
io_uring/cancel: wire up IORING_ASYNC_CANCEL_OP for sync cancel
2023-07-17 10:05:48 -06:00
cancel.h
io_uring/cancel: support opcode based lookup and cancelation
2023-07-17 10:05:48 -06:00
epoll.c
io_uring: undeprecate epoll_ctl support
2023-05-26 20:22:41 -06:00
epoll.h
…
fdinfo.c
io_uring/fdinfo: only print ->sq_array[] if it's there
2023-09-01 15:08:29 -06:00
fdinfo.h
…
filetable.c
io_uring: add helpers to decode the fixed file file_ptr
2023-06-20 09:36:22 -06:00
filetable.h
io_uring: add helpers to decode the fixed file file_ptr
2023-06-20 09:36:22 -06:00
fs.c
io_uring: for requests that require async, force it
2023-01-29 15:18:26 -07:00
fs.h
…
io_uring.c
io_uring: fix unprotected iopoll overflow
2023-09-07 09:02:29 -06:00
io_uring.h
io_uring: force inline io_fill_cqe_req
2023-08-24 17:16:19 -06:00
io-wq.c
io_uring: break out of iowq iopoll on teardown
2023-09-07 09:02:27 -06:00
io-wq.h
io_uring: break out of iowq iopoll on teardown
2023-09-07 09:02:27 -06:00
kbuf.c
io_uring: stop calling free_compound_page()
2023-08-21 14:28:42 -07:00
kbuf.h
io_uring: add support for user mapped provided buffer ring
2023-04-03 07:14:21 -06:00
Makefile
…
msg_ring.c
io_uring: use io_file_from_index in io_msg_grab_file
2023-06-20 09:36:22 -06:00
msg_ring.h
io_uring: get rid of double locking
2022-12-07 06:47:13 -07:00
net.c
io_uring: never overflow io_aux_cqe
2023-08-11 10:42:57 -06:00
net.h
io_uring: Add KASAN support for alloc_caches
2023-04-03 07:16:14 -06:00
nop.c
…
nop.h
…
notif.c
io_uring/notif: add constant for ubuf_info flags
2023-04-15 14:21:04 -06:00
notif.h
io_uring/notif: add constant for ubuf_info flags
2023-04-15 14:21:04 -06:00
opdef.c
io_uring: Pass whole sqe to commands
2023-05-04 08:19:05 -06:00
opdef.h
io_uring: Split io_issue_def struct
2023-01-29 15:17:41 -07:00
openclose.c
io_uring: correct check for O_TMPFILE
2023-08-07 12:34:23 -06:00
openclose.h
…
poll.c
io_uring: never overflow io_aux_cqe
2023-08-11 10:42:57 -06:00
poll.h
io_uring: avoid indirect function calls for the hottest task_work
2023-06-02 08:55:37 -06:00
refs.h
…
rsrc.c
io_uring/rsrc: keep one global dummy_ubuf
2023-08-11 10:42:57 -06:00
rsrc.h
io_uring/rsrc: Annotate struct io_mapped_ubuf with __counted_by
2023-08-17 19:14:47 -06:00
rw.c
for-6.6/io_uring-2023-08-28
2023-08-29 20:11:33 -07:00
rw.h
io_uring: avoid indirect function calls for the hottest task_work
2023-06-02 08:55:37 -06:00
slist.h
io_uring: silence variable ‘prev’ set but not used warning
2023-03-09 10:10:58 -07:00
splice.c
io_uring/splice: use fput() directly
2023-08-10 10:24:25 -06:00
splice.h
…
sqpoll.c
io_uring: Don't set affinity on a dying sqpoll thread
2023-08-30 09:53:44 -06:00
sqpoll.h
io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used
2023-08-16 13:40:28 -06:00
statx.c
io_uring: for requests that require async, force it
2023-01-29 15:18:26 -07:00
statx.h
…
sync.c
io_uring: for requests that require async, force it
2023-01-29 15:18:26 -07:00
sync.h
…
tctx.c
io_uring: Add io_uring_setup flag to pre-register ring fd and never install it
2023-05-16 08:06:00 -06:00
tctx.h
io_uring: simplify __io_uring_add_tctx_node
2022-10-07 12:25:30 -06:00
timeout.c
io_uring: never overflow io_aux_cqe
2023-08-11 10:42:57 -06:00
timeout.h
io_uring: remove unused return from io_disarm_next
2022-09-21 13:15:01 -06:00
uring_cmd.c
io_uring: simplify big_cqe handling
2023-08-24 17:16:19 -06:00
uring_cmd.h
io_uring: Remove unnecessary BUILD_BUG_ON
2023-05-04 08:19:05 -06:00
xattr.c
io_uring: for requests that require async, force it
2023-01-29 15:18:26 -07:00
xattr.h
…