iv/linux
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
linux/crypto
History
Eric Dumazet 1abe267f17 net: add sk_wake_async_rcu() helper 
While looking at UDP receive performance, I saw sk_wake_async()
was no longer inlined.

This matters at least on AMD Zen1-4 platforms (see SRSO)

This might be because rcu_read_lock() and rcu_read_unlock()
are no longer nops in recent kernels ?

Add sk_wake_async_rcu() variant, which must be called from
contexts already holding rcu lock.

As SOCK_FASYNC is deprecated in modern days, use unlikely()
to give a hint to the compiler.

sk_wake_async_rcu() is properly inlined from
__udp_enqueue_schedule_skb() and sock_def_readable().

Signed-off-by: Eric Dumazet <edumazet@google.com>
Link: https://lore.kernel.org/r/20240328144032.1864988-5-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
2024-03-29 15:03:11 -07:00
..
asymmetric_keys
Revert "crypto: pkcs7 - remove sha1 support"
2024-03-22 19:42:20 +08:00
async_tx
async_tx: fix kernel-doc notation warnings
2023-03-24 18:22:28 +08:00
842.c
…
acompress.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
adiantum.c
crypto: adiantum - flush destination page before unmapping
2023-11-01 12:58:42 +08:00
aead.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
aegis128-core.c
crypto: aegis128 - Move simd prototypes into aegis.h
2021-03-19 21:59:45 +11:00
aegis128-neon-inner.c
crypto: aegis128-neon - add header for internal prototypes
2023-05-24 18:12:33 +08:00
aegis128-neon.c
crypto: aegis128-neon - add header for internal prototypes
2023-05-24 18:12:33 +08:00
aegis-neon.h
crypto: aegis128-neon - add header for internal prototypes
2023-05-24 18:12:33 +08:00
aegis.h
crypto: aegis128 - Move simd prototypes into aegis.h
2021-03-19 21:59:45 +11:00
aes_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
aes_ti.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
af_alg.c
net: add sk_wake_async_rcu() helper
2024-03-29 15:03:11 -07:00
ahash.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
akcipher.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
algapi.c
crypto: api - Disallow identical driver names
2023-12-15 17:52:53 +08:00
algboss.c
crypto: algboss - compile out test-related code when tests disabled
2022-11-25 17:39:18 +08:00
algif_aead.c
sock: Remove ->sendpage*() in favour of sendmsg(MSG_SPLICE_PAGES)
2023-06-24 15:50:13 -07:00
algif_hash.c
crypto: algif_hash - Remove bogus SGL free on zero-length error path
2024-02-02 18:08:12 +08:00
algif_rng.c
sock: Remove ->sendpage*() in favour of sendmsg(MSG_SPLICE_PAGES)
2023-06-24 15:50:13 -07:00
algif_skcipher.c
crypto: algif_skcipher - Fix stream cipher chaining
2023-12-08 11:59:46 +08:00
ansi_cprng.c
crypto: remove cipher routines from public crypto API
2021-01-03 08:41:35 +11:00
anubis.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
api.c
crypto: api - Remove unnecessary NULL initialisation
2023-09-20 13:15:29 +08:00
arc4.c
crypto: arc4 - Add internal state
2023-12-08 11:59:46 +08:00
aria_generic.c
crypto: x86/aria - do not use magic number offsets of aria_ctx
2023-01-06 17:15:47 +08:00
authenc.c
crypto: authenc - stop using alignmask of ahash
2023-10-27 18:04:29 +08:00
authencesn.c
crypto: authencesn - stop using alignmask of ahash
2023-10-27 18:04:29 +08:00
blake2b_generic.c
treewide: update LLVM Bugzilla links
2024-02-22 15:38:51 -08:00
blowfish_common.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
blowfish_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
camellia_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
cast5_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
cast6_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
cast_common.c
…
cbc.c
crypto: cbc - Ensure statesize is zero
2024-02-02 18:08:12 +08:00
ccm.c
crypto: ccm - stop using alignmask of ahash
2023-10-27 18:04:29 +08:00
chacha20poly1305.c
crypto: chacha20poly1305 - stop using alignmask of ahash
2023-10-27 18:04:29 +08:00
chacha_generic.c
…
cipher.c
crypto: cipher - On clone do crypto_mod_get()
2023-06-23 16:15:36 +08:00
cmac.c
crypto: cmac - remove unnecessary alignment logic
2023-10-27 18:04:24 +08:00
compress.c
…
compress.h
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
crc32_generic.c
crypto: crc32-generic - Use SPDX-License-Identifier
2021-04-16 21:24:27 +10:00
crc32c_generic.c
crypto: crc32c_generic - delete and fix duplicated words
2020-08-21 14:45:25 +10:00
crc64_rocksoft_generic.c
crypto: add rocksoft 64b crc guard tag framework
2022-03-07 12:48:35 -07:00
crct10dif_common.c
…
crct10dif_generic.c
crypto: crct10dif_generic - fix duplicated words
2020-08-21 14:45:25 +10:00
cryptd.c
crypto: cryptd - Only access common skcipher fields on spawn
2023-10-13 18:27:26 +08:00
crypto_engine.c
crypto: engine - Make crypto_engine_exit() return void
2023-10-01 16:28:15 +08:00
crypto_null.c
…
crypto_user_base.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
crypto_user_stat.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
ctr.c
crypto: ctr - Only access common skcipher fields on spawn
2023-10-13 18:27:27 +08:00
cts.c
crypto: cts - Only access common skcipher fields on spawn
2023-10-13 18:27:27 +08:00
curve25519-generic.c
crypto: add __init/__exit annotations to init/exit funcs
2022-09-24 16:14:43 +08:00
deflate.c
crypto: deflate - Remove zlib-deflate
2023-10-12 21:59:32 +08:00
des_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
dh_helper.c
crypto: dh - split out deserialization code from crypto_dh_decode()
2022-03-03 10:47:50 +12:00
dh.c
crypto: dh - Make public key test FIPS-only
2024-03-01 18:35:40 +08:00
drbg.c
crypto: drbg - Remove SHA1 from drbg
2023-11-17 19:16:29 +08:00
ecb.c
crypto: skcipher - Add internal state support
2023-12-08 11:59:46 +08:00
ecc_curve_defs.h
Merge branch 'ecc'
2021-03-26 19:55:55 +11:00
ecc.c
crypto: ecc - Silence sparse warning
2023-02-14 13:39:33 +08:00
ecdh_helper.c
crypto: ecdh - move curve_id of ECDH from the key to algorithm name
2021-03-13 00:04:03 +11:00
ecdh.c
crypto: add __init/__exit annotations to init/exit funcs
2022-09-24 16:14:43 +08:00
ecdsa.c
crypto: add __init/__exit annotations to init/exit funcs
2022-09-24 16:14:43 +08:00
ecdsasignature.asn1
crypto: ecdsa - Add support for ECDSA signature verification
2021-03-26 19:41:58 +11:00
echainiv.c
crypto: geniv - remove unneeded arguments from aead_geniv_alloc()
2020-07-16 21:49:07 +10:00
ecrdsa_defs.h
crypto: ecc - Move ecc.h to include/crypto/internal
2021-10-29 21:04:03 +08:00
ecrdsa_params.asn1
…
ecrdsa_pub_key.asn1
…
ecrdsa.c
crypto: ecrdsa - Fix incorrect use of vli_cmp
2022-04-29 13:44:58 +08:00
essiv.c
crypto: essiv - Handle lskcipher spawns
2023-10-13 18:27:26 +08:00
fcrypt.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
fips.c
crypto: fips - simplify one-level sysctl registration for crypto_sysctl_table
2023-03-17 11:16:44 +08:00
gcm.c
crypto: gcm - stop using alignmask of ahash
2023-10-27 18:04:29 +08:00
geniv.c
crypto: algapi - use common mechanism for inheriting flags
2020-07-16 21:49:08 +10:00
ghash-generic.c
crypto: remove CRYPTO_TFM_RES_BAD_KEY_LEN
2020-01-09 11:30:53 +08:00
hash_info.c
crypto: FIPS 202 SHA-3 register in hash info for IMA
2023-10-27 18:04:30 +08:00
hash.h
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
hctr2.c
crypto: hctr2 - stop using alignmask of shash_alg
2023-10-27 18:04:25 +08:00
hmac.c
crypto: hmac - remove unnecessary alignment logic
2023-10-27 18:04:24 +08:00
internal.h
crypto: sig - Fix verify call
2023-06-27 15:40:24 +08:00
jitterentropy-kcapi.c
crypto: jitter - reuse allocated entropy collector
2023-10-13 18:31:07 +08:00
jitterentropy-testing.c
crypto: jitter - add interface for gathering of raw entropy
2023-05-12 18:48:01 +08:00
jitterentropy.c
crypto: jitter - use permanent health test storage
2023-10-27 18:04:25 +08:00
jitterentropy.h
crypto: jitter - reuse allocated entropy collector
2023-10-13 18:31:07 +08:00
Kconfig
RISC-V Patches for the 6.9 Merge Window
2024-03-22 10:41:13 -07:00
kdf_sp800108.c
crypto: kdf - silence noisy self-test
2022-11-25 17:39:18 +08:00
keywrap.c
crypto: keywrap - Remove else after break statement
2021-04-02 18:28:13 +11:00
khazad.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
kpp.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
lrw.c
crypto: lrw - Only access common skcipher fields on spawn
2023-10-13 18:27:27 +08:00
lskcipher.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
lz4.c
…
lz4hc.c
…
lzo-rle.c
…
lzo.c
…
Makefile
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
md4.c
…
md5.c
crypto: md5 - remove unused macros
2020-02-28 08:43:21 +08:00
michael_mic.c
crypto: michael_mic - fix broken misalignment handling
2021-02-10 17:55:55 +11:00
nhpoly1305.c
crypto: poly1305 - add new 32 and 64-bit generic versions
2020-01-16 15:18:12 +08:00
pcbc.c
crypto: pcbc - remove redundant assignment to nbytes
2024-01-26 16:39:32 +08:00
pcrypt.c
crypto: pcrypt - Fix hungtask for PADATA_RESET
2023-09-15 18:29:45 +08:00
poly1305_generic.c
crypto: poly1305 - add new 32 and 64-bit generic versions
2020-01-16 15:18:12 +08:00
polyval-generic.c
crypto: x86/polyval - Add PCLMULQDQ accelerated implementation of POLYVAL
2022-06-10 16:40:17 +08:00
proc.c
crypto: proc - Print fips status
2023-02-14 13:39:33 +08:00
ripemd.h
crypto: rmd320 - remove RIPE-MD 320 hash algorithm
2021-01-29 16:07:04 +11:00
rmd160.c
…
rng.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
rsa_helper.c
…
rsa-pkcs1pad.c
crypto: rsa-pkcs1pad - Add FIPS 202 SHA-3 support
2023-10-27 18:04:30 +08:00
rsa.c
crypto: rsa - restrict plaintext/ciphertext values more
2024-02-09 12:57:18 +08:00
rsaprivkey.asn1
treewide: Add SPDX identifier to IETF ASN.1 modules
2023-10-27 18:04:28 +08:00
rsapubkey.asn1
treewide: Add SPDX identifier to IETF ASN.1 modules
2023-10-27 18:04:28 +08:00
scatterwalk.c
…
scompress.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
seed.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
seqiv.c
crypto: api - Use data directly in completion function
2023-02-13 18:35:14 +08:00
serpent_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
sha1_generic.c
crypto: sha - split sha.h into sha1.h and sha2.h
2020-11-20 14:45:33 +11:00
sha3_generic.c
crypto: Replace HTTP links with HTTPS ones
2020-07-23 17:34:20 +10:00
sha256_generic.c
crypto: sha256 - remove duplicate generic hash init function
2021-12-31 18:10:54 +11:00
sha512_generic.c
crypto: sha512 - remove imaginary and mystifying clearing of variables
2021-08-27 16:30:19 +08:00
shash.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
sig.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
simd.c
crypto: algapi - use common mechanism for inheriting flags
2020-07-16 21:49:08 +10:00
skcipher.c
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
skcipher.h
Revert "crypto: remove CONFIG_CRYPTO_STATS"
2024-03-13 09:49:37 +08:00
sm2.c
crypto: sm2 - Fix crash caused by uninitialized context
2023-09-20 13:10:10 +08:00
sm2signature.asn1
crypto: sm2 - introduce OSCCA SM2 asymmetric cipher algorithm
2020-09-25 17:48:54 +10:00
sm3_generic.c
crypto: sm3 - make dependent on sm3 library
2022-01-28 16:51:11 +11:00
sm3.c
crypto: sm3,sm4 - move into crypto directory
2022-04-08 16:11:48 +08:00
sm4_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
sm4.c
crypto: sm4 - export sm4 constant arrays
2022-04-08 16:12:46 +08:00
streebog_generic.c
…
tcrypt.c
crypto: tcrypt - add ffdhe2048(dh) test
2024-03-08 19:23:25 +08:00
tcrypt.h
crypto: tcrypt - include larger key sizes in RFC4106 benchmark
2023-01-20 18:29:31 +08:00
tea.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
testmgr.c
crypto: testmgr - remove unused xts4096 and xts512 algorithms from testmgr.c
2024-01-26 16:39:33 +08:00
testmgr.h
Revert "crypto: pkcs7 - remove sha1 support"
2024-03-22 19:42:20 +08:00
twofish_common.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
twofish_generic.c
crypto: Prepare to move crypto_tfm_ctx
2022-12-02 18:12:40 +08:00
vmac.c
crypto: vmac - don't set alignmask
2023-10-27 18:04:24 +08:00
wp512.c
crypto: wp512 - disable kmsan checks in wp512_process_buffer()
2022-12-30 22:56:27 +08:00
xcbc.c
crypto: xcbc - remove unnecessary alignment logic
2023-10-27 18:04:25 +08:00
xctr.c
crypto: xctr - Add XCTR support
2022-06-10 16:40:16 +08:00
xor.c
Merge branch 'linus' of git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
2021-02-21 17:23:56 -08:00
xts.c
crypto: xts - use 'spawn' for underlying single-block cipher
2023-10-20 13:39:25 +08:00
xxhash_generic.c
crypto: remove CRYPTO_TFM_RES_BAD_KEY_LEN
2020-01-09 11:30:53 +08:00
zstd.c
lib: zstd: Add kernel-specific API
2021-11-08 16:55:21 -08:00