Jussi Kivilinna 8280daad43 crypto: twofish - add 3-way parallel x86_64 assembler implemention ...

Patch adds 3-way parallel x86_64 assembly implementation of twofish as new
module. New assembler functions crypt data in three blocks chunks, improving
cipher performance on out-of-order CPUs.

Patch has been tested with tcrypt and automated filesystem tests.

Summary of the tcrypt benchmarks:

Twofish 3-way-asm vs twofish asm (128bit 8kb block ECB)
 encrypt: 1.3x speed
 decrypt: 1.3x speed

Twofish 3-way-asm vs twofish asm (128bit 8kb block CBC)
 encrypt: 1.07x speed
 decrypt: 1.4x speed

Twofish 3-way-asm vs twofish asm (128bit 8kb block CTR)
 encrypt: 1.4x speed

Twofish 3-way-asm vs AES asm (128bit 8kb block ECB)
 encrypt: 1.0x speed
 decrypt: 1.0x speed

Twofish 3-way-asm vs AES asm (128bit 8kb block CBC)
 encrypt: 0.84x speed
 decrypt: 1.09x speed

Twofish 3-way-asm vs AES asm (128bit 8kb block CTR)
 encrypt: 1.15x speed

Full output:
 http://koti.mbnet.fi/axh/kernel/crypto/tcrypt-speed-twofish-3way-asm-x86_64.txt
 http://koti.mbnet.fi/axh/kernel/crypto/tcrypt-speed-twofish-asm-x86_64.txt
 http://koti.mbnet.fi/axh/kernel/crypto/tcrypt-speed-aes-asm-x86_64.txt

Tests were run on:
 vendor_id  : AuthenticAMD
 cpu family : 16
 model      : 10
 model name : AMD Phenom(tm) II X6 1055T Processor

Also userspace test were run on:
 vendor_id  : GenuineIntel
 cpu family : 6
 model      : 15
 model name : Intel(R) Xeon(R) CPU           E7330  @ 2.40GHz
 stepping   : 11

Userspace test results:

Encryption/decryption of twofish 3-way vs x86_64-asm on AMD Phenom II:
 encrypt: 1.27x
 decrypt: 1.25x

Encryption/decryption of twofish 3-way vs x86_64-asm on Intel Xeon E7330:
 encrypt: 1.36x
 decrypt: 1.36x

Signed-off-by: Jussi Kivilinna <jussi.kivilinna@mbnet.fi>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>

2011-10-21 14:23:08 +02:00

..

async_tx

net: remove mm.h inclusion from netdevice.h

2011-06-21 19:17:20 -07:00

ablkcipher.c

crypto: skcipher - remove redundant NULL check

2011-01-29 15:09:43 +11:00

aead.c

crypto: aead - Fix checkpatch errors

2010-02-16 20:24:07 +08:00

aes_generic.c

crypto: aes_generic - Fix checkpatch errors

2010-02-16 20:34:59 +08:00

af_alg.c

atomic: use <linux/atomic.h>

2011-07-26 16:49:47 -07:00

ahash.c

crypto: hash - Fix handling of small unaligned buffers

2010-08-06 09:26:38 +08:00

algapi.c

Merge git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6

2010-05-03 11:28:58 +08:00

algboss.c

crypto: testmgr - Fix test disabling option

2010-08-06 09:40:28 +08:00

algif_hash.c

crypto: algif_hash - Handle initial af_alg_make_sg error correctly

2011-06-30 07:44:06 +08:00

algif_skcipher.c

crypto: algif_skcipher - Handle unaligned receive buffer

2010-11-30 17:04:31 +08:00

ansi_cprng.c

Fix common misspellings

2011-03-31 11:26:23 -03:00

anubis.c

crypto: anubis - Fix checkpatch errors

2010-02-16 20:25:39 +08:00

api.c

crypto: api - Fix checkpatch errors

2010-02-16 20:26:46 +08:00

arc4.c

crypto: arc4 - Fixed coding style issues

2011-06-30 07:44:05 +08:00

authenc.c

crypto: Use scatterwalk_crypto_chain

2010-12-02 14:47:16 +08:00

authencesn.c

crypto: authencesn - Add algorithm to handle IPsec extended sequence numbers

2011-03-13 20:22:27 -07:00

blkcipher.c

mm: strictly nested kmap_atomic()

2010-10-26 16:52:08 -07:00

blowfish_common.c

crypto: blowfish - split generic and common c code

2011-09-22 21:25:25 +10:00

blowfish_generic.c

crypto: blowfish - rename C-version to blowfish_generic

2011-09-22 21:25:26 +10:00

camellia.c

crypto: camellia - Fix checkpatch errors

2010-02-16 20:27:57 +08:00

cast5.c

crypto: cast5 - simplify if-statements

2010-11-13 21:47:55 +09:00

cast6.c

crypto: cast6 - Fix checkpatch errors

2010-02-16 20:29:45 +08:00

cbc.c

Convert ERR_PTR(PTR_ERR(p)) instances to ERR_CAST(p)

2008-02-07 08:42:26 -08:00

ccm.c

crypto: ccm - Fix handling of null assoc data

2009-01-27 17:11:15 +11:00

chainiv.c

crypto: chainiv - Use kcrypto_wq instead of keventd_wq

2009-02-19 14:44:02 +08:00

cipher.c

crypto: cipher - Fix checkpatch errors

2010-02-16 20:31:37 +08:00

compress.c

crypto: compress - Fix checkpatch errors

2010-02-16 20:31:04 +08:00

crc32c.c

crypto: crc32c - Fixed coding style issue

2011-06-30 07:44:05 +08:00

cryptd.c

crypto: cryptd - Use subsys_initcall to prevent races with aesni

2011-08-20 16:08:03 +08:00

crypto_null.c

crypto: crypto_null - Fix checkpatch errors

2010-02-16 20:31:54 +08:00

crypto_wq.c

crypto: mark crypto workqueues CPU_INTENSIVE

2011-01-04 23:34:08 +11:00

ctr.c

crypto: Use ERR_CAST

2010-05-26 10:36:51 +10:00

cts.c

[CRYPTO] cts: Init SG tables

2008-06-02 15:46:51 +10:00

deflate.c

net+crypto: Use vmalloc for zlib inflate buffers.

2011-06-29 05:48:41 -07:00

des_generic.c

Blackfin: Rename DES PC2() symbol to avoid collision

2010-10-07 14:08:50 +01:00

ecb.c

crypto: ecb - Fix checkpatch errors

2010-02-16 20:33:49 +08:00

eseqiv.c

crypto: Use scatterwalk_crypto_chain

2010-12-02 14:47:16 +08:00

fcrypt.c

crypto: fcrypt - Fix checkpatch errors

2010-02-16 20:34:07 +08:00

fips.c

crypto: api - Add fips_enable flag

2008-08-29 15:50:02 +10:00

gcm.c

crypto: Use scatterwalk_crypto_chain

2010-12-02 14:47:16 +08:00

gf128mul.c

crypto: gf128mul - fix call to memset()

2011-07-08 17:21:21 +08:00

ghash-generic.c

crypto: ghash - Add GHASH digest algorithm for GCM

2009-08-06 15:32:38 +10:00

hmac.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

internal.h

crypto: internal - Fix checkpatch errors

2010-03-10 18:24:46 +08:00

Kconfig

crypto: twofish - add 3-way parallel x86_64 assembler implemention

2011-10-21 14:23:08 +02:00

khazad.c

[CRYPTO] all: Clean up init()/fini()

2008-04-21 10:19:34 +08:00

krng.c

crypto: rng - RNG interface and implementation

2008-08-29 15:50:04 +10:00

lrw.c

crypto: lrw - Fix big endian support

2009-02-17 20:00:11 +08:00

lzo.c

[CRYPTO] all: Clean up init()/fini()

2008-04-21 10:19:34 +08:00

Makefile

crypto: blowfish - rename C-version to blowfish_generic

2011-09-22 21:25:26 +10:00

md4.c

crypto: md4 - Switch to shash

2008-12-25 11:02:16 +11:00

md5.c

crypto: md5 - Set statesize

2010-03-02 21:58:16 +08:00

michael_mic.c

crypto: michael_mic - Switch to shash

2008-12-25 11:02:24 +11:00

pcbc.c

Convert ERR_PTR(PTR_ERR(p)) instances to ERR_CAST(p)

2008-02-07 08:42:26 -08:00

pcompress.c

crypto: api - Remove frontend argument from extsize/init_tfm

2009-07-14 12:58:15 +08:00

pcrypt.c

Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6

2011-01-13 10:25:58 -08:00

proc.c

atomic: use <linux/atomic.h>

2011-07-26 16:49:47 -07:00

ripemd.h

[CRYPTO] ripemd: Put all common RIPEMD values in header file

2008-07-10 20:35:12 +08:00

rmd128.c

crypto: ripemd - Set module author and update email address

2011-01-04 23:34:03 +11:00

rmd160.c

crypto: ripemd - Set module author and update email address

2011-01-04 23:34:03 +11:00

rmd256.c

crypto: ripemd - Set module author and update email address

2011-01-04 23:34:03 +11:00

rmd320.c

crypto: ripemd - Set module author and update email address

2011-01-04 23:34:03 +11:00

rng.c

atomic: use <linux/atomic.h>

2011-07-26 16:49:47 -07:00

salsa20_generic.c

crypto: salsa20 - Remove private wrappers around various operations

2008-12-25 11:02:30 +11:00

scatterwalk.c

crypto: scatterwalk - Fix scatterwalk_done() test

2010-05-19 14:06:29 +10:00

seed.c

[CRYPTO] seed: New cipher algorithm

2007-10-10 16:55:38 -07:00

seqiv.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

serpent.c

[CRYPTO] all: Clean up init()/fini()

2008-04-21 10:19:34 +08:00

sha1_generic.c

crypto: sha1 - export sha1_update for reuse

2011-08-10 19:00:28 +08:00

sha256_generic.c

crypto: sha256_generic - Add export/import support

2009-07-11 18:23:34 +08:00

sha512_generic.c

crypto: sha512_generic - Use 64-bit counters

2009-07-22 14:38:13 +08:00

shash.c

crypto: hash - Fix async import on shash algorithm

2010-11-04 14:48:37 -04:00

tcrypt.c

crypto: tcrypt - add ctr(twofish) speed test

2011-10-21 14:23:08 +02:00

tcrypt.h

crypto: tcrypt - Speed testing support for ghash

2010-03-10 18:30:32 +08:00

tea.c

[CRYPTO] all: Clean up init()/fini()

2008-04-21 10:19:34 +08:00

testmgr.c

crypto: testmgr - add support for aes ofb mode

2011-05-04 15:04:10 +10:00

testmgr.h

crypto: testmgr - add xts-aes-256 self-test

2011-06-30 07:44:00 +08:00

tgr192.c

crypto: tgr192 - Switch to shash

2008-12-25 11:02:21 +11:00

twofish_common.c

[CRYPTO] twofish: Do not unroll big stuff in twofish key setup

2008-01-11 08:16:06 +11:00

twofish_generic.c

crypto: twofish: Rename twofish to twofish_generic and add an alias

2010-06-03 21:02:51 +10:00

vmac.c

Fix common misspellings

2011-03-31 11:26:23 -03:00

wp512.c

crypto: wp512 - Switch to shash

2008-12-25 11:02:22 +11:00

xcbc.c

crypto: xcbc - Fix alignment calculation of xcbc_tfm_ctx

2009-08-20 17:58:04 +10:00

xor.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

xts.c

Fix common misspellings

2011-03-31 11:26:23 -03:00

zlib.c

net+crypto: Use vmalloc for zlib inflate buffers.

2011-06-29 05:48:41 -07:00