Jan Beulich
cb8095bba6
x86: atomic64 assembly improvements ...
In the "xchg" implementation, %ebx and %ecx don't need to be copied
into %eax and %edx respectively (this is only necessary when desiring
to only read the stored value).
In the "add_unless" implementation, swapping the use of %ecx and %esi
for passing arguments allows %esi to become an input only (i.e.
permitting the register to be re-used to address the same object
without reload).
In "{add,sub}_return", doing the initial read64 through the passed in
%ecx decreases a register dependency.
In "inc_not_zero", a branch can be eliminated by or-ing together the
two halves of the current (64-bit) value, and code size can be further
reduced by adjusting the arithmetic slightly.
v2: Undo the folding of "xchg" and "set".
Signed-off-by: Jan Beulich <jbeulich@suse.com>
Link: http://lkml.kernel.org/r/4F19A2BC020000780006E0DC@nat28.tlf.novell.com
Cc: Luca Barbieri <luca@luca-barbieri.com>
Cc: Eric Dumazet <eric.dumazet@gmail.com>
Signed-off-by: H. Peter Anvin <hpa@linux.intel.com>
2012-01-20 17:29:49 -08:00
2011-12-05 17:17:24 +01:00
2012-01-17 09:09:59 +01:00
2010-02-19 16:12:29 -08:00
2011-11-06 20:15:05 -08:00
2009-11-10 11:23:05 +01:00
2011-05-29 11:18:09 -07:00
2009-02-18 16:48:05 +08:00
2009-08-03 09:05:00 +01:00
2012-01-04 15:01:56 +01:00
2012-01-20 17:29:31 -08:00
2012-01-06 12:11:19 -08:00
2011-07-23 10:34:47 -07:00
2011-12-05 17:17:07 +01:00
2011-12-23 11:01:43 -08:00
2011-12-23 11:01:01 -08:00
2009-01-29 14:16:51 +01:00
2010-05-17 15:17:16 -07:00
2011-07-31 14:02:19 -07:00
2009-12-12 13:08:14 +01:00
2011-07-21 09:03:36 +02:00
2012-01-20 17:29:49 -08:00
2011-08-29 13:44:12 -07:00
2011-08-29 13:44:12 -07:00
2011-04-29 14:13:15 -07:00
2011-12-15 15:16:49 -08:00
2009-06-11 21:02:14 +02:00
2011-01-13 08:03:25 -08:00
2011-12-09 17:35:33 -08:00
2009-12-05 09:10:12 -08:00
2009-01-14 19:56:50 -08:00
2010-03-03 11:26:00 +01:00
2011-03-18 10:39:30 +01:00
2010-08-26 15:13:13 -07:00
2011-06-03 14:38:53 -07:00
2011-03-14 15:13:23 +01:00
2009-10-01 16:11:12 -07:00
2011-07-21 13:34:05 -07:00
2012-01-04 15:01:54 +01:00
2012-01-04 15:01:54 +01:00
2012-01-04 15:01:54 +01:00
2011-10-28 14:58:53 +02:00
2011-02-14 12:08:28 +01:00
2011-12-27 11:22:01 +02:00
2009-03-13 14:49:54 +10:30
2009-08-04 01:28:52 +09:00
2011-12-21 15:38:56 -05:00
2011-07-22 18:46:24 +02:00
2009-12-04 15:39:55 +01:00
2011-12-21 15:38:55 -05:00
2011-09-21 10:22:03 +02:00
2011-12-05 18:16:11 +01:00
2011-09-27 18:08:04 +02:00
2011-05-02 17:24:48 +02:00
2009-03-23 17:20:50 +01:00
2011-09-28 19:04:52 +02:00
2011-12-12 18:25:56 +01:00
2012-01-11 19:12:33 -08:00
2011-08-05 12:26:44 -07:00
2011-06-16 12:10:08 +02:00
2010-02-16 21:22:26 -08:00
2011-12-18 09:17:02 +01:00
2011-07-21 09:03:31 +02:00
2011-05-16 14:55:57 -04:00
2011-03-11 12:23:31 +01:00
2011-04-18 09:26:48 -07:00
2009-02-17 17:52:43 +01:00
2009-12-15 08:53:28 -08:00
2011-01-11 12:46:15 +01:00
2011-12-18 10:46:48 +01:00
2010-10-26 16:52:08 -07:00
2010-10-12 16:53:37 +02:00
2010-09-17 03:24:13 +02:00
2011-09-21 10:22:03 +02:00
2011-08-25 15:23:19 -07:00
2011-01-07 10:03:50 -05:00
2011-12-06 09:06:38 +01:00
2010-10-12 16:53:36 +02:00
2011-11-17 13:35:37 -08:00
2009-03-27 14:43:57 -04:00
2011-05-29 03:38:57 -04:00
2009-08-27 00:35:56 +02:00
2009-10-29 08:47:46 +01:00
2011-11-11 10:22:55 +01:00
2011-11-10 12:38:51 +01:00
2010-03-24 21:37:57 +08:00
2011-12-05 12:42:11 +01:00
2011-05-20 13:41:01 +02:00
2011-08-03 22:00:38 -10:00
2009-06-18 14:40:03 -07:00
2010-10-26 16:52:08 -07:00
2010-10-08 13:11:21 -07:00
2011-11-15 12:22:31 +01:00
2009-06-18 14:40:03 -07:00
2011-01-28 14:54:05 +01:00
2011-02-23 22:27:53 +01:00
2009-01-21 17:26:06 +09:00
2011-09-21 10:22:03 +02:00
2011-10-13 12:12:12 +02:00
2011-02-23 22:27:52 +01:00
2011-07-07 19:22:32 +02:00
2011-04-04 13:42:51 -04:00
2011-11-17 13:35:37 -08:00
2011-07-26 16:49:43 -07:00
2009-03-10 18:13:25 -07:00
2011-05-26 17:12:36 -07:00
2009-06-16 19:47:51 -07:00
2009-06-13 15:37:30 +02:00
2010-03-10 13:23:34 +01:00
2011-12-27 11:24:43 +02:00
2011-12-27 11:24:35 +02:00
2011-07-24 11:49:36 +03:00
2010-08-01 10:46:37 +03:00
2011-07-22 14:39:50 +09:30
2009-08-25 15:40:29 -07:00
2011-05-24 14:33:35 +02:00
2010-06-09 11:12:36 +02:00
2011-07-26 16:49:47 -07:00
2011-11-21 19:00:57 -08:00
2011-11-10 16:21:01 +01:00
2009-02-10 00:39:14 +01:00
2011-12-18 09:14:31 +01:00
2012-01-16 17:08:42 -08:00
2011-12-14 12:46:47 +01:00
2009-06-18 14:40:03 -07:00
2011-07-26 16:49:47 -07:00
2011-05-25 16:16:41 +02:00
2011-07-12 21:58:11 -07:00
2011-06-27 14:13:09 -07:00
2011-04-08 13:01:25 -07:00
2011-01-05 14:09:23 +01:00
2011-01-28 14:54:09 +01:00
2010-11-11 11:34:27 +01:00
2012-01-09 12:09:24 -08:00
2009-06-18 14:40:03 -07:00
2010-05-07 17:13:04 -07:00
2009-03-17 15:38:59 -07:00
2011-09-25 19:53:00 +03:00
2011-12-05 14:28:37 +01:00
2009-08-21 17:00:02 -07:00
2010-09-17 15:36:40 -07:00
2011-10-10 06:57:01 +02:00
2011-04-18 16:40:21 -07:00
2011-05-02 14:18:53 +02:00
2011-05-02 14:18:53 +02:00
2011-05-02 17:24:48 +02:00
2011-05-02 14:18:53 +02:00
2011-03-15 14:17:23 -07:00
2011-07-06 14:44:38 -07:00
2010-06-29 12:12:59 +02:00
2009-02-13 13:36:47 +01:00
2009-06-20 15:40:00 -07:00
2009-02-11 14:54:09 -08:00
2011-03-04 10:26:36 +01:00
2010-08-11 08:43:49 +02:00
2009-06-18 14:40:03 -07:00
2011-08-12 20:46:24 -07:00
2011-07-14 12:59:44 +03:00
2009-11-23 17:09:59 -08:00
2010-02-10 17:47:18 -08:00
2012-01-06 12:10:42 -08:00
2009-01-29 14:16:51 +01:00
2012-01-06 14:02:26 -08:00
2012-01-09 13:08:28 -08:00
2011-07-21 20:41:54 +02:00
2011-12-21 10:26:32 +01:00
2010-11-01 15:38:34 -04:00
2010-06-07 17:27:11 -07:00
2010-10-26 16:52:08 -07:00
2009-05-05 19:10:18 -07:00
2011-01-13 17:32:44 -08:00
2011-06-05 21:30:33 +02:00
2009-02-13 11:35:01 -08:00
2011-01-13 17:32:44 -08:00
2009-02-13 11:35:01 -08:00
2011-03-18 11:44:01 +01:00
2011-12-18 09:14:18 +01:00
2009-02-02 23:27:09 +05:30
2011-03-15 15:34:15 -07:00
2011-12-06 10:02:38 +01:00
2011-12-21 15:38:56 -05:00
2011-07-26 16:49:47 -07:00
2010-02-12 09:42:39 -08:00
2011-03-18 10:39:30 +01:00
2011-08-04 16:13:49 -07:00
2010-05-19 11:41:05 +03:00
2011-08-30 14:42:30 +03:00
2011-10-10 06:56:57 +02:00
2010-07-07 17:29:18 -07:00
2011-07-21 09:03:36 +02:00
2011-08-29 13:44:12 -07:00
2010-08-07 18:15:50 +02:00
2009-03-02 15:41:30 -08:00
2009-03-02 15:41:30 -08:00
2009-10-20 14:46:00 +09:00
2011-06-03 14:39:14 -07:00
2011-11-21 16:13:23 +08:00
2009-01-29 14:16:51 +01:00
2011-12-18 09:17:02 +01:00
2009-06-18 14:40:03 -07:00
2009-01-31 00:18:58 +05:30
2009-12-04 23:41:47 +01:00
2009-06-11 21:01:52 +02:00
2011-12-05 12:00:16 +01:00
2011-07-21 09:20:59 +02:00
2009-06-18 14:40:03 -07:00
2009-06-18 14:40:03 -07:00
2009-05-05 19:10:18 -07:00
2011-08-29 13:46:34 -07:00
2011-11-25 10:42:59 -08:00
2009-09-03 21:30:51 +02:00
2011-05-12 15:31:28 +02:00
2009-09-28 16:43:15 -07:00
2009-06-15 12:40:02 +02:00
2011-05-24 23:35:55 +02:00
2011-05-24 23:35:55 +02:00
2011-01-12 11:31:07 +02:00
2009-01-31 00:19:32 +05:30
2010-08-26 15:13:29 -07:00
2010-08-13 16:53:13 -07:00
2012-01-07 14:10:18 -08:00
2010-08-17 18:07:43 -07:00
2011-12-03 10:49:58 -08:00
2009-06-18 14:40:03 -07:00
2009-06-18 14:40:03 -07:00
2012-01-16 09:39:54 +01:00
2011-06-09 15:01:40 +02:00
2011-11-16 19:51:25 +01:00
2009-06-16 19:47:27 -07:00
2010-10-20 14:23:55 -07:00
2012-01-11 18:50:26 -08:00
2011-02-17 21:05:06 -08:00
2011-08-10 19:26:46 -05:00
2011-12-05 18:00:31 +01:00
2011-03-23 19:47:18 -07:00
2011-05-20 12:50:29 -07:00
2011-05-20 12:50:29 -07:00
2011-12-05 12:17:27 +01:00
2009-06-18 14:40:03 -07:00
2012-01-19 12:57:09 -08:00
2010-02-11 15:08:17 -08:00
2011-05-24 14:51:28 +02:00
2011-07-14 17:57:05 -07:00
2009-03-24 11:02:46 +02:00
2011-09-25 19:52:17 +03:00
2011-08-10 19:26:46 -05:00
2011-06-05 21:30:32 +02:00
2011-05-20 13:41:11 +02:00
2012-01-11 18:50:26 -08:00
2009-06-15 12:40:02 +02:00
2010-08-06 16:25:13 -07:00
cb8095bba6