Douglas Bagnall 949fe57077 libutil/iconv: don't allow wtf-8 surrogate pairs ...

At present, if we meet a string like "hello \xed\xa7\x96 world", the
bytes in the middle will be converted into half of a surrogate pair,
and the UTF-16 will be invalid. It is better to error out immediately,
because the UTF-8 string is already invalid.

https://learn.microsoft.com/en-us/windows/win32/api/Stringapiset/nf-stringapiset-widechartomultibyte#remarks
is a citation for the statement about this being a pre-Vista
problem.

Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
Reviewed-by: Andrew Bartlett <abartlet@samba.org>

2023-10-26 01:24:32 +00:00

..

tests

util/charset/torture: test convert_string_talloc with emptyish strings

2023-10-26 01:24:32 +00:00

charset_macosxfs.c

lib:util: Fix code spelling

2023-04-14 05:25:33 +00:00

charset_proto.h

s3: Fix fn signatures in charset_macosx.c

2011-12-25 13:31:58 +01:00

charset.h

util/str: helper to check for utf-8 validity

2023-09-26 23:45:36 +00:00

codepoints.c

lib:util: Fix code spelling

2023-04-14 05:25:33 +00:00

convert_string.c

util/convert string: remove inaccurate misspelt comment

2023-10-26 01:24:32 +00:00

iconv.c

libutil/iconv: don't allow wtf-8 surrogate pairs

2023-10-26 01:24:32 +00:00

pull_push.c

lib/util/charset: @param typos

2023-10-26 01:24:32 +00:00

util_str.c

lib:charset: Fix code spelling

2023-09-11 02:42:41 +00:00

util_unistr_w.c

lib: Avoid "includes.h" in lib/util/charset/

2021-01-12 00:10:30 +00:00

util_unistr.c

util/str: helper to check for utf-8 validity

2023-09-26 23:45:36 +00:00

weird.c

lib: Simplify "weird" charset code

2021-01-12 00:10:30 +00:00

wscript_build

lib: Fix 'charset' dependencies

2021-01-12 01:19:26 +00:00

wscript_configure

charset: add support for Unicode normalisation with libicu

2019-08-07 06:07:28 +00:00