r2159: converted samba4 over to UTF-16.
authorAndrew Tridgell <tridge@samba.org>
Wed, 1 Sep 2004 04:39:06 +0000 (04:39 +0000)
committerGerald (Jerry) Carter <jerry@samba.org>
Wed, 10 Oct 2007 17:58:27 +0000 (12:58 -0500)
commit31c1c7846f6b6e5848bc39a28a65118bfa98e35d
tree7387bbf9234320ca2c60011b34c76c08e2b274b0
parent48f3df41bb4c854b1049591e1c315c4c3b980984
r2159: converted samba4 over to UTF-16.

I had previously thought this was unnecessary, as windows doesn't use
standards compliant UTF-16, and for filesystem operations treats bytes
as UCS-2, but Bjoern Jacke has pointed out to me that this means we
don't correctly store extended UTF-16 characters as UTF-8 on
disk. This can be seen with (for example) the gothic characters with
codepoints above 64k.

This commit also adds a LOCAL-ICONV torture test that tests the first
1 million codepoints against the system iconv library, and tests 5
million random UTF-16LE buffers for identical error handling to the
system iconv library.

the lib/iconv.c changes need backporting to samba3
(This used to be commit 756f28ac95feaa84b42402723d5f7286865c78db)
13 files changed:
source4/include/charset.h
source4/lib/charcnv.c
source4/lib/iconv.c
source4/lib/util_unistr.c
source4/libcli/raw/rawrequest.c
source4/librpc/ndr/ndr_basic.c
source4/smb_server/request.c
source4/torture/basic/charset.c
source4/torture/basic/utable.c
source4/torture/config.m4
source4/torture/config.mk
source4/torture/local/iconv.c [new file with mode: 0644]
source4/torture/torture.c