Re: Pattern replacement fails if string contains multibyte characters

[Chet Ramey]

Bernd Eggink wrote:
> This happens on a utf-8 based system (CRUX 2.3), LANG=de_DE.UTF-8:
> 
> t="123abc456äöüABCD"
> echo ${t//[a-c]/}
> # output: 123456öüCD
> # (should be: "123456äöüABCD")
> 
> echo ${t//[!a-c]/}
> # output: abcäAB
> # (should be: "abc")
> 
> bash --version:
> GNU bash, version 3.2.25(1)-release (i686-pc-linux-gnu)
> 
> Without multibyte chars, replacement works as expected. I looks like a
> bug, or am I misssing something?

I get the expected output using Mac OS X or FreeBSD; the same output you
do using FC6.

The difference is in the gnu libc implementation of strcoll(), which bash
uses to compare characters for range matching.  The glibc implementation
ignores the locale; the other systems incorporate the current locale's
collating sequence into their strcoll implementation.

Chet
-- 
``The lyf so short, the craft so long to lerne.'' - Chaucer
                       Live Strong.  No day but today.
Chet Ramey, ITS, CWRU    chet@case.edu    http://cnswww.cns.cwru.edu/~chet/