Re: [Gluster-devel] copy glitch, latest TLA

[Harris Landgarten]

I can verify that something is wrong.

cp -av /usr/share/zoneinfo /mnt/glusterfs/test/

completed without error.

Then:

ls -lh /mnt/glusterfs/test/zoneinfo/
ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or 
directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or 
directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or 
directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or directory
ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file or 
directory
total 228K
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Africa
drwxr-xr-x  6 root root 4.0K Jun  8 17:04 America
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Antarctica
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Arctic
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Asia
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Atlantic
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Australia
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Brazil
-rw-r--r--  1 root root 2.1K Jun  8 17:04 CET
-rw-r--r--  1 root root 2.3K Jun  8 17:04 CST6CDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Canada
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Chile
-rw-r--r--  2 root root 2.4K Jun  8 17:04 Cuba
-rw-r--r--  1 root root 1.9K Jun  8 17:04 EET
-rw-r--r--  1 root root  118 Jun  8 17:04 EST
-rw-r--r--  1 root root 2.3K Jun  8 17:04 EST5EDT
-?????????  ? ?    ?       ?            ? Egypt
-?????????  ? ?    ?       ?            ? Eire
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Etc
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Europe
-rw-r--r--  2 root root  255 Jun  8 17:04 Factory
-rw-r--r--  7 root root 3.6K Jun  8 17:04 GB
-rw-r--r--  7 root root 3.6K Jun  8 17:04 GB-Eire
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT+0
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT-0
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT0
-rw-r--r-- 10 root root  118 Jun  8 17:04 Greenwich
-rw-r--r--  1 root root  119 Jun  8 17:04 HST
-?????????  ? ?    ?       ?            ? Hongkong
-rw-r--r--  2 root root 1.2K Jun  8 17:04 Iceland
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Indian
-?????????  ? ?    ?       ?            ? Iran
-?????????  ? ?    ?       ?            ? Israel
-rw-r--r--  2 root root  481 Jun  8 17:04 Jamaica
-?????????  ? ?    ?       ?            ? Japan
-rw-r--r--  2 root root  211 Jun  8 17:04 Kwajalein
-rw-r--r--  2 root root  599 Jun  8 17:04 Libya
-rw-r--r--  1 root root 2.1K Jun  8 17:04 MET
-rw-r--r--  1 root root  118 Jun  8 17:04 MST
-rw-r--r--  1 root root 2.3K Jun  8 17:04 MST7MDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mexico
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mideast
-rw-r--r--  2 root root 2.4K Jun  8 17:04 NZ
-?????????  ? ?    ?       ?            ? NZ-CHAT
-?????????  ? ?    ?       ?            ? Navajo
-?????????  ? ?    ?       ?            ? PRC
-rw-r--r--  1 root root 2.3K Jun  8 17:04 PST8PDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Pacific
-rw-r--r--  2 root root 2.7K Jun  8 17:04 Poland
-?????????  ? ?    ?       ?            ? Portugal
-?????????  ? ?    ?       ?            ? ROC
-?????????  ? ?    ?       ?            ? ROK
-rw-r--r--  2 root root  402 Jun  8 17:04 Singapore
-?????????  ? ?    ?       ?            ? Turkey
-rw-r--r--  2 root root  118 Jun  8 17:04 UCT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 US
-rw-r--r--  6 root root  118 Jun  8 17:04 UTC
-rw-r--r--  6 root root  118 Jun  8 17:04 Universal
-?????????  ? ?    ?       ?            ? W-SU
-rw-r--r--  1 root root 1.9K Jun  8 17:04 WET
-rw-r--r--  6 root root  118 Jun  8 17:04 Zulu
-rw-r--r--  1 root root 4.0K Jun  8 17:04 iso3166.tab
-rw-r--r--  2 root root  255 Jun  8 17:04 localtime
drwxr-xr-x 19 root root 4.0K Sep  6  2006 posix
-?????????  ? ?    ?       ?            ? posixrules
drwxr-xr-x 19 root root 4.0K Sep  6  2006 right
-rw-r--r--  1 root root  19K Jun  8 17:04 zone.tab


After restarting the client:

ls -lh /mnt/glusterfs/test/zoneinfo/
total 296K
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Africa
drwxr-xr-x  6 root root 4.0K Jun  8 17:04 America
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Antarctica
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Arctic
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Asia
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Atlantic
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Australia
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Brazil
-rw-r--r--  1 root root 2.1K Jun  8 17:04 CET
-rw-r--r--  1 root root 2.3K Jun  8 17:04 CST6CDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Canada
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Chile
-rw-r--r--  2 root root 2.4K Jun  8 17:04 Cuba
-rw-r--r--  1 root root 1.9K Jun  8 17:04 EET
-rw-r--r--  1 root root  118 Jun  8 17:04 EST
-rw-r--r--  1 root root 2.3K Jun  8 17:04 EST5EDT
-rw-r--r--  2 root root 9.1K Jun  8 17:04 Egypt
-rw-r--r--  2 root root 3.5K Jun  8 17:04 Eire
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Etc
drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Europe
-rw-r--r--  2 root root  255 Jun  8 17:04 Factory
-rw-r--r--  7 root root 3.6K Jun  8 17:04 GB
-rw-r--r--  7 root root 3.6K Jun  8 17:04 GB-Eire
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT+0
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT-0
-rw-r--r-- 10 root root  118 Jun  8 17:04 GMT0
-rw-r--r-- 10 root root  118 Jun  8 17:04 Greenwich
-rw-r--r--  1 root root  119 Jun  8 17:04 HST
-rw-r--r--  2 root root 1.2K Jun  8 17:04 Hongkong
-rw-r--r--  2 root root 1.2K Jun  8 17:04 Iceland
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Indian
-rw-r--r--  2 root root  791 Jun  8 17:04 Iran
-rw-r--r--  3 root root 2.2K Jun  8 17:04 Israel
-rw-r--r--  2 root root  481 Jun  8 17:04 Jamaica
-rw-r--r--  2 root root  331 Jun  8 17:04 Japan
-rw-r--r--  2 root root  211 Jun  8 17:04 Kwajalein
-rw-r--r--  2 root root  599 Jun  8 17:04 Libya
-rw-r--r--  1 root root 2.1K Jun  8 17:04 MET
-rw-r--r--  1 root root  118 Jun  8 17:04 MST
-rw-r--r--  1 root root 2.3K Jun  8 17:04 MST7MDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mexico
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mideast
-rw-r--r--  2 root root 2.4K Jun  8 17:04 NZ
-rw-r--r--  2 root root 2.0K Jun  8 17:04 NZ-CHAT
-rw-r--r--  3 root root 2.4K Jun  8 17:04 Navajo
-rw-r--r--  2 root root  405 Jun  8 17:04 PRC
-rw-r--r--  1 root root 2.3K Jun  8 17:04 PST8PDT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 Pacific
-rw-r--r--  2 root root 2.7K Jun  8 17:04 Poland
-rw-r--r--  2 root root 3.4K Jun  8 17:04 Portugal
-rw-r--r--  2 root root  724 Jun  8 17:04 ROC
-rw-r--r--  2 root root  380 Jun  8 17:04 ROK
-rw-r--r--  2 root root  402 Jun  8 17:04 Singapore
-rw-r--r--  3 root root 2.7K Jun  8 17:04 Turkey
-rw-r--r--  2 root root  118 Jun  8 17:04 UCT
drwxr-xr-x  2 root root 4.0K Sep  6  2006 US
-rw-r--r--  6 root root  118 Jun  8 17:04 UTC
-rw-r--r--  6 root root  118 Jun  8 17:04 Universal
-rw-r--r--  2 root root 2.2K Jun  8 17:04 W-SU
-rw-r--r--  1 root root 1.9K Jun  8 17:04 WET
-rw-r--r--  6 root root  118 Jun  8 17:04 Zulu
-rw-r--r--  1 root root 4.0K Jun  8 17:04 iso3166.tab
-rw-r--r--  2 root root  255 Jun  8 17:04 localtime
drwxr-xr-x 19 root root 4.0K Sep  6  2006 posix
-rw-r--r--  2 root root 3.5K Jun  8 17:04 posixrules
drwxr-xr-x 19 root root 4.0K Sep  6  2006 right
-rw-r--r--  1 root root  19K Jun  8 17:04 zone.tab

Best,

Harris

----- Original Message -----
From: "Brent A Nelson" <address@hidden>
To: "Anand Avati" <address@hidden>
Cc: address@hidden
Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York
Subject: Re: [Gluster-devel] copy glitch, latest TLA

Strace attached.

Thanks,

Brent

On Fri, 27 Jul 2007, Anand Avati wrote:

> Brent, August,
> I just committed some fixes related to hardlinks into patch-371. Is it
> possible to get an strace of the ls -l, so that I can confirm if patch-371
> will fix your issue?
>
> thanks,
> avati
>
> 2007/7/26, August R. Wohlt <address@hidden>:
>> 
>> I noticed something very similar this morning with a similar setup. For me
>> it only shows up on hard-linked files that I do not have permissions to
>> view:
>> 
>> address@hidden ls -ail /backups/20070726/root/ | head -10
>> total 0
>> ??---------  ? ? ? ?           ? .
>> ??---------  ? ? ? ?           ? ..
>> ??---------  ? ? ? ?           ? anaconda-ks.cfg
>> ??---------  ? ? ? ?           ? .bash_history
>> ??---------  ? ? ? ?           ? .bash_logout
>> ??---------  ? ? ? ?           ? .bash_profile
>> ??---------  ? ? ? ?           ? .bashrc
>> ??---------  ? ? ? ?           ? .config
>> address@hidden sudo ls -ail /backups/20070726/root/ | head -10
>> total 404
>> 4213728 drwxr-xr--  18 root  root   4096 Jul 20 09:44 .
>> 4210689 drwxr-xr-x  18 root  root   4096 Jul 26 07:20 ..
>> 4213743 -rw-r--r--   1 root  root   1294 Mar 23  2006 anaconda-ks.cfg
>> 4213731 -rw-------   1 root  root   2054 Jul 17 20:57 .bash_history
>> 4213732 -rw-r--r--   1 root  root     24 Sep 22  2004 .bash_logout
>> 4213733 -rw-r--r--   1 root  root    191 Sep 22  2004 .bash_profile
>> 4213734 -rw-r--r--   1 root  root    176 Sep 22  2004 .bashrc
>> 7375158 drwxr-xr-x   3 root  root   4096 Mar 23  2006 .config
>> 
>> :goose
>> 
>> On 7/26/07, Brent A Nelson <address@hidden> wrote:
>> >
>> > In copying (cp -a) a local /usr to a GlusterFS (unify, protocol/client,
>> > protocol/server, features/posix-locks, storage/posix), I notice this
>> > glitch:
>> >
>> > ls -lai /beast/usr/share/zoneinfo/posix/America/
>> > total 484
>> > 115452 drwxr-xr-x  6 root root    0 2007-06-18 13:33 .
>> > 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 ..
>> > 115443 -rw-r--r--  3 root root  858 2007-04-23 06:07 Adak
>> > 115435 -rw-r--r--  3 root root  861 2007-04-23 06:07 Anchorage
>> > 115528 -rw-r--r--  1 root root   73 2007-04-23 06:07 Anguilla
>> > 115454 -rw-r--r--  1 root root   90 2007-04-23 06:07 Antigua
>> > 115477 -rw-r--r--  1 root root  326 2007-04-23 06:07 Araguaina
>> > 115533 drwxr-xr-x  2 root root 4096 2007-06-18 13:33 Argentina
>> > 115470 -rw-r--r--  1 root root   90 2007-04-23 06:07 Aruba
>> > 115517 -rw-r--r--  1 root root  729 2007-04-23 06:07 Asuncion
>> > 115472 -rw-r--r--  2 root root  134 2007-04-23 06:07 Atikokan
>> > 115443 -rw-r--r--  3 root root  858 2007-04-23 06:07 Atka
>> > 115465 -rw-r--r--  1 root root  376 2007-04-23 06:07 Bahia
>> > 115526 -rw-r--r--  1 root root  142 2007-04-23 06:07 Barbados
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Edmonton
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Halifax
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Regina
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Rosario
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Santiago
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/St_Johns
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Toronto
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Vancouver
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Whitehorse
>> >       ? ?---------  ? ?    ?       ?                ?
>> > /beast/usr/share/zoneinfo/posix/America/Winnipeg
>> > 115482 -rw-r--r--  1 root root  226 2007-04-23 06:07 Belem
>> > 115521 -rw-r--r--  1 root root  368 2007-04-23 06:07 Belize
>> > ... (everything normal after that).
>> >
>> > Plenty of other areas in zoneinfo were also affected.  Is this a glitch
>> in
>> > hardlinks?
>> >
>> > Thanks,
>> >
>> > Brent
>> >
>> >
>> > _______________________________________________
>> > Gluster-devel mailing list
>> > address@hidden
>> > http://lists.nongnu.org/mailman/listinfo/gluster-devel
>> >
>> _______________________________________________
>> Gluster-devel mailing list
>> address@hidden
>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>> 
>
>
>
> -- 
> Anand V. Avati
>