Re: [Gluster-devel] copy glitch, latest TLA

[Anand Babu Periasamy]

You are correct, Brent's strace confirms it. ls gets the file listing
from name space, but stat on it is performed on actual file. It looks
like only name space entries are made, but files were not copied. We are
looking into it.

--
Anand Babu
GPG Key ID: 0x62E15A31
Blog [http://ab.freeshell.org]
The GNU Operating System [http://www.gnu.org]
Z RESEARCH Inc [http://www.zresearch.com]



Harris Landgarten wrote:
> I can verify that something is wrong.
>
> cp -av /usr/share/zoneinfo /mnt/glusterfs/test/
>
> completed without error.
>
> Then:
>
> ls -lh /mnt/glusterfs/test/zoneinfo/
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or 
> directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or 
> directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or 
> directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or directory
> ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file or 
> directory
> total 228K
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Africa
> drwxr-xr-x  6 root root 4.0K Jun  8 17:04 America
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Antarctica
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Arctic
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Asia
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Atlantic
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Australia
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Brazil
> -rw-r--r--  1 root root 2.1K Jun  8 17:04 CET
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 CST6CDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Canada
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Chile
> -rw-r--r--  2 root root 2.4K Jun  8 17:04 Cuba
> -rw-r--r--  1 root root 1.9K Jun  8 17:04 EET
> -rw-r--r--  1 root root  118 Jun  8 17:04 EST
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 EST5EDT
> -?????????  ? ?    ?       ?            ? Egypt
> -?????????  ? ?    ?       ?            ? Eire
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Etc
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Europe
> -rw-r--r--  2 root root  255 Jun  8 17:04 Factory
> -rw-r--r--  7 root root 3.6K Jun  8 17:04 GB
> -rw-r--r--  7 root root 3.6K Jun  8 17:04 GB-Eire
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT+0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT-0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 Greenwich
> -rw-r--r--  1 root root  119 Jun  8 17:04 HST
> -?????????  ? ?    ?       ?            ? Hongkong
> -rw-r--r--  2 root root 1.2K Jun  8 17:04 Iceland
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Indian
> -?????????  ? ?    ?       ?            ? Iran
> -?????????  ? ?    ?       ?            ? Israel
> -rw-r--r--  2 root root  481 Jun  8 17:04 Jamaica
> -?????????  ? ?    ?       ?            ? Japan
> -rw-r--r--  2 root root  211 Jun  8 17:04 Kwajalein
> -rw-r--r--  2 root root  599 Jun  8 17:04 Libya
> -rw-r--r--  1 root root 2.1K Jun  8 17:04 MET
> -rw-r--r--  1 root root  118 Jun  8 17:04 MST
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 MST7MDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mexico
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mideast
> -rw-r--r--  2 root root 2.4K Jun  8 17:04 NZ
> -?????????  ? ?    ?       ?            ? NZ-CHAT
> -?????????  ? ?    ?       ?            ? Navajo
> -?????????  ? ?    ?       ?            ? PRC
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 PST8PDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Pacific
> -rw-r--r--  2 root root 2.7K Jun  8 17:04 Poland
> -?????????  ? ?    ?       ?            ? Portugal
> -?????????  ? ?    ?       ?            ? ROC
> -?????????  ? ?    ?       ?            ? ROK
> -rw-r--r--  2 root root  402 Jun  8 17:04 Singapore
> -?????????  ? ?    ?       ?            ? Turkey
> -rw-r--r--  2 root root  118 Jun  8 17:04 UCT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 US
> -rw-r--r--  6 root root  118 Jun  8 17:04 UTC
> -rw-r--r--  6 root root  118 Jun  8 17:04 Universal
> -?????????  ? ?    ?       ?            ? W-SU
> -rw-r--r--  1 root root 1.9K Jun  8 17:04 WET
> -rw-r--r--  6 root root  118 Jun  8 17:04 Zulu
> -rw-r--r--  1 root root 4.0K Jun  8 17:04 iso3166.tab
> -rw-r--r--  2 root root  255 Jun  8 17:04 localtime
> drwxr-xr-x 19 root root 4.0K Sep  6  2006 posix
> -?????????  ? ?    ?       ?            ? posixrules
> drwxr-xr-x 19 root root 4.0K Sep  6  2006 right
> -rw-r--r--  1 root root  19K Jun  8 17:04 zone.tab
>
>
> After restarting the client:
>
> ls -lh /mnt/glusterfs/test/zoneinfo/
> total 296K
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Africa
> drwxr-xr-x  6 root root 4.0K Jun  8 17:04 America
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Antarctica
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Arctic
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Asia
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Atlantic
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Australia
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Brazil
> -rw-r--r--  1 root root 2.1K Jun  8 17:04 CET
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 CST6CDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Canada
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Chile
> -rw-r--r--  2 root root 2.4K Jun  8 17:04 Cuba
> -rw-r--r--  1 root root 1.9K Jun  8 17:04 EET
> -rw-r--r--  1 root root  118 Jun  8 17:04 EST
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 EST5EDT
> -rw-r--r--  2 root root 9.1K Jun  8 17:04 Egypt
> -rw-r--r--  2 root root 3.5K Jun  8 17:04 Eire
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Etc
> drwxr-xr-x  2 root root 4.0K Jun  8 17:04 Europe
> -rw-r--r--  2 root root  255 Jun  8 17:04 Factory
> -rw-r--r--  7 root root 3.6K Jun  8 17:04 GB
> -rw-r--r--  7 root root 3.6K Jun  8 17:04 GB-Eire
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT+0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT-0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 GMT0
> -rw-r--r-- 10 root root  118 Jun  8 17:04 Greenwich
> -rw-r--r--  1 root root  119 Jun  8 17:04 HST
> -rw-r--r--  2 root root 1.2K Jun  8 17:04 Hongkong
> -rw-r--r--  2 root root 1.2K Jun  8 17:04 Iceland
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Indian
> -rw-r--r--  2 root root  791 Jun  8 17:04 Iran
> -rw-r--r--  3 root root 2.2K Jun  8 17:04 Israel
> -rw-r--r--  2 root root  481 Jun  8 17:04 Jamaica
> -rw-r--r--  2 root root  331 Jun  8 17:04 Japan
> -rw-r--r--  2 root root  211 Jun  8 17:04 Kwajalein
> -rw-r--r--  2 root root  599 Jun  8 17:04 Libya
> -rw-r--r--  1 root root 2.1K Jun  8 17:04 MET
> -rw-r--r--  1 root root  118 Jun  8 17:04 MST
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 MST7MDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mexico
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Mideast
> -rw-r--r--  2 root root 2.4K Jun  8 17:04 NZ
> -rw-r--r--  2 root root 2.0K Jun  8 17:04 NZ-CHAT
> -rw-r--r--  3 root root 2.4K Jun  8 17:04 Navajo
> -rw-r--r--  2 root root  405 Jun  8 17:04 PRC
> -rw-r--r--  1 root root 2.3K Jun  8 17:04 PST8PDT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 Pacific
> -rw-r--r--  2 root root 2.7K Jun  8 17:04 Poland
> -rw-r--r--  2 root root 3.4K Jun  8 17:04 Portugal
> -rw-r--r--  2 root root  724 Jun  8 17:04 ROC
> -rw-r--r--  2 root root  380 Jun  8 17:04 ROK
> -rw-r--r--  2 root root  402 Jun  8 17:04 Singapore
> -rw-r--r--  3 root root 2.7K Jun  8 17:04 Turkey
> -rw-r--r--  2 root root  118 Jun  8 17:04 UCT
> drwxr-xr-x  2 root root 4.0K Sep  6  2006 US
> -rw-r--r--  6 root root  118 Jun  8 17:04 UTC
> -rw-r--r--  6 root root  118 Jun  8 17:04 Universal
> -rw-r--r--  2 root root 2.2K Jun  8 17:04 W-SU
> -rw-r--r--  1 root root 1.9K Jun  8 17:04 WET
> -rw-r--r--  6 root root  118 Jun  8 17:04 Zulu
> -rw-r--r--  1 root root 4.0K Jun  8 17:04 iso3166.tab
> -rw-r--r--  2 root root  255 Jun  8 17:04 localtime
> drwxr-xr-x 19 root root 4.0K Sep  6  2006 posix
> -rw-r--r--  2 root root 3.5K Jun  8 17:04 posixrules
> drwxr-xr-x 19 root root 4.0K Sep  6  2006 right
> -rw-r--r--  1 root root  19K Jun  8 17:04 zone.tab
>
> Best,
>
> Harris
>
> ----- Original Message -----
> From: "Brent A Nelson" <address@hidden>
> To: "Anand Avati" <address@hidden>
> Cc: address@hidden
> Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York
> Subject: Re: [Gluster-devel] copy glitch, latest TLA
>
> Strace attached.
>
> Thanks,
>
> Brent
>
> On Fri, 27 Jul 2007, Anand Avati wrote:
>
> > Brent, August,
> > I just committed some fixes related to hardlinks into patch-371. Is it
> > possible to get an strace of the ls -l, so that I can confirm if patch-371
> > will fix your issue?
> >
> > thanks,
> > avati
> >
> > 2007/7/26, August R. Wohlt <address@hidden>:
> > > I noticed something very similar this morning with a similar setup. For me
> > > it only shows up on hard-linked files that I do not have permissions to
> > > view:
> > >
> > > address@hidden ls -ail /backups/20070726/root/ | head -10
> > > total 0
> > > ??---------  ? ? ? ?           ? .
> > > ??---------  ? ? ? ?           ? ..
> > > ??---------  ? ? ? ?           ? anaconda-ks.cfg
> > > ??---------  ? ? ? ?           ? .bash_history
> > > ??---------  ? ? ? ?           ? .bash_logout
> > > ??---------  ? ? ? ?           ? .bash_profile
> > > ??---------  ? ? ? ?           ? .bashrc
> > > ??---------  ? ? ? ?           ? .config
> > > address@hidden sudo ls -ail /backups/20070726/root/ | head -10
> > > total 404
> > > 4213728 drwxr-xr--  18 root  root   4096 Jul 20 09:44 .
> > > 4210689 drwxr-xr-x  18 root  root   4096 Jul 26 07:20 ..
> > > 4213743 -rw-r--r--   1 root  root   1294 Mar 23  2006 anaconda-ks.cfg
> > > 4213731 -rw-------   1 root  root   2054 Jul 17 20:57 .bash_history
> > > 4213732 -rw-r--r--   1 root  root     24 Sep 22  2004 .bash_logout
> > > 4213733 -rw-r--r--   1 root  root    191 Sep 22  2004 .bash_profile
> > > 4213734 -rw-r--r--   1 root  root    176 Sep 22  2004 .bashrc
> > > 7375158 drwxr-xr-x   3 root  root   4096 Mar 23  2006 .config
> > >
> > > :goose
> > >
> > > On 7/26/07, Brent A Nelson <address@hidden> wrote:
> > > > In copying (cp -a) a local /usr to a GlusterFS (unify, protocol/client,
> > > > protocol/server, features/posix-locks, storage/posix), I notice this
> > > > glitch:
> > > >
> > > > ls -lai /beast/usr/share/zoneinfo/posix/America/
> > > > total 484
> > > > 115452 drwxr-xr-x  6 root root    0 2007-06-18 13:33 .
> > > > 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 ..
> > > > 115443 -rw-r--r--  3 root root  858 2007-04-23 06:07 Adak
> > > > 115435 -rw-r--r--  3 root root  861 2007-04-23 06:07 Anchorage
> > > > 115528 -rw-r--r--  1 root root   73 2007-04-23 06:07 Anguilla
> > > > 115454 -rw-r--r--  1 root root   90 2007-04-23 06:07 Antigua
> > > > 115477 -rw-r--r--  1 root root  326 2007-04-23 06:07 Araguaina
> > > > 115533 drwxr-xr-x  2 root root 4096 2007-06-18 13:33 Argentina
> > > > 115470 -rw-r--r--  1 root root   90 2007-04-23 06:07 Aruba
> > > > 115517 -rw-r--r--  1 root root  729 2007-04-23 06:07 Asuncion
> > > > 115472 -rw-r--r--  2 root root  134 2007-04-23 06:07 Atikokan
> > > > 115443 -rw-r--r--  3 root root  858 2007-04-23 06:07 Atka
> > > > 115465 -rw-r--r--  1 root root  376 2007-04-23 06:07 Bahia
> > > > 115526 -rw-r--r--  1 root root  142 2007-04-23 06:07 Barbados
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Edmonton
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Halifax
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Regina
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Rosario
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Santiago
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/St_Johns
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Toronto
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Vancouver
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Whitehorse
> > > >       ? ?---------  ? ?    ?       ?                ?
> > > > /beast/usr/share/zoneinfo/posix/America/Winnipeg
> > > > 115482 -rw-r--r--  1 root root  226 2007-04-23 06:07 Belem
> > > > 115521 -rw-r--r--  1 root root  368 2007-04-23 06:07 Belize
> > > > ... (everything normal after that).
> > > >
> > > > Plenty of other areas in zoneinfo were also affected.  Is this a glitch
> > > in
> > > > hardlinks?
> > > >
> > > > Thanks,
> > > >
> > > > Brent
> > > >
> > > >
> > > > _______________________________________________
> > > > Gluster-devel mailing list
> > > > address@hidden
> > > > http://lists.nongnu.org/mailman/listinfo/gluster-devel
> > > _______________________________________________
> > > Gluster-devel mailing list
> > > address@hidden
> > > http://lists.nongnu.org/mailman/listinfo/gluster-devel
> >
> >
> > --
> > Anand V. Avati
>
>
> _______________________________________________
> Gluster-devel mailing list
> address@hidden
> http://lists.nongnu.org/mailman/listinfo/gluster-devel