gluster-devel
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Gluster-devel] copy glitch, latest TLA

From: Harris Landgarten
Subject: Re: [Gluster-devel] copy glitch, latest TLA
Date: Fri, 27 Jul 2007 17:57:10 -0400 (EDT) 
No. Just writeback and io-threads

Harris

----- Original Message -----
From: "Anand Avati" <address@hidden>
To: "Harris Landgarten" <address@hidden>
Cc: "Anand Babu Periasamy" <address@hidden>, address@hidden
Sent: Friday, July 27, 2007 5:34:10 PM (GMT-0500) America/New_York
Subject: Re: [Gluster-devel] copy glitch, latest TLA

Harris, 
do you have io-cache in your setup? 

avati 


2007/7/27 , Harris Landgarten < address@hidden >: 

The cp -av behavior I am seeing worked in patch-368. I am also seeing some 
other issues. 

1. my tar test slowed down after 368. 366 is still fast. 
2. running tar -cf immediately after restarting the client results is a 
failure: bad descriptor. tar -cvf runs. rerunning tar -cf runs as well. It is 
difficult to test this further because slowing it down makes the error go away. 
It also does not happen every time. 

Harris 

----- Original Message ----- 
From: "Anand Babu Periasamy" < address@hidden > 
To: "Harris Landgarten" < address@hidden > 
Cc: "Brent A Nelson" < address@hidden >, address@hidden 
Sent: Thursday, July 26, 2007 7:48:12 PM (GMT-0500) America/New_York 
Subject: Re: [Gluster-devel] copy glitch, latest TLA 

You are correct, Brent's strace confirms it. ls gets the file listing 
from name space, but stat on it is performed on actual file. It looks 
like only name space entries are made, but files were not copied. We are 
looking into it. 

-- 
Anand Babu 
GPG Key ID: 0x62E15A31 
Blog [ http://ab.freeshell.org ] 
The GNU Operating System [ http://www.gnu.org ] 
Z RESEARCH Inc [ http://www.zresearch.com ] 



Harris Landgarten wrote: 
> I can verify that something is wrong. 
> 
> cp -av /usr/share/zoneinfo /mnt/glusterfs/test/ 
> 
> completed without error. 
> 
> Then: 
> 
> ls -lh /mnt/glusterfs/test/zoneinfo/ 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or 
> directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file or 
> directory 
> total 228K 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa 
> drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 EST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT 
> -????????? ? ? ? ? ? Egypt 
> -????????? ? ? ? ? ? Eire 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich 
> -rw-r--r-- 1 root root 119 Jun 8 17:04 HST 
> -????????? ? ? ? ? ? Hongkong 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian 
> -????????? ? ? ? ? ? Iran 
> -????????? ? ? ? ? ? Israel 
> -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica 
> -????????? ? ? ? ? ? Japan 
> -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein 
> -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 MST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ 
> -????????? ? ? ? ? ? NZ-CHAT 
> -????????? ? ? ? ? ? Navajo 
> -????????? ? ? ? ? ? PRC 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific 
> -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland 
> -????????? ? ? ? ? ? Portugal 
> -????????? ? ? ? ? ? ROC 
> -????????? ? ? ? ? ? ROK 
> -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore 
> -????????? ? ? ? ? ? Turkey 
> -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 US 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal 
> -????????? ? ? ? ? ? W-SU 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu 
> -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix 
> -????????? ? ? ? ? ? posixrules 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 right 
> -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab 
> 
> 
> After restarting the client: 
> 
> ls -lh /mnt/glusterfs/test/zoneinfo/ 
> total 296K 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa 
> drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 EST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT 
> -rw-r--r-- 2 root root 9.1K Jun 8 17:04 Egypt 
> -rw-r--r-- 2 root root 3.5K Jun 8 17:04 Eire 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich 
> -rw-r--r-- 1 root root 119 Jun 8 17:04 HST 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Hongkong 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian 
> -rw-r--r-- 2 root root 791 Jun 8 17:04 Iran 
> -rw-r--r-- 3 root root 2.2K Jun 8 17:04 Israel 
> -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica 
> -rw-r--r-- 2 root root 331 Jun 8 17:04 Japan 
> -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein 
> -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 MST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ 
> -rw-r--r-- 2 root root 2.0K Jun 8 17:04 NZ-CHAT 
> -rw-r--r-- 3 root root 2.4K Jun 8 17:04 Navajo 
> -rw-r--r-- 2 root root 405 Jun 8 17:04 PRC 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific 
> -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland 
> -rw-r--r-- 2 root root 3.4K Jun 8 17:04 Portugal 
> -rw-r--r-- 2 root root 724 Jun 8 17:04 ROC 
> -rw-r--r-- 2 root root 380 Jun 8 17:04 ROK 
> -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore 
> -rw-r--r-- 3 root root 2.7K Jun 8 17:04 Turkey 
> -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 US 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal 
> -rw-r--r-- 2 root root 2.2K Jun 8 17:04 W-SU 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu 
> -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix 
> -rw-r--r-- 2 root root 3.5K Jun 8 17:04 posixrules 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 right 
> -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab 
> 
> Best, 
> 
> Harris 
> 
> ----- Original Message ----- 
> From: "Brent A Nelson" < address@hidden > 
> To: "Anand Avati" < address@hidden > 
> Cc: address@hidden 
> Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York 
> Subject: Re: [Gluster-devel] copy glitch, latest TLA 
> 
> Strace attached. 
> 
> Thanks, 
> 
> Brent 
> 
> On Fri, 27 Jul 2007 , Anand Avati wrote: 
> 
>> Brent, August, 
>> I just committed some fixes related to hardlinks into patch-371. Is it 
>> possible to get an strace of the ls -l, so that I can confirm if patch-371 
>> will fix your issue? 
>> 
>> thanks, 
>> avati 
>> 
>> 2007/7/26 , August R. Wohlt < address@hidden >: 
>>> I noticed something very similar this morning with a similar setup. For me 
>>> it only shows up on hard-linked files that I do not have permissions to 
>>> view: 
>>> 
>>> address@hidden ls -ail /backups/ 20070726 /root/ | head -10 
>>> total 0 
>>> ??--------- ? ? ? ? ? . 
>>> ??--------- ? ? ? ? ? .. 
>>> ??--------- ? ? ? ? ? anaconda-ks.cfg 
>>> ??--------- ? ? ? ? ? .bash_history 
>>> ??--------- ? ? ? ? ? .bash_logout 
>>> ??--------- ? ? ? ? ? .bash_profile 
>>> ??--------- ? ? ? ? ? .bashrc 
>>> ??--------- ? ? ? ? ? .config 
>>> address@hidden sudo ls -ail /backups/ 20070726 /root/ | head -10 
>>> total 404 
>>> 4213728 drwxr-xr-- 18 root root 4096 Jul 20 09:44 . 
>>> 4210689 drwxr-xr-x 18 root root 4096 Jul 26 07:20 .. 
>>> 4213743 -rw-r--r-- 1 root root 1294 Mar 23 2006 anaconda-ks.cfg 
>>> 4213731 -rw------- 1 root root 2054 Jul 17 20:57 .bash_history 
>>> 4213732 -rw-r--r-- 1 root root 24 Sep 22 2004 .bash_logout 
>>> 4213733 -rw-r--r-- 1 root root 191 Sep 22 2004 .bash_profile 
>>> 4213734 -rw-r--r-- 1 root root 176 Sep 22 2004 .bashrc 
>>> 7375158 drwxr-xr-x 3 root root 4096 Mar 23 2006 .config 
>>> 
>>> :goose 
>>> 
>>> On 7/26/07 , Brent A Nelson < address@hidden > wrote: 
>>>> In copying (cp -a) a local /usr to a GlusterFS (unify, protocol/client, 
>>>> protocol/server, features/posix-locks, storage/posix), I notice this 
>>>> glitch: 
>>>> 
>>>> ls -lai /beast/usr/share/zoneinfo/posix/America/ 
>>>> total 484 
>>>> 115452 drwxr-xr-x 6 root root 0 2007-06-18 13:33 . 
>>>> 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 .. 
>>>> 115443 -rw-r--r-- 3 root root 858 2007 -04-23 06:07 Adak 
>>>> 115435 -rw-r--r-- 3 root root 861 2007 -04-23 06:07 Anchorage 
>>>> 115528 -rw-r--r-- 1 root root 73 2007-04-23 06:07 Anguilla 
>>>> 115454 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Antigua 
>>>> 115477 -rw-r--r-- 1 root root 326 2007 -04-23 06:07 Araguaina 
>>>> 115533 drwxr-xr-x 2 root root 4096 2007-06-18 13:33 Argentina 
>>>> 115470 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Aruba 
>>>> 115517 -rw-r--r-- 1 root root 729 2007 -04-23 06:07 Asuncion 
>>>> 115472 -rw-r--r-- 2 root root 134 2007 -04-23 06:07 Atikokan 
>>>> 115443 -rw-r--r-- 3 root root 858 2007 -04-23 06:07 Atka 
>>>> 115465 -rw-r--r-- 1 root root 376 2007 -04-23 06:07 Bahia 
>>>> 115526 -rw-r--r-- 1 root root 142 2007 -04-23 06:07 Barbados 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Edmonton 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Halifax 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Regina 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Rosario 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Santiago 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/St_Johns 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Toronto 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Vancouver 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Whitehorse 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Winnipeg 
>>>> 115482 -rw-r--r-- 1 root root 226 2007 -04-23 06:07 Belem 
>>>> 115521 -rw-r--r-- 1 root root 368 2007 -04-23 06:07 Belize 
>>>> ... (everything normal after that). 
>>>> 
>>>> Plenty of other areas in zoneinfo were also affected. Is this a glitch 
>>> in 
>>>> hardlinks? 
>>>> 
>>>> Thanks, 
>>>> 
>>>> Brent 
>>>> 
>>>> 
>>>> _______________________________________________ 
>>>> Gluster-devel mailing list 
>>>> address@hidden 
>>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel 
>>>> 
>>> _______________________________________________ 
>>> Gluster-devel mailing list 
>>> address@hidden 
>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel 
>>> 
>> 
>> 
>> -- 
>> Anand V. Avati 
>> 
> 
> 
> _______________________________________________ 
> Gluster-devel mailing list 
> address@hidden 
> http://lists.nongnu.org/mailman/listinfo/gluster-devel 



_______________________________________________ 
Gluster-devel mailing list 
address@hidden 
http://lists.nongnu.org/mailman/listinfo/gluster-devel 



-- 
Anand V. Avati
reply via email to
[Prev in Thread] Current Thread [Next in Thread]