[Gluster-devel] 2 "NFS" mounts not working

[Hans Einar Gautun]

Hi,

I have to export 2 standalen directories as "NFS".

A strange problem with mainline 2.5:

When exporting only one diretcory at a time it works nice. Server
staring and mounting is ok

When exporting both at the same time the server starts, but the mount
doesn't work. 

>From the client log:

 2007-07-06 11:02:54 E [tcp-client.c:171:tcp_connect] client:
non-blocking connect() returned: 111 (Connection refused)
2007-07-06 11:02:55 E [tcp-client.c:171:tcp_connect] client:
non-blocking connect() returned: 111 (Connection refused)
2007-07-06 11:02:57 E [tcp-client.c:171:tcp_connect] client:
non-blocking connect() returned: 111 (Connection refused)
2007-07-06 11:03:00 E [tcp-client.c:171:tcp_connect] client:
non-blocking connect() returned: 111 (Connection refused)
2007-07-06 11:03:05 E [tcp-client.c:171:tcp_connect] client:
non-blocking connect() returned: 111 (Connection refused)
2007-07-06 11:03:06 E [fuse-bridge.c:1901:fuse_transport_notify]
glusterfs-fuse: got GF_EVENT_POLLERR

Last line is when umounting the directory. 
_________________________________________________________

>From server log when starting in DEBUG mode:

2007-07-06 10:59:51 D [spec.y:116:new_section] libglusterfs/parser: New
node for 'home'
2007-07-06 10:59:51 D [spec.y:132:section_type] libglusterfs/parser:
Type:home:storage/posix
2007-07-06 10:59:51 D [xlator.c:100:xlator_set_type]
libglusterfs/xlator: attempt to load type storage/posix
2007-07-06 10:59:51 D [xlator.c:107:xlator_set_type]
libglusterfs/xlator: attempt to load
file /usr/local/lib/glusterfs/1.3.0-pre5.2/xlator/storage/posix.so
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:home:directory:/tellus/home
2007-07-06 10:59:51 D [spec.y:209:section_end] libglusterfs/parser:
end:home
2007-07-06 10:59:51 D [spec.y:116:new_section] libglusterfs/parser: New
node for 'server'
2007-07-06 10:59:51 D [spec.y:132:section_type] libglusterfs/parser:
Type:server:protocol/server
2007-07-06 10:59:51 D [xlator.c:100:xlator_set_type]
libglusterfs/xlator: attempt to load type protocol/server
2007-07-06 10:59:51 D [xlator.c:107:xlator_set_type]
libglusterfs/xlator: attempt to load
file /usr/local/lib/glusterfs/1.3.0-pre5.2/xlator/protocol/server.so
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:transport-type:tcp/server
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:bind-address:159.162.84.85
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:listen-port:6996
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:client-volume-filename:/etc/glusterfs/glusterfs-client1.vol
2007-07-06 10:59:51 D [spec.y:194:section_sub] liglusterfs/parser:
child:server->home
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:auth.ip.home.allow:159.162.84.*:127.0.0.1
2007-07-06 10:59:51 D [spec.y:209:section_end] libglusterfs/parser:
end:server
2007-07-06 10:59:51 D [spec.y:116:new_section] libglusterfs/parser: New
node for 'local'
2007-07-06 10:59:51 D [spec.y:132:section_type] libglusterfs/parser:
Type:local:storage/posix
2007-07-06 10:59:51 D [xlator.c:100:xlator_set_type]
libglusterfs/xlator: attempt to load type storage/posix
2007-07-06 10:59:51 D [xlator.c:107:xlator_set_type]
libglusterfs/xlator: attempt to load
file /usr/local/lib/glusterfs/1.3.0-pre5.2/xlator/storage/posix.so
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:local:directory:/tellus/local
2007-07-06 10:59:51 D [spec.y:209:section_end] libglusterfs/parser:
end:local
2007-07-06 10:59:51 D [spec.y:116:new_section] libglusterfs/parser: New
node for 'server'
2007-07-06 10:59:51 D [spec.y:132:section_type] libglusterfs/parser:
Type:server:protocol/server
2007-07-06 10:59:51 D [xlator.c:100:xlator_set_type]
libglusterfs/xlator: attempt to load type protocol/server
2007-07-06 10:59:51 D [xlator.c:107:xlator_set_type]
libglusterfs/xlator: attempt to load
file /usr/local/lib/glusterfs/1.3.0-pre5.2/xlator/protocol/server.so
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:transport-type:tcp/server
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:bind-address:159.162.84.85
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:listen-port:6997
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:client-volume-filename:/etc/glusterfs/glusterfs-client2.vol
2007-07-06 10:59:51 D [spec.y:194:section_sub] liglusterfs/parser:
child:server->local
2007-07-06 10:59:51 D [spec.y:152:section_option] libglusterfs/parser:
Option:server:auth.ip.local.allow:159.162.84.*:127.0.0.1
2007-07-06 10:59:51 D [spec.y:209:section_end] libglusterfs/parser:
end:server
2007-07-06 10:59:51 D [posix.c:1770:init] local: missing
'inode-lru-limit'. defaulting to 1000
2007-07-06 10:59:51 D [inode.c:481:__create_inode] local/inode: create
inode(1)
2007-07-06 10:59:51 D [inode.c:279:__active_inode] local/inode:
activating inode(1), lru=0/1000
2007-07-06 10:59:51 D [server-protocol.c:5670:init] protocol/server:
protocol/server xlator loaded
2007-07-06 10:59:51 D [transport.c:81:transport_load]
libglusterfs/transport: attempt to load type tcp/server
2007-07-06 10:59:51 D [transport.c:86:transport_load]
libglusterfs/transport: attempt to load
file /usr/local/lib/glusterfs/1.3.0-pre5.2/transport/tcp/server.so
________________________________________________

This is the server config:

volume home
  type storage/posix                   # POSIX FS translator
  option directory /tellus/home         # Export this directory
end-volume

volume server
  type protocol/server
  option transport-type tcp/server     # For TCP/IP transport
 option bind-address 159.162.84.85     # Default is to listen on all
interfaces
 option listen-port 6996              # Default is 6996
 option client-volume-filename /etc/glusterfs/glusterfs-client1.vol
  subvolumes home
  option auth.ip.home.allow 159.162.84.*:127.0.0.1 # Allow access to
"brick" volume
end-volume

volume local
  type storage/posix                   # POSIX FS translator
  option directory /tellus/local        # Export this directory
end-volume

volume server
  type protocol/server
  option transport-type tcp/server     # For TCP/IP transport
 option bind-address 159.162.84.85     # Default is to listen on all
interfaces
 option listen-port 6997              # Default is 6996
 option client-volume-filename /etc/glusterfs/glusterfs-client2.vol
  subvolumes local
  option auth.ip.local.allow 159.162.84.*:127.0.0.1 # Allow access to
"brick" volume
end-volume

I can't spot any problem - can anyone else?

BTW: I'm using this conf in V.1.2.3 today in production

Thanks,
Einar