Re: [Gluster-devel] Cannot run VMware Virtual Machines on GlusterFS

[Fernando Frediani (Qube)]

Hi Tomaoaki,
Thanks for investigating it.
I believe that behaviour you see on your environment is exactly the same here.

I thought originally it could be something that way ESXi mounts the NFS and 
also changed a few options on the volume GlusterFS(NFS) but didn't work.
Just out of curiosity and I don't think it would be related to this problem, 
but previously I've tried using striped+replicated+distributed and I couldn't 
even browse the Datastore or deploy a machine. With Distributed+Replicated I 
can store data there, it can see the files, so the issue is only when trying to 
power it on.

Regards,

Fernando

-----Original Message-----
From: Tomoaki Sato [mailto:address@hidden 
Sent: 20 June 2012 02:09
To: Fernando Frediani (Qube)
Cc: 'Rajesh Amaravathi'; 'address@hidden'
Subject: Re: [Gluster-devel] Cannot run VMware Virtual Machines on GlusterFS

Fernando

I've tried 'getcwd' on the ESXi host with both the Linux kernel NFS server and 
the GlusterFS(NFS) as I saw following message in the vmware.log.

  vmx| FILE: File_Cwd: getcwd() failed: No such file or directory
  vmx| Unable to determine absolute path for '.'.
  vmx| Msg_Post: Error
  vmx| [msg.filePosix.getcwd] Unable to retrieve the current working directory: 
No such file or directory. Check if the directory has been deleted or unmounted.
  vmx| [msg.monitorLoop.createVMFailed] Failed to power on 
VM----------------------------------------

The Linux kernel NFS server serves an Ext3 on a local disk.
The VMkernel does not fail at getcwd with the Linux kernel NFS server and does 
fail at getcwd with the GlusterFS(NFS) in my environment.

Tomo

(2012/06/19 17:45), Fernando Frediani (Qube) wrote:
> Hi Rajesh,
>
>
> Yes, they definitely exist. The simple test I've done is deploy a new machine 
> and try to power it On right after.
>
> Browsing the Datastore it shows all the files there, it's just a power On 
> that doesn't work.
>
> So, Tomaso, I believe that on the test you did when you mentioned the Linux 
> kernel NFS server that is directly on the brick folder not on a GlusterFS 
> mounted volume ? I guess it's not possible to export it using the kernel NFS 
> server.
>
> What would take to get it working with the Gluster export ?
>
> Regards,
>
> Fernando
>
> *From:*Rajesh Amaravathi [mailto:address@hidden
> *Sent:* 19 June 2012 07:30
> *To:* Fernando Frediani (Qube)
> *Cc:* address@hidden
> *Subject:* Re: [Gluster-devel] Cannot run VMware Virtual Machines on 
> GlusterFS
>
> Hi Fernando,
>
> I see some gfid 00000000000000000000000 on lookup of some files (~12). can 
> you confirm if those files actually exist in the backend (bricks)?
>
> Regards,
> Rajesh Amaravathi,
> Software Engineer, GlusterFS
> RedHat Inc.
>
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> --------
 --
>
> *From: *"Fernando Frediani (Qube)" <address@hidden 
> <mailto:address@hidden>>
> *To: *"address@hidden <mailto:address@hidden>" 
> <address@hidden <mailto:address@hidden>>
> *Sent: *Monday, June 18, 2012 5:43:23 PM
> *Subject: *[Gluster-devel] Cannot run VMware Virtual Machines on 
> GlusterFS
>
>
> Hi,
>
> I have been trying to run VMware ESXi VMs on Gluster and was never able to, 
> either with Gluster 3.2 or 3.3. It mounts the NFS, deploy the VM but can't 
> power it on. I suspect it would be something to do with the way Gluster 
> exports NFS.
>
> I have been people reporting that they used it with KVM VMs and normal Linux 
> NFS, but I never saw anyone saying they have used it with VMware.
>
> I have enabled TRACE logging and grabber the logs from the host I mounted the 
> Datastore while trying to power on the VM.
>
> Would someone care to look and confirm if it's a NFS export problem or if the 
> problem is somewhere else ?
>
> Thanks
>
> Regards,
>
> *Fernando Frediani*
>
>
> _______________________________________________
> Gluster-devel mailing list
> address@hidden <mailto:address@hidden> 
> https://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> address@hidden
> https://lists.nongnu.org/mailman/listinfo/gluster-devel