[Gluster-devel] server crash on pre6

[August R. Wohlt]

Howdy devs -

I have a pre6 server compiled with fuse-2.7.0-glfs2 on CentOS. The server
has posix locks and io-threads on top of ext3. There are two pre6 clients,
they both have write-behind enabled. The server has been crashing for me all
day today with this stack trace. Let me know if you want any other info.

*** glibc detected *** /usr/sbin/glusterfsd: double free or corruption
(fasttop): 0x0000000004ee1450 ***
======= Backtrace: =========
/lib64/libc.so.6[0x358346e890]
/lib64/libc.so.6(cfree+0x8c)[0x3583471fac]
/usr/lib/libglusterfs.so.0(dict_destroy+0x98)[0x36a8006063]
/usr/lib/libglusterfs.so.0[0x36a8012ca0]
/usr/lib/libglusterfs.so.0(inode_unref+0x4f)[0x36a801303a]
/usr/lib/glusterfs/1.3.pre6/xlator/protocol/server.so[0x2aaaab0d7e60]
/usr/lib/glusterfs/1.3.pre6/xlator/protocol/server.so[0x2aaaab0d7025]
/lib64/libpthread.so.0[0x35840061b5]
/lib64/libc.so.6(clone+0x6d)[0x35834cd36d]
======= Memory map: ========
00400000-00403000 r-xp 00000000 09:02 39311736
/usr/sbin/glusterfsd
00602000-00603000 rw-p 00002000 09:02 39311736
/usr/sbin/glusterfsd
04e01000-05492000 rw-p 04e01000 00:00 0
40000000-40001000 ---p 40000000 00:00 0
40a02000-41402000 rw-p 40a02000 00:00 0
41402000-41403000 ---p 41402000 00:00 0
41403000-41e03000 rw-p 41403000 00:00 0
41e03000-41e04000 ---p 41e03000 00:00 0
41e04000-42804000 rw-p 41e04000 00:00 0
42804000-42805000 ---p 42804000 00:00 0
42805000-43205000 rw-p 42805000 00:00 0
43205000-43206000 ---p 43205000 00:00 0
43206000-43c06000 rw-p 43206000 00:00 0
3583000000-358301a000 r-xp 00000000 09:02 57212930
/lib64/ld-2.5.so
3583219000-358321a000 r--p 00019000 09:02 57212930
/lib64/ld-2.5.so
358321a000-358321b000 rw-p 0001a000 09:02 57212930
/lib64/ld-2.5.so
3583400000-3583544000 r-xp 00000000 09:02 57213184
/lib64/libc-2.5.so
3583544000-3583744000 ---p 00144000 09:02 57213184
/lib64/libc-2.5.so
3583744000-3583748000 r--p 00144000 09:02 57213184
/lib64/libc-2.5.so
3583748000-3583749000 rw-p 00148000 09:02 57213184
/lib64/libc-2.5.so
3583749000-358374e000 rw-p 3583749000 00:00 0
3583800000-3583802000 r-xp 00000000 09:02 57213205
/lib64/libdl-2.5.so
3583802000-3583a02000 ---p 00002000 09:02 57213205
/lib64/libdl-2.5.so
3583a02000-3583a03000 r--p 00002000 09:02 57213205
/lib64/libdl-2.5.so
3583a03000-3583a04000 rw-p 00003000 09:02 57213205
/lib64/libdl-2.5.so
3584000000-3584015000 r-xp 00000000 09:02 57213209
/lib64/libpthread-2.5.so
3584015000-3584214000 ---p 00015000 09:02 57213209
/lib64/libpthread-2.5.so
3584214000-3584215000 r--p 00014000 09:02 57213209
/lib64/libpthread-2.5.so
3584215000-3584216000 rw-p 00015000 09:02 57213209
/lib64/libpthread-2.5.so
3584216000-358421a000 rw-p 3584216000 00:00 0
3593e00000-3593e0d000 r-xp 00000000 09:02 57212980
/lib64/libgcc_s-4.1.1-20070105.so.1
3593e0d000-359400c000 ---p 0000d000 09:02 57212980
/lib64/libgcc_s-4.1.1-20070105.so.1
359400c000-359400d000 rw-p 0000c000 09:02 57212980
/lib64/libgcc_s-4.1.1-20070105.so.1
36a8000000-36a801f000 r-xp 00000000 09:02 39311742
/usr/lib/libglusterfs.so.0.0.0
36a801f000-36a821f000 ---p 0001f000 09:02 39311742
/usr/lib/libglusterfs.so.0.0.0
36a821f000-36a8220000 rw-p 0001f000 09:02 39311742
/usr/lib/libglusterfs.so.0.0.0
3ec5e00000-3ec5e0a000 r-xp 00000000 09:02 39311412
/usr/lib64/libsysfs.so.2.0.0
3ec5e0a000-3ec6009000 ---p 0000a000 09:02 39311412
/usr/lib64/libsysfs.so.2.0.0
3ec6009000-3ec600a000 rw-p 00009000 09:02 39311412
/usr/lib64/libsysfs.so.2.0.0
3ec6200000-3ec6207000 r-xp 00000000 09:02 39299762
/usr/lib64/libibverbs.so.1.0.0
3ec6207000-3ec6407000 ---p 00007000 09:02 39299762
/usr/lib64/libibverbs.so.1.0.0
3ec6407000-3ec6408000 rw-p 00007000 09:02 39299762
/usr/lib64/libibverbs.so.1.0.0
2aaaaaaab000-2aaaaaaad000 rw-p 2aaaaaaab000 00:00 0

Program received signal SIGABRT, Aborted.
[Switching to Thread 1136679232 (LWP 8080)]
0x0000003583430015 in raise () from /lib64/libc.so.6