cfservd seg fault on tls

[Debbie Mazurek]

Hi,

We are having a problem where cfservd is continually dying.  This is on
a Scientific Linux (RHEL clone) 4.1 box, with cfengine-2.1.15-1.2
Also tried the latest cfengine, same thing.

Any ideas?  Below are the tail end of logs with debugging on and the
trace from debugging the core file.

Any help or suggestions would be greatly appreciated.
deb





[root@nasa tmp]# gdb /usr/sbin/cfservd core.13630
GNU gdb Red Hat Linux (6.3.0.0-1.63rh)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you
are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for
details.
This GDB was configured as "i386-redhat-linux-gnu"...(no debugging
symbols found)
Using host libthread_db library "/lib/tls/libthread_db.so.1".

Core was generated by `cfservd'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /lib/tls/i686/libdb-4.2.so...(no debugging symbols
found)...done.
Loaded symbols for /lib/tls/i686/libdb-4.2.so
Reading symbols from /lib/libcrypto.so.4...(no debugging symbols
found)...done.
Loaded symbols for /lib/libcrypto.so.4
Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/tls/libpthread.so.0...(no debugging symbols
found)...done.
Loaded symbols for /lib/tls/libpthread.so.0
Reading symbols from /lib/tls/libm.so.6...
(no debugging symbols found)...done.
Loaded symbols for /lib/tls/libm.so.6
Reading symbols from /lib/tls/libc.so.6...(no debugging symbols
found)...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /usr/lib/libgssapi_krb5.so.2...(no debugging
symbols found)...done.
Loaded symbols for /usr/lib/libgssapi_krb5.so.2
Reading symbols from /usr/lib/libkrb5.so.3...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libkrb5.so.3
Reading symbols from /lib/libcom_err.so.2...
(no debugging symbols found)...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /usr/lib/libk5crypto.so.3...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libk5crypto.so.3
Reading symbols from /lib/libresolv.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /lib/libdl.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/lib/libz.so.1...
(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libnsl.so.1...(no debugging symbols
found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libnss_dns.so.2...
(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_dns.so.2
#0  0x00963b4d in memmove () from /lib/tls/libc.so.6
(gdb) where
#0  0x00963b4d in memmove () from /lib/tls/libc.so.6
#1  0x00cddf1d in __db_pitem () from /lib/tls/i686/libdb-4.2.so
#2  0x00c8a21a in __bam_search () from /lib/tls/i686/libdb-4.2.so
#3  0x00c8b913 in __bam_split () from /lib/tls/i686/libdb-4.2.so
#4  0x00c7e672 in __bam_c_rget () from /lib/tls/i686/libdb-4.2.so
#5  0x00cd9f0c in __db_c_put () from /lib/tls/i686/libdb-4.2.so
#6  0xa85abd70 in ?? ()
#7  0xa85abd50 in ?? ()
#8  0x00000010 in ?? ()
#9  0xa85ab288 in ?? ()
#10 0x00a20800 in __malloc_initialize_hook () from /lib/tls/libc.so.6
#11 0x00000038 in ?? ()
#12 0x00a20800 in __malloc_initialize_hook () from /lib/tls/libc.so.6
#13 0xa85ab290 in ?? ()
#14 0x00a14423 in __libc_ptyname1 () from /lib/tls/libc.so.6
#15 0xb5b00048 in ?? ()
#16 0x00d2ecb8 in ?? () from /lib/tls/i686/libdb-4.2.so
#17 0x00044000 in ?? ()
#18 0xa85ab384 in ?? ()
#19 0xa85ab278 in ?? ()
#20 0x00d14e9e in __os_malloc () from /lib/tls/i686/libdb-4.2.so
#21 0x00000000 in ?? ()
(gdb) quit



>From the log:
Oct 11 19:07:44 nasa cfservd: cfservd: Host ms211v.cpsc.ucalgary.ca
granted access to /export/cfengine-
production/usr/share/gdm/themes/CPSC/.svn/text-base/cpsc.xml.svn-base
Oct 11 19:07:44 nasa cfservd: RecvSocketStream(8)
Oct 11 19:07:44 nasa cfservd: Clocks were off by 0
Oct 11 19:07:44 nasa cfservd: StatFile(/export/cfengine-
production/usr/share/gdm/themes/CPSC/.svn/text-base/cpsc.xml.svn-base)
Oct 11 19:07:44 nasa cfservd:     (Concatenated 8 from stream)
Oct 11 19:07:44 nasa cfservd:
Loaded /var/cfengine/ppkeys/root-10.7.0.165.pub
Oct 11 19:07:44 nasa cfservd: Transaction Receive [t 87][]
Oct 11 19:07:44 nasa cfservd: RecvSocketStream(87)
Oct 11 19:07:44 nasa cfservd:     (Concatenated 87 from stream)
Oct 11 19:07:44 nasa cfservd: Received: [MD5 /export/cfengine-
production/usr/share/ssl/certs/ca-bundle.crt.any] on socket 100
Oct 11 19:07:44 nasa cfservd: OK: type=0
Oct 11 19:07:44 nasa cfservd:  mode=444
Oct 11 19:07:44 nasa cfservd:  lmode=0
Oct 11 19:07:44 nasa cfservd:  uid=48
Oct 11 19:07:44 nasa cfservd:  gid=48
Oct 11 19:07:44 nasa cfservd:  size=16207
Oct 11 19:07:44 nasa cfservd:  atime=1129079207
Oct 11 19:07:44 nasa cfservd:  mtime=1126558087
Oct 11 19:07:44 nasa cfservd: A public key was already known from
zone40wd.cpsc.ucalgary.ca/10.7.0.165 - no trust required
Oct 11 19:07:44 nasa cfservd: Adding IP 10.7.0.165 to SkipVerify - no
need to check this if we have a key
Oct 11 19:07:44 nasa cfservd: Prepending [10.7.0.165]
Oct 11 19:07:44 nasa cfservd:
Oct 11 19:07:44 nasa cfservd: FuzzyItemIn(LIST,10.7.0.165)
Oct 11 19:07:44 nasa cfservd:  Try FuzzySetMatch(136.159.,10.7.0.165)
Oct 11 19:07:44 nasa cfservd: Transaction Send[t 72][Packed text]
Oct 11 19:07:44 nasa cfservd: Attempting to send 80 bytes
Oct 11 19:07:44 nasa cfservd:  Try FuzzySetMatch(10.,10.7.0.165)
Oct 11 19:07:44 nasa cfservd: CompareLocalChecksums(/export/cfengine-
production/usr/share/ssl/certs/ca-
bundle.crt.any,MD5=de68ecf0c00049b80c0ed5f9b436aff2)
Oct 11 19:07:44 nasa cfservd: The key does not match the known, key but
the host has dynamic IP...
Oct 11 19:07:44 nasa cfservd:
Oct 11 19:07:44 nasa cfservd: FuzzyItemIn(LIST,10.7.0.16