Re: Test results from base

[Wolfgang Lux]

So, I finally got round to running make check with an up-to-date copy  
of -base (svn r32689).
These are the results for gnu-gnu-gnu on OS X 10.5 using gcc 4.5 from  
MacPorts and the gnu runtime of the compiler.

4276 Passed tests
  19 Dashed hopes
  12 Failed tests
   7 Failed files
   1 Skipped set

The skipped set is base/NSStream/socket.m, probably since I have  
disabled gnutls (I haven't yet found a way to have it refrain from  
linking with Apple's libobjc).

The 12 failed tests occur in
 base/NSNumberFormatter/basic.m:
  Failed test:       basic.m:31 ... Handle leading zeroes in  
fractional part: 1.1
  Expected '1.1' and got '1.01'
and base/NSNumberFormatter/basic10_4.m:
  Start set:         basic10_4.m:58 ... NSLocale
  Passed test:         basic10_4.m:63 ... formatting suceeded
  Passed test:         basic10_4.m:67 ... is not equal to NaN
  Passed test:         basic10_4.m:69 ... is equal to zero
  Failed test:         basic10_4.m:75 ... default 10.4 format same as  
Cocoa
  Expected '1235' and got 'NaN'
  Failed test:         basic10_4.m:82 ... round up for fractional  
part >0.5
  Expected '1234.57' and got 'NaN'
  Failed test:         basic10_4.m:87 ... round down for fractional  
part <0.5
  Expected '1234.43' and got 'NaN'
  Failed test:         basic10_4.m:93 ... minus sign assigned correctly
  Expected '_1234.4' and got 'NaN'
  Dashed hope:         basic10_4.m:100 ... Negative percentage correct
  Expected '_123,443##' and got 'NaN'
  Failed test:         basic10_4.m:111 ... format width set correctly
  Expected '**1234' and got '***NaN'
  Failed test:         basic10_4.m:115 ... positive prefix set  
correctly
  Expected '*+1234' and got '***NaN'
  Failed test:         basic10_4.m:119 ... default padding position  
is before prefix
  Expected '0+1234' and got '000NaN'
  Failed test:         basic10_4.m:124 ... numeric and space padding OK
  Expected '+01234' and got '000NaN'
  Dashed hope:         basic10_4.m:132 ... currency style does not  
include currency string
  Expected '+1.235' and got '000NaN'
  Failed test:         basic10_4.m:137 ... positive prefix is set  
correctly for currency style
  Expected '+1.235' and got '000NaN'
  Failed test:         basic10_4.m:141 ... prefix and suffix used  
properly
  Expected '+1.235c' and got '000NaN'
  Failed test:         basic10_4.m:145 ... negativeFormat used for - 
ve number
In case this matters, I'm using ICU 4.6.0 from MacPorts.

The failed files are
 base/NSException/mixedException.mm
 base/NSException/sillySemantics.mm
 base/NSException/skipCatchall.mm
 base/NSObject/objc++.mm
 base/NSOperation/basic.m:
 base/NSOperation/threads.m:
 base/headers/ObjCXX.mm

All ObjC++ tests fail with a missing symbol error at runtime
  Symbol not found: __ZTIP11NSException
  Referenced from: /Users/Shared/GNUstep/libs/base/Tests/base/ 
NSObject/./obj/objc++
  Expected in: dynamic lookup

The detailed output for base/NSOperation/basic.m is
Running base/NSOperation/basic.m...
Passed test:     Class 'NSOperation' exists
Passed test:     Class 'NSOperation' has working alloc
Passed test:     Class 'NSOperation' alloc gives the correct class
Passed test:     Class 'NSOperation' has working init
Passed test:     Class 'NSOperation' has working new
Passed test:     Class 'NSOperation' has working allocWithZone
Passed test:     basic.m:16 ... can create an operation
Passed test:     NSOperation is a known className
Passed test:     Object 0 of class 'NSOperation' conforms to NSObject
Passed test:     Object 0 of class 'NSOperation' can return self
Passed test:     Object 0 of class 'NSOperation' can return own class
Passed test:     Object 0 of class 'NSOperation' object <NSOperation:  
0x1e12d68> is of correct class
Passed test:     Object 0 of class 'NSOperation' isMemberOfClass works
Passed test:     Object 0 of class 'NSOperation' can return superclass
Passed test:     Object 0 of class 'NSOperation' responds to hash
Passed test:     Object 0 of class 'NSOperation' isEqual: to self
Passed test:     Object 0 of class 'NSOperation' respondsToSelector:
Passed test:     Object 0 of class 'NSOperation' handles retain
Passed test:     Object 0 of class 'NSOperation' has working retainCount
Passed test:     Object 0 of class 'NSOperation' has NSString  
description
Passed test:     Object 0 of class 'NSOperation' handles performSelector
Passed test:     basic.m:20 ... operation is ready
Passed test:     basic.m:21 ... operation is not concurrent
Passed test:     basic.m:22 ... operation is not cancelled
Passed test:     basic.m:23 ... operation is not executing
Passed test:     basic.m:24 ... operation is not finished
Passed test:     basic.m:26 ... operation has no dependencies
Passed test:     basic.m:28 ... operation has normal priority
Passed test:     basic.m:31 ... operation has very high priority
Passed test:     basic.m:36 ... operation has added dependency
Passed test:     basic.m:37 ... operation with dependency is not ready
Passed test:     basic.m:40 ... cancelled dependency continues
Passed test:     basic.m:41 ... operation is cancelled
Passed test:     basic.m:43 ... cancelled dependency continues
Passed test:     basic.m:44 ... operation with cancelled dependency  
not ready
Passed test:     basic.m:47 ... dependency removal works
Passed test:     basic.m:48 ... operation without dependency is ready
Passed test:     basic.m:57 ... operation is finished
Passed test:     basic.m:58 ... a finished operation is ready
Passed test:     basic.m:60 ... finished dependency continues
Passed test:     basic.m:61 ... operation with finished dependency is  
ready
Passed test:     basic.m:70 ... a cancelled object is ready even with  
a dependency
Passed test:     basic.m:74 ... a cancelled object can finish
./obj/basic: Uncaught exception NSInvalidArgumentException, reason:  
[NSOperation-start] called on executing operation
/usr/GNUstep/System/Tools/gnustep-tests: line 278: 35155 Abort  
trap              $RUN_CMD
Failed file:     basic.m aborted without running all tests!

The detailed output for base/NSOperation/threads.m is
Running base/NSOperation/threads.m...
Passed test:     threads.m:128 ... counter was set up
Passed test:     threads.m:133 ... operation ran
Passed test:     threads.m:134 ... operation ran in this thread
2011-03-23 18:35:23.059 threads[35198] WARNING your program is  
becoming multi-threaded, but you are using an ObjectiveC runtime  
library which does not have a thread-safe implementation of the  
+initialize method.  This means that any classes not already used may  
be incorrectly initialised, potentially causing strange behaviors and  
crashes.
To put this into context, the runtime bug has been knoown for several  
years and only rarely causes problems ... the easy workaround being to  
ensure that any classes used by a new thread have already been used in  
the main thread before the new thread starts.
If you are worried, please build/run GNUstep with a runtime which  
supports the +initialize method. The GNUstep stable runtime (libobjc)  
and experimental runtime (libobjc2), available from the GNUstep  
website and subversion repository, should both work.
To disable this warning (eg. for an application which does not suffer  
any problems caused by this runtime bug), please set the  
GSSilenceInitializeWarning user default to YES.
Passed test:     threads.m:143 ... operation finished
Passed test:     threads.m:144 ... operation ran
Passed test:     threads.m:145 ... operation ran in other thread
Passed test:     threads.m:154 ... operation exited
Passed test:     threads.m:155 ... operation ran
Passed test:     threads.m:156 ... operation ran in other thread
Passed test:     threads.m:157 ... operation seems to be running
./obj/threads: Uncaught exception NSGenericException, reason: done
/usr/GNUstep/System/Tools/gnustep-tests: line 278: 35198 Abort  
trap              $RUN_CMD
Failed file:     threads.m aborted without running all tests!

Wolfgang