[gnugo-devel] some tests

[max-d]

Here are some results from (SZ 19) games between gnugo versions .
into brackets are the score minus 0.5.
i don't exactly know what that means but 3.3.16 did better than
3.3.19 and 3.3.16 did better against 3.2 than 3.3.19 did.

At the end of the message, is a sgf file from 3.3.16 lv 10 playing against
itself at
lv 12 (game 35 : lv 10 won by 133.5)
after 187 = G12 , all gnugo versions have trouble to analyse the
the M16 group even when they are asked precise questions
eg = 1 L19(*owl_defend  M17*)
which is wrong !
The problem is fairly easy
i have already see Gnugo solving much more complex problems.
md.


129 games

= gnugo.3.2 lv 10 45
= gnugo3_3_16 lv 11 84

65%

= gnugo.3.2 won:
6 (7)
7 (52)
8 (3)
14 (0)
16 (19)
17 (23)
18 (2)
19 (4)
20 (10)
21 (35)
22 (47)
25 (18)
26 (0)
27 (3)
31 (13)
32 (18)
34 (13)
35 (0)
41 (21)
44 (42)
50 (34)
52 (5)
56 (63)
57 (13)
61 (32)
71 (12)
72 (10)
83 (8)
85 (25)
86 (8)
89 (0)
97 (7)
99 (29)
103 (28)
106 (2)
110 (33)
115 (4)
118 (7)
120 (18)
122 (40)
123 (21)
124 (0)
125 (36)
128 (8)
129 (11)

= gnugo3_3_16 won:
1 (45)
2 (0)
3 (10)
4 (26)
5 (30)
9 (1)
10 (18)
11 (10)
12 (27)
13 (8)
15 (0)
23 (21)
24 (10)
28 (6)
29 (65)
30 (7)
33 (22)
36 (16)
37 (2)
38 (71)
39 (19)
40 (54)
42 (35)
43 (48)
45 (25)
46 (24)
47 (34)
48 (11)
49 (20)
51 (12)
53 (1)
54 (29)
55 (53)
58 (48)
59 (1)
60 (10)
62 (40)
63 (53)
64 (19)
65 (35)
66 (37)
67 (25)
68 (7)
69 (45)
70 (29)
73 (35)
74 (9)
75 (45)
76 (19)
77 (13)
78 (9)
79 (12)
80 (9)
81 (83)
82 (24)
84 (0)
87 (47)
88 (5)
90 (23)
91 (25)
92 (0)
93 (11)
94 (2)
95 (13)
96 (27)
98 (32)
100 (62)
101 (3)
102 (0)
104 (22)
105 (89)
107 (0)
108 (5)
109 (14)
111 (33)
112 (10)
113 (14)
114 (38)
116 (2)
117 (47)
119 (20)
121 (4)
126 (7)
127 (35)

time = gnugo.3.2: 35161
time = gnugo3_3_16: 30847
--------------------------------------------------------

185 games level 10

= gnugo3_3_16 105
= gnugo-3.3.19 80

56.75%

= gnugo3_3_16 won:
1 (15)
5 (46)
6 (7)
7 (44)
9 (36)
12 (10)
13 (1)
16 (4)
18 (3)
19 (7)
21 (6)
23 (20)
24 (27)
25 (80)
26 (5)
29 (12)
30 (6)
32 (31)
35 (13)
36 (15)
38 (11)
39 (11)
40 (19)
41 (14)
42 (37)
43 (55)
44 (10)
46 (63)
47 (17)
49 (15)
50 (12)
51 (12)
52 (10)
55 (36)
56 (22)
58 (1)
59 (5)
61 (22)
64 (9)
65 (72)
67 (33)
69 (28)
70 (0)
71 (11)
72 (40)
73 (2)
77 (39)
78 (6)
79 (65)
81 (15)
82 (21)
85 (0)
87 (8)
88 (75)
89 (2)
92 (37)
93 (4)
95 (41)
97 (6)
98 (2)
99 (17)
101 (10)
106 (0)
107 (25)
109 (28)
113 (8)
114 (37)
116 (0)
118 (42)
119 (54)
120 (57)
122 (65)
125 (12)
130 (70)
131 (11)
133 (26)
135 (19)
138 (4)
139 (20)
140 (6)
141 (16)
142 (40)
143 (26)
144 (2)
146 (13)
148 (34)
149 (17)
150 (12)
151 (52)
152 (14)
157 (5)
158 (4)
159 (24)
160 (52)
161 (48)
168 (4)
169 (51)
171 (37)
172 (1)
176 (3)
177 (33)
178 (19)
180 (13)
184 (13)
185 (17)

= gnugo-3.3.19 won:
2 (2)
3 (3)
4 (15)
8 (20)
10 (7)
11 (41)
14 (107)
15 (10)
17 (2)
20 (34)
22 (9)
27 (26)
28 (7)
31 (7)
33 (5)
34 (28)
37 (5)
45 (5)
48 (19)
53 (23)
54 (4)
57 (19)
60 (7)
62 (11)
63 (19)
66 (8)
68 (7)
74 (3)
75 (18)
76 (12)
80 (30)
83 (24)
84 (4)
86 (7)
90 (9)
91 (9)
94 (17)
96 (15)
100 (32)
102 (7)
103 (9)
104 (13)
105 (34)
108 (15)
110 (33)
111 (27)
112 (16)
115 (2)
117 (3)
121 (9)
123 (2)
124 (1)
126 (20)
127 (12)
128 (19)
129 (16)
132 (20)
134 (6)
136 (21)
137 (7)
145 (0)
147 (5)
153 (6)
154 (6)
155 (75)
156 (16)
162 (17)
163 (23)
164 (10)
165 (69)
166 (6)
167 (5)
170 (7)
173 (17)
174 (11)
175 (5)
179 (24)
181 (28)
182 (18)
183 (31)

time = gnugo3_3_16: 44337
time = gnugo-3.3.19: 42350

----------------------------------------------------

52 games level 10

= gnugo.3.2    19
= gnugo-3.3.19 33

63.5%

= gnugo.3.2 won:
2 (62)
3 (1)
5 (5)
12 (10)
14 (42)
15 (17)
17 (38)
20 (12)
21 (58)
26 (6)
28 (10)
34 (12)
35 (26)
36 (0)
37 (18)
40 (30)
42 (9)
47 (14)
48 (16)

= gnugo-3.3.19 won:
1 (2)
4 (51)
6 (46)
7 (50)
8 (17)
9 (13)
10 (20)
11 (6)
13 (33)
16 (33)
18 (1)
19 (7)
22 (1)
23 (6)
24 (31)
25 (25)
27 (16)
29 (23)
30 (8)
31 (37)
32 (7)
33 (11)
38 (19)
39 (7)
41 (18)
43 (15)
44 (22)
45 (5)
46 (27)
49 (25)
50 (8)
51 (2)
52 (10)

time = gnugo.3.2: 14765
time = gnugo-3.3.19: 12286

----------------------------------------------------
48 games
(gnugo3_3_160= gnugo3_3_16 level 10
gnugo3_3_16 = gnugo3_3_16 level 12)


= gnugo3_3_160 18
= gnugo3_3_16 30

62.5%

= gnugo3_3_160 won:
1 (2)
3 (14)
4 (16)
10 (5)
11 (9)
13 (9)
14 (1)
19 (32)
25 (18)
27 (9)
29 (13)
30 (29)
31 (13)
35 (133)
38 (0)
40 (11)
41 (55)
47 (3)

= gnugo3_3_16 won:
2 (29)
5 (5)
6 (1)
7 (59)
8 (33)
9 (33)
12 (42)
15 (20)
16 (6)
17 (71)
18 (2)
20 (11)
21 (5)
22 (23)
23 (40)
24 (31)
26 (11)
28 (8)
32 (12)
33 (5)
34 (1)
36 (7)
37 (49)
39 (26)
42 (44)
43 (6)
44 (0)
45 (12)
46 (4)
48 (4)

time = gnugo3_3_160: 11858
time = gnugo3_3_16: 18704

--------

Game 35
Size 19
Black = gnugo3_3_160 White = gnugo3_3_16
Level black = 10 Level white = 12
Time black = 286,2 Time white = 582,6
Score = = B+133.5 (upper bound: -133.5, lower: -133.5)
(
;B[pd]
;W[dp]
;B[pp]
;W[dd]
;B[pj]
;W[dj]
;B[jd]
;W[nq]
;B[lq]
;W[no]
;B[pn]
;W[nm]
;B[iq]
;W[nd]
;B[pf]
;W[pc]
;B[qc]
;W[oc]
;B[qb]
;W[hc]
;B[fq]
;W[cn]
;B[dr]
;W[cq]
;B[cf]
;W[ce]
;B[df]
;W[fd]
;B[pl]
;W[ch]
;B[bg]
;W[pr]
;B[qq]
;W[qr]
;B[be]
;W[bd]
;B[bh]
;W[kn]
;B[ad]
;W[bc]
;B[rr]
;W[cr]
;B[fo]
;W[eg]
;B[nk]
;W[er]
;B[fr]
;W[dq]
;B[bj]
;W[fs]
;B[io]
;W[hs]
;B[ci]
;W[im]
;B[nf]
;W[mc]
;B[lk]
;W[en]
;B[ih]
;W[jr]
;B[jq]
;W[kl]
;B[kr]
;W[js]
;B[jj]
;W[kp]
;B[lp]
;W[lo]
;B[jp]
;W[jc]
;B[kc]
;W[kb]
;B[jb]
;W[lc]
;B[ic]
;W[lb]
;B[mr]
;W[lf]
;B[nb]
;W[ld]
;B[hb]
;W[lh]
;B[hp]
;W[ob]
;B[hd]
;W[mp]
;B[gc]
;W[nr]
;B[mi]
;W[mh]
;B[nh]
;W[ik]
;B[db]
;W[dc]
;B[eb]
;W[cb]
;B[ij]
;W[ls]
;B[ks]
;W[gr]
;B[ms]
;W[dl]
;B[bl]
;W[fl]
;B[dh]
;W[ec]
;B[fc]
;W[rs]
;B[rq]
;W[ac]
;B[ae]
;W[ef]
;B[de]
;W[ee]
;B[eh]
;W[hg]
;B[ge]
;W[bm]
;B[mg]
;W[lg]
;B[hn]
;W[da]
;B[fa]
;W[al]
;B[ak]
;W[am]
;B[jo]
;W[ko]
;B[kq]
;W[kd]
;B[ck]
;W[cl]
;B[bk]
;W[pb]
;B[dk]
;W[qa]
;B[ra]
;W[pa]
;B[od]
;W[rb]
;B[rc]
;W[sa]
;B[ek]
;W[gk]
;B[ll]
;W[lm]
;B[kk]
;W[om]
;B[pm]
;W[jk]
;B[ml]
;W[jc]
;B[je]
;W[ja]
;B[ib]
;W[gg]
;B[fh]
;W[gf]
;B[oq]
;W[pq]
;B[op]
;W[or]
;B[mf]
;W[fe]
;B[me]
;W[le]
;B[ne]
;W[jg]
;B[ig]
;W[if]
;B[jf]
;W[fj]
;B[ej]
;W[he]
;B[gd]
;W[el]
;B[kg]
;W[kh]
;B[jh]
;W[md]
;B[fg]
;W[cd]
;B[ff]
;W[li]
;B[lj]
;W[gi]
;B[gh]
;W[hi]
;B[ka]
;W[hh]
;B[hj]
;W[kc]
;B[gj]
;W[la]
;B[na]
;W[fk]
;B[fi]
;W[eo]
;B[dg]
;W[ed]
;B[jn]
;W[jm]
;B[eq]
;W[es]
;B[mm]
;W[mn]
;B[on]
;W[nn]
;B[ir]
;W[fp]
;B[gq]
;W[go]
;B[is]
;W[gs]
;B[ol]
;W[hr]
;B[oo]
;W[gm]
;B[hk]
;W[hl]
;B[gn]
;W[fn]
;B[ns]
;W[gp]
;B[np]
;W[mq]
;B[os]
;W[sr]
;B[sq]
;W[qs]
;B[ss]
;W[qd]
;B[rd]
;W[sr]
;B[ba]
;W[ca]
;B[ea]
;W[bb]
;B[ss]
;W[qe]
;B[re]
;W[sr]
;B[ab]
;W[aa]
;B[ss]
;W[pe]
;B[oe]
;W[sr]
;B[hq]
;W[ds]
;B[ep]
;W[ss]
;B[nl]
;W[hm]
;B[in]
;W[fo]
;B[ho]
;W[mo]
;B[lr]
;W[ps]
)