We are
making contributions to LiPS ( http://www.lipsforum.org
) and developing some software and applications to implement the LiPS
Specifications. Some software have been done. To ensure the quality of those
software and save resources, we want to use some open source tools to perform
the auto GUI test for some gtk+ based phone applications like address book,
voice call. Xnee is a good candidate. And yes, it is indeed. But after some
investigation, we find that Xnee can't help to determine the
correctness of the test result except the recording and replaying. So we
have no choice but turn to your help whether we can find a solution to achieve
this.
To explain our requirements clearly, here is a
example of the "contact
search" for address book
application . For example, in the search interface of Address
book, when typing
'j' through phone
keypad , the matched contacts starting with 'j' will be
listed in alphabet order. we name the matched contacts as the
expected results.
Our current
status is: test specification is ready and we can perform the recording and
replaying correctly with Xnee. The scenario
we image is like below:
(1). tester or
developer perform the test manually according to the test specification
to obtain the test script which just record the EVENT sequence, that
is the 'recording' process.
(2). For
the regression test, the test will be perform the test automatically without
tester's intervention.
The current Xnee release can't meet the
requirement of step (2). After reading the Xnee manual, maybe the
'synchronism mechanism in Xnee" is helpful. As the synchronism
mechanism, it records more DATA than just the EVENT to be
replayed. Based on this mechanism, we think that can we also
introduce this mechanism to step (1) to record the test results as the DATA
field in the script file. (for each test case in our test
specifications, the results/outputs will be specified for the given
inputs. this is the base of our idea.) During the replaying process,
just comparing the DATA field with those DATA from recording process Xnee will
determine the correctness automatically. Because the DATA output
will be same for each test case
ideally.