We are making contributions to LiPS ( http://www.lipsforum.org ) and
developing some software and applications to implement the LiPS
Specifications. Some software have been done. To ensure the quality of those
software and save resources, we want to use some open source tools to perform
the auto GUI test for some gtk+ based phone applications like address book,
voice call. Xnee is a good candidate. And yes, it is indeed. But after some
investigation, we find that Xnee can't help to determine
the correctness of the test result except the recording and replaying.
So we have no choice but turn to your help whether we can find a solution to
achieve this.
To explain our requirements clearly, here is a example
of the "contact search" for address
book
application . For
example, in
the search interface of Address book,
when typing 'j' through phone
keypad , the matched contacts starting with 'j'
will be listed in alphabet order. we name the matched contacts as
the expected results.
Our current status is:
test specification is ready and we can perform the recording and
replaying correctly with Xnee. The
scenario we image is like below:
(1). tester or developer perform the test
manually according to the test specification to obtain the test script
which just record the EVENT sequence, that is the 'recording'
process.
(2). For the regression test, the test
will be perform the test automatically without tester's
intervention.
The current Xnee release can't meet the requirement of step (2).
After reading the Xnee manual, maybe the 'synchronism mechanism in Xnee" is
helpful. As the synchronism mechanism, it records more
DATA than just the EVENT to be replayed. Based on this
mechanism, we think that can we also introduce this mechanism to
step (1) to record the test results as the DATA field in the script file. (for each test case in our test specifications, the
results/outputs will be specified for the given inputs. this is the base of
our idea.) During the replaying process, just comparing the DATA
field with those DATA from recording process Xnee will determine the
correctness automatically. Because the DATA output
will be same for each test case
ideally.