How the Test Scripts Work: Difference between revisions

From VrlWiki
Jump to navigation Jump to search
No edit summary
Jadrian Miles (talk | contribs)
No edit summary
 
(3 intermediate revisions by one other user not shown)
Line 6: Line 6:
: Checkout src/gfxtest???
: Checkout src/gfxtest???


    src/gfxtest> ./gfxtest  [-noemail] [-notmp] [-d <result/]  mail,...
src/gfxtest> ./gfxtest  [-noemail] [-notmp] [-d <result/]  mail,...
 
         -noemail  Do not email individual test reports to the recipients
         -noemail  Do not email individual test reports to the recipients in
                   in gfxtest.cfg.  By default failed tests mail a notification.
                   gfxtest.cfg.  By default failed tests mail a notification.
                   Successful test runs never cause mail to be sent.
                   Successful test runs never cause mail to be sent.
         -notmp    Run tests in the current $G tree.  Administrative use only.
         -notmp    Run tests in the current $G tree.  Administrative use only.
         -d        Store output files here (default is $G_TMP/gfxtest).
         -d        Store output files here (default is $G_TMP/gfxtest).


Line 35: Line 37:




* Script Files:
* '''Script Files'''
: $G/src/gfxtest/gfxtest.cfg
: $G/src/gfxtest/gfxtest.cfg
:: A configuration file to designate individual tests to be run for each platform and subscribers to be notified when they fail.
:: A configuration file to designate individual tests to be run for each platform and subscribers to be notified when they fail.
: $G/src/gfxtest/gfxtest-project
:: Checkout, build, and install a project.  This is used to setup a test and is invoked via gfxtest/gfxtest.cfg.


: $G/src/gfxtest/gfxtest-nightly
: $G/src/gfxtest/gfxtest-nightly
:: Set up and run the tests.  Subscribers for test summaries are specified here.
:: Set up and run the tests via gfxtest/gfxtest.  Subscribers for test summaries are specified here.


: $G/src/gfxtest/gfxtest
: $G/src/gfxtest/gfxtest
Line 49: Line 54:




* Output Files created on each test machine:
* '''Output Files Created When Tests are Run'''
: $G_TMP/gfxtest/gfxtest-summary.txt
: $G_TMP/gfxtest/gfxtest-summary.txt
:: A summary of test run results.
:: A summary of test run results.
Line 56: Line 61:
:: Output from creation of the $G tree.
:: Output from creation of the $G tree.


: $G_TMP/gfxtest/gfxtest-$testcount-$testName-output.txt
: $G_TMP/gfxtest/gfxtest-<testcount>-<testName>-output.txt
:: Result output from an individual test.
:: Result output from an individual test.
[[Category:$G]][[Category:Software Development]]

Latest revision as of 22:58, 6 March 2009

<<< These are preliminary notes and may not be accurate. >>>

  • Launch $G/src/gfxtest/gfxtest from a designated test machine.
Setup $G normally???
Checkout src/gfxtest???
src/gfxtest> ./gfxtest  [-noemail] [-notmp] [-d <result/]  mail,...

       -noemail   Do not email individual test reports to the recipients in
                  gfxtest.cfg.  By default failed tests mail a notification.
                  Successful test runs never cause mail to be sent.

       -notmp     Run tests in the current $G tree.  Administrative use only.

       -d         Store output files here (default is $G_TMP/gfxtest).


  • gfxtest runs: $G/src/gfxscripts/gfxtree-init
A partial copy of $G is created locally in /ltmp.
The files are extracted from cvs.
Separate duplicate copies are made for each supported architecture with:
       src/gfxtest/     src/gfxscripts    src/gfxtools-doc    src/make
A copy of $G/data/ is made for WIN32 and the Unix copies link to it.


  • $G is set in gfxtest to the test copy.
linux: $G = /ltmp/gfxtest/gfx/tools/linux
WIN32: $G = /tmp/gfxtest/gfx/tools/WIN32


  • Tests are run on a test machines for each supported platform.
Currently these machines are:  ???


  • Script Files
$G/src/gfxtest/gfxtest.cfg
A configuration file to designate individual tests to be run for each platform and subscribers to be notified when they fail.
$G/src/gfxtest/gfxtest-project
Checkout, build, and install a project. This is used to setup a test and is invoked via gfxtest/gfxtest.cfg.
$G/src/gfxtest/gfxtest-nightly
Set up and run the tests via gfxtest/gfxtest. Subscribers for test summaries are specified here.
$G/src/gfxtest/gfxtest
Run tests that can be run on this platform and send notifications to subscribers.
$G/src/gfxscripts/gfxtree-init
Create an initial $G framework in a temporary directory where tests are run.


  • Output Files Created When Tests are Run
$G_TMP/gfxtest/gfxtest-summary.txt
A summary of test run results.
$G_TMP/gfxtest/gfxtest-treeinit-output.txt
Output from creation of the $G tree.
$G_TMP/gfxtest/gfxtest-<testcount>-<testName>-output.txt
Result output from an individual test.