Translations of this page:

Adapter Regression Tests (ART)

Overview

The ART platform ensures that new adapter bugs are not introduced through the normal development process. Each test contains, at a minimum, a recording and a baseline ZiptieElementDocument (ZED) file. Normal tests ensure that an adapter backup produces a ZED that validates against the ZED schema document and also matches the baseline ZED for the tests.

Caveats

  • Recordings can only have Telnet and TFTP protocols as our simulator doesn't simulate any other protocol
  • The simulator will replace all instances of the recording's host IP address (found in the connectionPath) with the simulated loopback IP (127.x.x.x). This will cause differences in the baseline ZED and the ZED produced as part of the test. To get around this, you should replace the first host attribute in the connectionPath element with something bogus like '4.4.4.4'.

Creating a Test

  • Run 'adapterTool -r' to generate a recording file. Be sure to only use “Telnet” as a protocol. Note that if the real device doesn't support Telnet then you can still generate an SSH recording and then do a replace-all in your recording file replacing 'SSH' with 'Telnet'.
  • Copy the recording file to the AdapterRegressionTests project on /usr/local/cvsroot2 on the redwine server (AlterPoint internal only). Place the file in the appropriate folder under tests.
  • Update the recording to change the *connectionPath host** attibute at the top of your recording to a bogus but valid IP address (e.g. '1.1.2.2') so that the test will the baseline compare.
  • Create a .test file that matches the name of your recording file, except with the .test extension instead of the .record recording. Here is an example .test file.
    recording=Accelar_10.100.4.6.record
    output=Accelar_10.100.4.6.zed
  • run 'adapterTool –test -r [full-path-to-test-file]' to refresh the ZED file for your test.
  • Validate that the test completes by running 'adapterTool –test [full-path-to-test-file] -o test.html' and analyzing the test.hml output
  • Checkin the .test and .record and .zed files into the CVS project AdapterRegressionTests on redwine (/usr/local/cvsroot2). This is an AlterPoint internal server.

Scheduled Test Runs

The tests are run daily on speedy.inside.alterpoint.com (AlterPoint Internal Server) via a Scheduled Task. Results are emailed to those in the runTests.bat file. This same batch file controls the checkout of adapters from ziptie cvs as well as the tests from redwine cvs.

 
dev/adapters_testing.txt · Last modified: 2009/02/26 12:42 by ryankruse
 
Recent changes RSS feed Creative Commons License Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki