wiki:Orange25/Testing

Version 19 (modified by miha, 2 years ago) (diff)

Orange is tested automatically on our  continuous integration server on each push to  Bitbucket.

Commands

On Python 2.7 or newer run:

  • python -m unittest discover Orange/testing/unit/tests

On older Python versions run:

  • python -m unittest2 discover Orange/testing/unit/tests

Unittest module was updated significantly in the Python 2.7 version. A backport of new unittest features for Python 2.4-2.6 is module unittest2, that  can be installed from pypi.

Regression tests

Regression tests are now run automatically as part of the unittests. However, we advise to write future tests as unittests only. Old convention regarding regression tests still apply. Regression tests for Orange25 are stored in:

  • Orange/testing/regression/tests - testing Orange25
  • Orange/testing/regression/tests_20 - testing backward compatibility
  • docs/reference/rst/code - testing reference scripts
  • docs/tutorial/rst/code - testing tutorial scripts

Test results are saved to:

  • Orange/testing/regression/results_tests
  • Orange/testing/regression/results_tests_20
  • Orange/testing/regression/results_reference
  • Orange/testing/regression/results_tutorial