Allow testenv to be "non-voting" (optional)

[pytoxbot]

• Bitbucket: https://bitbucket.org/hpk42/tox/issue/174
• Originally reported by: @aconrad
• Originally created at: 2014-05-28T03:13:44.661

I would like to see an option that tells tox to not fail for testenvs / jobs that are considered optional.

For example, if I have a section [testenv:pep8] I don't want tox to fail if I mark it as non-voting. So if a testenv returns a non-zero status (failure) then tox would still exit with a zero status but display a warning that a non-voting test failed.

#!ini

[tox]
skipsdist = True
envlist = py26, py27, pep8

[testenv]
commands =
        pip install -e .
        pip install -r test-requirements.txt
        py.test {posargs}

[testenv:pep8]
voting = False
commands =
        pip install pep8
        pep8 --ignore=E501 myproject/

If this is considered a good idea, I'd like to try implementing it.

[pytoxbot]

Original comment by @hpk42

fix issue174: add new ignore_outcome testenv attribute which
can be set to True in which case it will produce a warning instead
of an error on a failed testenv command outcome.
Thanks Rebecka Gulliksson for the PR.

→ <<cset 618ba985f958>>

[pytoxbot]

Original comment by @msabramo

Yes, this would be useful. I might also use this to monitor Python 3 compatibility without strictly requiring it.