long running py.test stop at first failure

pytest -x           # stop after first failure
pytest --maxfail=2  # stop after two failures

See the pytest documentation.