Resolve "Rework system tests"
What does this MR do?
Completely rework the system tests for more granular information and improved CI runtime.
Changes:
-
add custom
make
targets for testing:-
test_dorie_exec
: simpledorie
wrapper test commands -
test_run_ode
: benchmarks against ODE solutions -
test_run_ref
: bechmarks against Muphi reference -
test_run_parallel
: Check if solutions of sequential and parallel execution are the same
-
- Revamp ODE test: Fewer tests, narrow tolerances
-
Remove
-Werror
from debug configurations, but add tobuild:debug
. This build is allowed to fail now. -
Remove Parameter field correlation tests: We trust
dune-randomfield
... - Merge !33 (merged) into this
- Reduce error tolerances for ODE tests after merge
-
Remove
deploy
stage for now - Fix default reference testing tolerances
Is there something that needs to be double checked?
No
Can this MR be accepted?
- New pipeline passing
Related issues
Closes #46 (closed)