-
Notifications
You must be signed in to change notification settings - Fork 16
Description
Currently, when evaluating solvers across a set of test cases using the eval.py script, there is currently no way to specify hyperparameters with which the solver should be run. This means that to evaluate the solver with a different set of hyperparameters, the default hyperparameter values must be changed in the source code.
To address this, the eval.py script should be modified to accept additional arguments that can specify non-default values for different hyperparameters, including maximum iteration time, error tolerances. etc. The arguments should also be setup to warn the user when a hyperparameter is specified for a solver for which it is not applicatble - for instance, the FABRIKc algorithm does not make use of a rotational error tolerance.