Cross Validation
Currently, we are always doing grid search and always KFold CV, but with different numbers of folds and repeats.
LOO has to be added. But what else and what do you think would be a good way to specify in the user facing api.
Should we always do Gridsearch even when there are few parameters ( so results are consistent) or only when it is needed?