Dominating in Recommender Systems
One model dominates another when it is at least as good on every metric and better on at least one. Most comparisons end with several non-dominated models and a trade-off to decide.
-
-
DeLong’s Test
A case-resampling bootstrap gives 0.015711 where DeLong’s closed form gives 0.015541.
-
Comparing Models: Uncertainty and Significance
Assess the size and uncertainty of a model difference, then consider whether the changed decisions have practical value.