How and When Metrics and Datasets Update