scoringutils: Utilities for Scoring and Assessing Predictions

Provides a collection of metrics and proper scoring rules (Tilmann Gneiting & Adrian E Raftery (2007) <doi:10.1198/016214506000001437>, Jordan, A., Krüger, F., & Lerch, S. (2019) <doi:10.18637/jss.v090.i12>) within a consistent framework for evaluation, comparison and visualisation of forecasts. In addition to proper scoring rules, functions are provided to assess bias, sharpness and calibration (Sebastian Funk, Anton Camacho, Adam J. Kucharski, Rachel Lowe, Rosalind M. Eggo, W. John Edmunds (2019) <doi:10.1371/journal.pcbi.1006785>) of forecasts. Several types of predictions (e.g. binary, discrete, continuous) which may come in different formats (e.g. forecasts represented by predictive samples or by quantiles of the predictive distribution) can be evaluated. Scoring metrics can be used either through a convenient data.frame format, or can be applied as individual functions in a vector / matrix format. All functionality has been implemented with a focus on performance and is robustly tested. Find more information about the package in the accompanying paper (<doi:10.48550/arXiv.2205.07090>).

Version: 1.2.2
Depends: R (≥ 3.6)
Imports: data.table, ggdist (≥ 3.2.0), ggplot2 (≥ 3.4.0), lifecycle, methods, rlang, scoringRules, stats
Suggests: kableExtra, knitr, magrittr, rmarkdown, testthat, vdiffr
Published: 2023-11-29
DOI: 10.32614/CRAN.package.scoringutils
Author: Nikos Bosse ORCID iD [aut, cre], Sam Abbott ORCID iD [aut], Hugo Gruson ORCID iD [aut], Johannes Bracher ORCID iD [ctb], Sebastian Funk [aut]
Maintainer: Nikos Bosse <nikosbosse at gmail.com>
BugReports: https://github.com/epiforecasts/scoringutils/issues
License: MIT + file LICENSE
URL: https://doi.org/10.48550/arXiv.2205.07090, https://epiforecasts.io/scoringutils/, https://github.com/epiforecasts/scoringutils
NeedsCompilation: no
Language: en-GB
Citation: scoringutils citation info
Materials: README NEWS
In views: TimeSeries
CRAN checks: scoringutils results [issues need fixing before 2024-10-31]

Documentation:

Reference manual: scoringutils.pdf
Vignettes: Details on the metrics implemented in 'scoringutils'
Scoring forecasts directly
Getting started

Downloads:

Package source: scoringutils_1.2.2.tar.gz
Windows binaries: r-devel: scoringutils_1.2.2.zip, r-release: scoringutils_1.2.2.zip, r-oldrel: scoringutils_1.2.2.zip
macOS binaries: r-release (arm64): scoringutils_1.2.2.tgz, r-oldrel (arm64): scoringutils_1.2.2.tgz, r-release (x86_64): scoringutils_1.2.2.tgz, r-oldrel (x86_64): scoringutils_1.2.2.tgz
Old sources: scoringutils archive

Linking:

Please use the canonical form https://CRAN.R-project.org/package=scoringutils to link to this page.