vip is an R package for constructing variable importance plots (VIPs). VIPs are part of a larger framework referred to as interpretable machine learning (IML), which includes (but not limited to): partial dependence plots (PDPs) and individual conditional expectation (ICE) curves. While PDPs and ICE curves (available in the R package pdp) help visualize feature effects, VIPs help visualize feature impact (either locally or globally). An in-progress, but comprehensive, overview of IML can be found here: https://github.com/christophM/interpretable-ml-book.
Many supervised learning algorithms can naturally emit some measure
of importance for the features used in the model, and these approaches
are embedded in many different packages. The downside, however, is that
each package uses a different function and interface and it can be
challenging (and distracting) to have to remember each one (e.g.,
remembering to use xgb.importance() for xgboost models and
gbm.summary() for gbm models). With vip you get one
consistent interface to computing variable importance for many types of
supervised learning models across a number of packages. Additionally, vip offers a
number of model-agnostic procedures for computing feature
importance (see the next section) as well an experimental function for
quantifying the strength of potential interaction effects. For details
and example usage, visit the vip package
website.
Model-based variable importance - Compute variable importance specific to a particular model (like a random forest, gradient boosted decision trees, or multivariate adaptive regression splines) from a wide range of R packages (e.g., randomForest, ranger, xgboost, and many more). Also supports the caret and parsnip (starting with version 0.0.4) packages.
Permutation-based variable importance - An efficient implementation of the permutation feature importance algorithm discussed in this chapter from Christoph Molnar’s Interpretable Machine Learning book.
Shapley-based variable importance - An efficient implementation of feature importance based on the popular Shapley values via the fastshap package.
Variance-based variable importance - Compute variable importance using a simple feature importance ranking measure (FIRM) approach. For details, see see Greenwell et al. (2018) and Scholbeck et al. (2019).
# The easiest way to get vip is to install it from CRAN:
install.packages("vip")
# Alternatively, you can install the development version from GitHub:
if (!requireNamespace("remotes")) {
install.packages("remotes")
}
remotes::install_github("koalaverse/vip")