contextual: Evaluating Contextual Multi-Armed Bandit Problems in R - Robin van Emden; Maurits Kaptein (2018)