Orange Forum • View topic - Test Learner dealing with multiclass classification prob.

Test Learner dealing with multiclass classification prob.

A place to ask questions about methods in Orange and how they are used and other general support.

Test Learner dealing with multiclass classification prob.

Postby julexp » Thu Jul 18, 2013 0:01

Dear all,

does anyone know how the Test Learner widget computes sensitivity, specificity, brier score and AUC in multiclass classification problems?

Does it compute a simple mean of 1 vs all indices for every class?

Re: Test Learner dealing with multiclass classification prob

Postby Ales » Thu Jul 18, 2013 14:49

Sensitivity, specificity, precision, recall, F1 and Matthews corr. coeff. are computed for the class (one vs. rest) selected in the 'Target class' box.
AUC is computed by a weighted mean of all one vs. one pair AUC scores (weighted by joint class probability estimated from the training data)


Return to Questions & Support



cron