Orange Forum • View topic - Per-fold cross validation accuracy, AUC, etc.

Per-fold cross validation accuracy, AUC, etc.

A place to ask questions about methods in Orange and how they are used and other general support.

Per-fold cross validation accuracy, AUC, etc.

Postby Kenny » Fri Nov 17, 2006 23:03

Is there any way with the built in cross validation functions to get the CA, AUC, etc. for each fold? Thanks!

Kenny

Postby Blaz » Fri Dec 01, 2006 20:11

No, but there is a very simple trick that you can use. Use MakeRandomIndicesCV to get fold index for each of the data instances. In the loop, sample the data to test and train subsets (according to cross-validation), use learnAndTestOnTestData from orngTest and then use any performance measure from orngStat that you need.


Return to Questions & Support



cron