Orange Forum • View topic - Introducing randomness in Test Learners widget.

Introducing randomness in Test Learners widget.

A place to ask questions about methods in Orange and how they are used and other general support.

Introducing randomness in Test Learners widget.

Postby julexp » Fri Jul 05, 2013 0:36

Hi to everybody,

I've noticed that if I run Random Sampling (or any other validation
algorithm) several times (e.g. with the parameter "Repeat train/test" set to
1), I always get the same results for each performance scores, thus indicating that the same data are processed. How can I change random seeds?

Furthermore, I'm interested in evaluating performance scores for every fold
of cross-validation and I can't manage to do it.


Any help?

Thanks in advance!

Re: Introducing randomness in Test Learners widget.

Postby Ales » Fri Jul 05, 2013 11:33

julexp wrote:How can I change random seeds?
This cannot currently be done in the 'Test Learners' widget.
If you are only interested in a single repeat you can simulate this in combination with 'Sample Data' widget to split the data into a train/test set. Connect the 'Data Sample' output to 'Data' input and 'Remaining Data' to 'Separate Test Data' input of the 'Test Learners' widget and select the "Test on test data" option.
julexp wrote:Furthermore, I'm interested in evaluating performance scores for every fold
of cross-validation and I can't manage to do it.
You can again simulate this with the above setup, this time selecting the 'Cross validation' sampling option and send each fold in turn (Fold/group box) in the 'Sample Data' widget.

Re: Introducing randomness in Test Learners widget.

Postby julexp » Wed Jul 17, 2013 23:49

All straight, thank you so much!


Return to Questions & Support



cron