Orange Forum • View topic - Can I use ExampleTable to read very large data files?

Can I use ExampleTable to read very large data files?

A place to ask questions about methods in Orange and how they are used and other general support.

Can I use ExampleTable to read very large data files?

Postby hdeo » Sat May 26, 2007 5:04

From the tests I did with small / medium datasets - it looks like ExampleTable loads the entire file in memory.

If that is correct - how can it be used for very large data sets? I ended up writting a wrappers script to read blocks from the files and creating ExampleTable every time.

Is there a better way?

Postby Janez » Sat May 26, 2007 19:02

No, ExampleTable loads everything in memory.

Postby hdeo » Sun May 27, 2007 0:26

What is the best way to handle large datasets - in that case?

Postby Janez » Sun May 27, 2007 16:04

Reduce them. ;)


Return to Questions & Support