RE: high file count in application
- Posted by Matt Lewis <matthewwalkerlewis at yahoo.com> Dec 01, 2003
- 516 views
Kat wrote: <snip> > ...just *one* subdirectory built last year has 414 megabytes in > 118,306 files,, a bit more than EDS can deal with in ram. > Loading that as one EDS file isn't possible... That's probably more than most of us would ever want [for one process to have] in RAM, period. However, I don't see why EDS couldn't handle this much data--by which I mean, it's possible, if not very efficient. Since EDS uses 32-bit pointers, a file can grow to 2Gb (some of that will be overhead, of course). The whole EDS file doesn't get loaded just by opening. That's kinda the point of a database. Based on your figures, it looks like the files average about 3.6K per file. I'm curious (and I'm sure the original poster is, too), how are you using the data, Kat? What do the files look like? How do you access them? Matt Lewis