RE: memory?
> From: John McAdam [mailto:johnmcadam at clix.pt]
> I got this error message after processing 86 out of 766 items.
<SNIP>
> Hate the idea of rewriting everything to process in little chunks
> and bits. Storing to files. in and out. slow slow slow.
I'm curious as to what these 'items' are. I wrote a program a while back to
do a very large dynamic programming problem (something like 1000 variables
and with some unusual constraints). I'd first tried to solve it as a
knapsack, since that was easy, but it was very slow--and eventually ran out
of memory. So I went to DP.
Even though it was a lot faster, it ate up a ton of memory, and never got
close to a solution. So I changed my tactic. I broke it up into three
different DP problems, and combined them using a tabu search. The result
was very good solutions very quickly (typically less than a minute),
depending on the starting guess I used to initialize the search. It took
some time to rewrite the algorithms, but was definitely worth it.
Of course, without knowing what sort of processing you're doing, I don't
know if there's any way to do something similar, but maybe it will give you
some ideas. Or, if you're willing to share some more about what you're
doing, we could come up with some other solutions.
Matt Lewis
|
Not Categorized, Please Help
|
|
