OpenEuphoria

Re: Str-Kat

• Posted by ken mortenson <kenneth_john at ?ahoo.?om> May 31, 2008
• 730 views

Kat wrote:
> 
> ken mortenson wrote:
> > But your case would be a lot stronger if you had written a string library
> > and already found it's performance limited.  
> 
> Did, done, found it so. Try winxp on a computer with 512megs memory, and load
> and use strtok's parse on a 100kbyte string. 100K byte isn't hard to find,
> some
> webpages are over 100Kbytes, NOT counting the css, js, and pics. You'll get
> bogged down with drive swapping the memory back and forth.

I put together computer from the junk I've got around the house that only
had 32mb or RAM.  I had to search all over the internet for utils and a
browser that would perform on such a limited machine (The power switch died
on it and I haven't replaced it, so I took another machine out of storage
which is a bit better.)

Anyway, you're probably able better than some of the younger folk (assuming
there are younger folk here, I really have no idea of the age demographic)
to remember when we had to tape sorts?  I'm talking millions of records
on 9 track tape.  We made it work.

Your always going to find applications where this isn't enough memory.
Having four times the memory (or having Euphoria use real strings instead
of sequences) isn't going to change that much.

I would take a careful look at what you're doing with the data and try
to manipulate it in a way that doesn't fill memory so much which is putting
you in a disk churning situation because of memory swaps.

I usually only deal with a subset of my data.  If I had to fill memory
with an application I'd probably have to get a machine that allowed me
to add enough memory to do the job (I can't afford my dream machine, but
that's what others have done.)

When I say subset of data, that doesn't mean I'm not processing all of it.
It just means I try do deal with it in managable chunks.

It sounds to me like you really don't have a string issue.  The issue seems
to be more about what algoritms your choosing.  If you are a bit more
detailed in your description, perhaps someone will have some ideas.

Best to ya.