Re: Question About Web Site Speed
On 13 Jul 2005, at 15:40, Robert Craig wrote:
>
>
> posted by: Robert Craig <rds at RapidEuphoria.com>
>
> cklester wrote:
> > Robert Craig wrote:
> > >
> > > php is a typical interpreter that's much slower than Euphoria.
> > > It couldn't handle the EUforum search for example, without
> > > people screaming.
> >
> > With an index, it would probably work fine. Or see here:
>
> I do a bit of indexing. For example if you specify the "posted by"
> field, I can give you your results almost instantly.
>
> However, there are no limits on the strings you can search for and
> quite often it's necessary to actually read every line of
> all 70,000 messages (over 100MB). I suspect no one
> would try that with pure PHP.
Looks like some people are wearing blinders 24-7. I indexed a couple of db,
one of 3.3 gigabytes (626,769 files), and one of 10.1 gigabytes (1,005,239
files).
I add some 500+ new files per day with one app (averaging about 750K bytes
per day), and 5,800 files with another app (averaging 15 megabytes per day).
And there's other apps running too, but are comparatively slower adding
things. The files are munged before saving, and duplicates are not added. No
problem indexing more than the "posted by" field here, i index ALL the words
by filename and count and frequency/file and global frequency. And the neat
thing is, a search is instant, and i don't need to load even ONE megabyte
into memory.
Perhaps the problem with using Eu as a web server database isn't with that
per se, it's more with loading a 100megabyte db in Eu (making it 400megs
for lack of a string type) each time someone does a search can quickly run
out of memory on any reasonable (/ly priced) server shell. And doing gets()
on a brute force search of a 100 meg file (RobC said his program does that!?)
takes too long. But what do i know, i play with a 14 gigabyte database and
want "goto" and string types added to Eu.
Kat
|
Not Categorized, Please Help
|
|
