1. on multitasking, tcp4u, etc
- Posted by gertie at ad-tek.net
Jun 05, 2001
Hey all net addicts,
Has anyone tried using tcp4u to access several urls/ip#'s at the same time? When
it
rains this afternoon, i may come inside and try it, and wanted to know if you
have
discovered any problems with it.
Right now, i have 8 Eu apps running, as they have for the last 6 weeks,
collecting data
from the web. Each app has one url at a time to mine. I have a feeling this is
eating up
excessive OS resources that i could be doing other things with (like run even
more Eu
code, mostly). What i'd like to do is use *one* Eu application, and have *one*
"include
tcp4u.ew", *one* gui display of what it's doing, and have it simultaneously
access all
the sites on the list (i can limit the list to the current 8, but i do NOT wish
to limit the
connections to one at a time). Any ideas?
I have had a few requests to serve data, and the volume required will mean i
cannot be
limited to a single tcp connection, and may mean i cannot be limited to a single
isp
either. There are two problems with doing things the way i am now:
1) OS resource use is up, reboots are more often as a result. This is
unacceptable,
especially since i can't seem to get Eu to watch windoze's resource usage, and
warn
me a reboot is needed.
2) linking the running "threads" together is going to get really cumbersome,
especially
if i haveto spread the work across both puters, connected to two different isps
(to get
what passes as reliability here, and to get up to 20K connection speed total).
Thanks,
Kat
2. Re: on multitasking, tcp4u, etc
Hi Kat,
I had a quick look through the Tcp4u doco and couldn't find any reference to
running
multi threads using the tcp4u. The best bet would be to double check my bad
late
night reading and read the tcp4u doco then if unsure contact the author.
I guess you'd only persue this if you wanted to use C ... as Euphoria is
single threaded,
and unless I'm completely mistaken will remain this way for at least a long
period of
time. I don't know if it would be possible to create a "multi threaded TCP
server
engine" - possibly using Tcp4u if the author confirmed it was mutli-threaded
"aware".
Can DLL's execute multi threads? I'm not really sure ... these questions
and my pie
in the sky solutions are far beyond my knowledge!
I know I shouldn't .... but have you considered using something like Python
for your
web development? I think I can recall reading an article about the old
www.onelist.com mailing list that was written using Python and was
processing
millions (well hundreds of thousands anyway!) of messages daily on a P300
with
256MB Ram. I think from memory it was processing multi transactions per
second
(on average) through the entire day ... just in case your interested
www.python.org
I haven't used Python for more than just a hello world but it has a *LOT* of
support
and many many library developers, it's open source and has commercial
backing!
Sorry for the Pythin rant.
Ray Smith.
>
> Hey all net addicts,
>
> Has anyone tried using tcp4u to access several urls/ip#'s at the same
time? When it
> rains this afternoon, i may come inside and try it, and wanted to know if
you have
> discovered any problems with it.
>
> Right now, i have 8 Eu apps running, as they have for the last 6 weeks,
collecting data
> from the web. Each app has one url at a time to mine. I have a feeling
this is eating up
> excessive OS resources that i could be doing other things with (like run
even more Eu
> code, mostly). What i'd like to do is use *one* Eu application, and have
*one* "include
> tcp4u.ew", *one* gui display of what it's doing, and have it
simultaneously access all
> the sites on the list (i can limit the list to the current 8, but i do NOT
wish to limit the
> connections to one at a time). Any ideas?
>
> I have had a few requests to serve data, and the volume required will mean
i cannot be
> limited to a single tcp connection, and may mean i cannot be limited to a
single isp
> either. There are two problems with doing things the way i am now:
>
> 1) OS resource use is up, reboots are more often as a result. This is
unacceptable,
> especially since i can't seem to get Eu to watch windoze's resource usage,
and warn
> me a reboot is needed.
>
> 2) linking the running "threads" together is going to get really
cumbersome, especially
> if i haveto spread the work across both puters, connected to two different
isps (to get
> what passes as reliability here, and to get up to 20K connection speed
total).
>
> Thanks,
>
> Kat
>
>
>
3. Re: on multitasking, tcp4u, etc
> Hey all net addicts,
>
> Has anyone tried using tcp4u to access several urls/ip#'s at the same time?
> When it
> rains this afternoon, i may come inside and try it, and wanted to know if you
> have
> discovered any problems with it.
>
> Right now, i have 8 Eu apps running, as they have for the last 6 weeks,
> collecting data
> from the web. Each app has one url at a time to mine. I have a feeling this is
> eating up
> excessive OS resources that i could be doing other things with (like run even
> more Eu
> code, mostly). What i'd like to do is use *one* Eu application, and have *one*
> "include
> tcp4u.ew", *one* gui display of what it's doing, and have it simultaneously
> access all
> the sites on the list (i can limit the list to the current 8, but i do NOT
> wish to limit the
> connections to one at a time). Any ideas?
>
> I have had a few requests to serve data, and the volume required will mean i
> cannot be
> limited to a single tcp connection, and may mean i cannot be limited to a
> single isp
> either. There are two problems with doing things the way i am now:
>
> 1) OS resource use is up, reboots are more often as a result. This is
> unacceptable,
> especially since i can't seem to get Eu to watch windoze's resource usage, and
> warn
> me a reboot is needed.
>
> 2) linking the running "threads" together is going to get really cumbersome,
> especially
> if i haveto spread the work across both puters, connected to two different
> isps (to get
> what passes as reliability here, and to get up to 20K connection speed total).
>
> Thanks,
>
> Kat
Have you tried using asynchronous winsock functions? For my Jabber
client I'm using the asynchronous functions from the version of
winsock.ew included with Hawke's EUServer (SRVSCKIP.EW) and it's
working very well :)
Thomas Parslow (PatRat) ICQ #:26359483
Rat Software
http://www.rat-software.com/
Please leave quoted text in place when replying
4. Re: on multitasking, tcp4u, etc
I though it was possible to do something like:
procedure main()
some_var = get_info_from_1_server()
other_var = get_data_from_other_server()
-- and keep doing this...
end procedure
Isn't that possible?
Best Regards,
Guillermo Bonvehí
--- gertie at ad-tek.net wrote:
>
>
> Hey all net addicts,
>
> Has anyone tried using tcp4u to access several urls/ip#'s at the same
> time? When it
> rains this afternoon, i may come inside and try it, and wanted to
> know if you have
> discovered any problems with it.
>
> Right now, i have 8 Eu apps running, as they have for the last 6
> weeks, collecting data
> from the web. Each app has one url at a time to mine. I have a
> feeling this is eating up
> excessive OS resources that i could be doing other things with (like
> run even more Eu
> code, mostly). What i'd like to do is use *one* Eu application, and
> have *one* "include
> tcp4u.ew", *one* gui display of what it's doing, and have it
> simultaneously access all
> the sites on the list (i can limit the list to the current 8, but i
> do NOT wish to limit the
> connections to one at a time). Any ideas?
>
> I have had a few requests to serve data, and the volume required will
> mean i cannot be
> limited to a single tcp connection, and may mean i cannot be limited
> to a single isp
> either. There are two problems with doing things the way i am now:
>
> 1) OS resource use is up, reboots are more often as a result. This is
> unacceptable,
> especially since i can't seem to get Eu to watch windoze's resource
> usage, and warn
> me a reboot is needed.
>
> 2) linking the running "threads" together is going to get really
> cumbersome, especially
> if i haveto spread the work across both puters, connected to two
> different isps (to get
> what passes as reliability here, and to get up to 20K connection
> speed total).
>
> Thanks,
>
> Kat
>
>
>
>
5. Re: on multitasking, tcp4u, etc
Hi,
Just written an include file to do asynchronous transfer of HTTP
documents. So that you can have your program do other stuff while the
document downloads or download multiple documents at the same time.
You can get it at http://www.rat-software.com/projects.html (at the
bottom)
Thomas Parslow (PatRat) ICQ #:26359483
Rat Software
http://www.rat-software.com/
Please leave quoted text in place when replying
6. Re: on multitasking, tcp4u, etc
- Posted by gertie at ad-tek.net
Jun 05, 2001
On 5 Jun 2001, at 22:08, Thomas Parslow (PatRat) wrote:
>
> Hi,
> Just written an include file to do asynchronous transfer of HTTP
> documents. So that you can have your program do other stuff while the
> document downloads or download multiple documents at the same time.
>
> You can get it at http://www.rat-software.com/projects.html (at the
> bottom)
But it points to the user archives at RDS!
Kat
7. Re: on multitasking, tcp4u, etc
- Posted by gertie at ad-tek.net
Jun 05, 2001
On 5 Jun 2001, at 22:08, Thomas Parslow (PatRat) wrote:
>
> Hi,
> Just written an include file to do asynchronous transfer of HTTP
> documents. So that you can have your program do other stuff while the
> document downloads or download multiple documents at the same time.
>
> You can get it at http://www.rat-software.com/projects.html (at the
> bottom)
Disregard my previous post, your page uses javascript, and tiggrbox gets into
paranoid
mode when she sees that, and she killed the link to the zip file, thinking it
might be a
js script download out to get her... and i didn't notice she did it.
Kat,
<sheepish look>
