OpenEuphoria

1. http_get behind a proxy

• Posted by papinic Jun 24, 2011
• 2664 views

Hello everybody,

I'm trying to retrive a web page using http_get:

url = "http://www.google.com" 
txt_url = http_get(url) 
 
if atom(txt_url) or length(txt_url) = 0 then 
   error = 1 
end if 

but when I use this at work, I'm behind a proxy server and I get an error.

How can I solve this?

Thanks,

papinic

3. Re: http_get behind a proxy

• Posted by papinic Jul 11, 2011
• 2449 views

up

5. Re: http_get behind a proxy

• Posted by papinic Aug 07, 2011
• 2276 views

Ok, so I tried with wget. The code I am using is:

system("wget -q -O " & "temp.html \"" &  url & "\"", 0) 
return {0, read_file("temp.html")} 

but each call to wget makes a black console screen flash. Is there any way to avoid the black screen?

Also I noticed that http_get (also without proxy) causes my application to stop, without any evidence in ex.err. I am using euphoria 4.0.3.

Thanks.

Papinic

7. Re: http_get behind a proxy

• Posted by useless Aug 10, 2011
• 2214 views

Write a .bat file such as:

set http_proxy=http://ip-number:port-number/ 
c:\wget\wget.exe -k --connect-timeout=60 -nc -PE:\asubdir\ -oE:\log-this4.txt -w60 -Dsomedomain.com  -x --user-agent="Mozilla/3.0" -e robots=off http://somedomain.com/path/filename.html 

sleep(1) 
junk = system_exec(YourBatFileName,2) 

then read the file into your program.

useless

9. Re: http_get behind a proxy

• Posted by jeremy (admin) Aug 29, 2011
• 1997 views

Does anyone understand the internals of how http proxies work that could modify the code to allow http proxy support directly in Euphoria?

Jeremy

11. Re: http_get behind a proxy

• Posted by jeremy (admin) Aug 29, 2011
• 1930 views

OK. So if I understand this right the only thing we would need to do is provide a 3rd option to http_get that is an address of a proxy server and then connect to that IP address (if supplied) and then just pass on the normal GET request? That sounds easy enough, is that the case? I'll code it up and have it ready for 4.1.

Jeremy

13. Re: http_get behind a proxy

• Posted by papinic Sep 01, 2011
• 1897 views

Hi Jeremy,

thank you for your interest in this problem. On Monday I'll be back to work and I'll check your solution.

Papinic

15. Re: http_get behind a proxy

• Posted by jimcbrown (admin) Sep 03, 2011
• 1874 views

Although true at one point in time, I'm pretty sure this is no longer the case, considering that most of the socket library is written in C and additionally that Jeremy rewrote all or most of http.e

17. Re: http_get behind a proxy

• Posted by jeremy (admin) Sep 05, 2011
• 1793 views

My tests with the new library method works with anonymous proxies. I am not sure how to interact with an authenticating proxy. I'll have to do some research.

Jeremy