Need a scriptable web browser [badly]

mc_bluebeard

Hi,

I need to interact with a fairly complicated website
many thousands of times over and I'd like to accomplish
this via a script.

My first thought was to do it by hand once using

BlackEdder · Posted: Thu Feb 17, 2005 10:38 pm Post subject:

I think both perl and ruby (and python) have modules that let you easily interact with webpages. I would try something along that route.

alkan · Posted: Thu Feb 17, 2005 10:39 pm Post subject:

me too need a scriptable browser. Any suggestions?
Sorry hijacking your thread.

msalerno · Posted: Thu Feb 17, 2005 10:40 pm Post subject:

Smells fishy!

You don't explain what it is you are trying to do very well.

I would use libwww-perl

davey_freeman@yahoo.com · n00b Joined: 16 Jan 2005 Posts: 34

alkan · Posted: Fri Feb 18, 2005 12:52 am Post subject:

I've looked into libwww but not libwww-perl. I've written something in C# (.NET) that is working fine, But it requires recompiliation of the program everytime I wish to change something. There must be a easier way. I didn't want to go through libwww since it will also require recompilation of the c program for changes.

libwww-perl. It looks like what i just need.

What I am trying to do is well intended. This program running on the background will logon to a web page and navigate to a sub page. Then it will monitor that page for any changes. If it sees a predefined pattern it will clik on a button on that page and notify the user by e-mail.

mc_bluebeard · Posted: Fri Feb 18, 2005 1:00 am Post subject:

Well, the python urllib seems to work fairly well for me.
However, nothing works quite as well as lynx, which I've
had great success with.

Actually, since I last posted, I started working on this
again and figured out that many 'bugs' I was encountering
would go away if I told lynx to use a userAgent string
corresponding to internet destroyer.

So -- it was the website I was playing with and not lynx.
Ah, good old lynx.

Anyway, saving the lynx output via the cmd_log flag and
then loading it via cmd_script is hilarious --- the web pages
*fly* by. It truly is funny.

Ah.....
_________________
I do not belong on this mission and I want to return to earth.

alkan · Posted: Fri Feb 18, 2005 9:25 am Post subject:

thanks msalerno and davey_freeman@yahoo.com. LWP is exteremely easy and works very nice. Whole thing took 15 lines of code.

alexkoval · n00b Joined: 18 Feb 2005 Posts: 4 Location: Ukraine

Hi

software testing tool "maxq" (http://maxq.tigris.org) could be used.

very easy to record & run the script.

Alex