Parsing html / server

Bringing the internet highway into your project? Building FTP, HTTP, email, chat or other client solutions?

Moderators: FourthWorld, heatherlaine, Klaus, kevinmiller, robinmiller

Post Reply
kbirand
Posts: 15
Joined: Tue Oct 30, 2012 1:28 am

Parsing html / server

Post by kbirand » Sun Nov 25, 2012 3:48 am

I have been parsing whatismyipaddress.com with

put url("http://whatismyipaddress.com/ip/8.8.8.8") into aaa

and some lines of code which parse the result
successfully but after a while I started to get:
Too many queries<BR> You appear to be an automated script. Site terms and conditions do not allow for automated/script access.
Please wait one hour before coming back to the site.
For API details see http://whatismyipaddress.com/api
But when I open the link with my safari everything seems to work
But with livecode I keep getting the same response.

So i assume the page that i am accessing is doing some kind of header check.

Is there a way to send data as SAFARI or some other browser.

Thanks,
Koray Birand

shaosean
Posts: 906
Joined: Thu Nov 04, 2010 7:53 am

Re: Parsing html / server

Post by shaosean » Sun Nov 25, 2012 6:27 am

Please do not attempt to obtain the IP address by querying the homepage of our website.
We provide a specific page that returns just the IP address of the device making the request on http://bot.whatismyipaddress.com. You are free to query that server but please limit queries to no more than once per five minutes. While rate limiting is currently not in place if the service is abused it will be.
Plus the data returned on the http://bot.whatismyipaddress.com address is simply plain text with the IP address and no need to parse out the HTML..

kbirand
Posts: 15
Joined: Tue Oct 30, 2012 1:28 am

Re: Parsing html / server

Post by kbirand » Sun Nov 25, 2012 12:33 pm

shaosean wrote:
Please do not attempt to obtain the IP address by querying the homepage of our website.
We provide a specific page that returns just the IP address of the device making the request on http://bot.whatismyipaddress.com. You are free to query that server but please limit queries to no more than once per five minutes. While rate limiting is currently not in place if the service is abused it will be.
Plus the data returned on the http://bot.whatismyipaddress.com address is simply plain text with the IP address and no need to parse out the HTML..
Shaosean,

Thank you for your suggestion, but that was not my question, I already know that.
I am not querying my own ip, Instead I want to query different ip's to get their location data.

Thanks,
Koray Birand

shaosean
Posts: 906
Joined: Thu Nov 04, 2010 7:53 am

Re: Parsing html / server

Post by shaosean » Sun Nov 25, 2012 2:59 pm

Sorry, I thought you were writing software to get the IP address when the software was running on a client machine.. But the first part of message still holds true, they do not want you to hammer their website with queries.. In regards to the question you asked, you can set the headers used by libURL and pass along whatever data you would like (so you can even make your software claim to be Safari)

http://docs.runrev.com/Command/libURLSe ... TTPHeaders

jacque
VIP Livecode Opensource Backer
VIP Livecode Opensource Backer
Posts: 7389
Joined: Sat Apr 08, 2006 8:31 pm
Contact:

Re: Parsing html / server

Post by jacque » Sun Nov 25, 2012 6:53 pm

IP to Country conversions at the late Mark Smith's web archive: http://marksmith.on-rev.com/revstuff/

He left us a rich legacy before he passed away.
Jacqueline Landman Gay | jacque at hyperactivesw dot com
HyperActive Software | http://www.hyperactivesw.com

Post Reply