Web Scraping

Bringing the internet highway into your project? Building FTP, HTTP, email, chat or other client solutions?

Moderators: Klaus, FourthWorld, heatherlaine, kevinmiller, robinmiller

Post Reply
Not a lot of thought
Posts: 77
Joined: Thu May 21, 2015 2:41 am

Web Scraping

Post by Not a lot of thought » Thu Dec 08, 2016 4:07 pm

I'm working on a project and would like to incorporate automated web scraping capabilities based on certain triggers to compile information on certain topics from the web. I've not been able to find any web scraping applications that incorporate livecode. Does anyone have any suggestions? I mean can i just point to a search engine and insert the text and hit search from a virtual browser? Just curious.

FourthWorld
VIP Livecode Opensource Backer
VIP Livecode Opensource Backer
Posts: 7930
Joined: Sat Apr 08, 2006 7:05 am
Location: Los Angeles
Contact:

Re: Web Scraping

Post by FourthWorld » Thu Dec 08, 2016 4:50 pm

Richard Gaskin
Community volunteer LiveCode Community Liaison

LiveCode development, training, and consulting services: Fourth World Systems: http://FourthWorld.com
LiveCode User Group on Facebook : http://FaceBook.com/groups/LiveCodeUsers/

diegoranan
Posts: 1
Joined: Fri Jun 07, 2019 5:53 am
Location: Mississauga
Contact:

Re: Web Scraping

Post by diegoranan » Fri Jun 07, 2019 5:56 am

Thanks, FourthWorld, for sharing these helpful links with us.

greymatter[dot]ca

mrcoollion
Posts: 571
Joined: Thu Sep 11, 2014 1:49 pm
Location: The Netherlands

Re: Web Scraping

Post by mrcoollion » Fri Jun 07, 2019 9:14 am

Here are some opensource options that might be helpful..

https://blog.testproject.io/2016/12/22/ ... lications/
https://www.scrapehero.com/open-source- ... and-tools/

I have used Sikuli now SikuliX for some fun projects (auto roulette) and it works fine. It also has an APi and is Java based so I think livecode and sikuliX should be able to work together ?
http://sikulix.com/

Hope to have been of some help...

regards,

Post Reply

Return to “Internet”