Page 1 of 1
Web Scraping
Posted: Thu Dec 08, 2016 4:07 pm
by Not a lot of thought
I'm working on a project and would like to incorporate automated web scraping capabilities based on certain triggers to compile information on certain topics from the web. I've not been able to find any web scraping applications that incorporate livecode. Does anyone have any suggestions? I mean can i just point to a search engine and insert the text and hit search from a virtual browser? Just curious.
Re: Web Scraping
Posted: Thu Dec 08, 2016 4:50 pm
by FourthWorld
Re: Web Scraping
Posted: Fri Jun 07, 2019 5:56 am
by diegoranan
Thanks, FourthWorld, for sharing these helpful links with us.
greymatter[dot]ca
Re: Web Scraping
Posted: Fri Jun 07, 2019 9:14 am
by mrcoollion
Here are some opensource options that might be helpful..
https://blog.testproject.io/2016/12/22/ ... lications/
https://www.scrapehero.com/open-source- ... and-tools/
I have used Sikuli now SikuliX for some fun projects (auto roulette) and it works fine. It also has an APi and is Java based so I think livecode and sikuliX should be able to work together ?
http://sikulix.com/
Hope to have been of some help...
regards,