Web Scraping

Not a lot of thought · Post by **Not a lot of thought** » Thu Dec 08, 2016 4:07 pm

I'm working on a project and would like to incorporate automated web scraping capabilities based on certain triggers to compile information on certain topics from the web. I've not been able to find any web scraping applications that incorporate livecode. Does anyone have any suggestions? I mean can i just point to a search engine and insert the text and hit search from a virtual browser? Just curious.

FourthWorld · Post by **FourthWorld** » Thu Dec 08, 2016 4:50 pm

These threads may help:

http://forums.livecode.com/viewtopic.php?f=7&t=27805
http://forums.livecode.com/viewtopic.php?f=11&t=7462

diegoranan · Post by **diegoranan** » Fri Jun 07, 2019 5:56 am

Thanks, FourthWorld, for sharing these helpful links with us.

greymatter[dot]ca

mrcoollion · Post by **mrcoollion** » Fri Jun 07, 2019 9:14 am

Here are some opensource options that might be helpful..

https://blog.testproject.io/2016/12/22/ ... lications/
https://www.scrapehero.com/open-source- ... and-tools/

I have used Sikuli now SikuliX for some fun projects (auto roulette) and it works fine. It also has an APi and is Java based so I think livecode and sikuliX should be able to work together ?
http://sikulix.com/

Hope to have been of some help...

regards,

LiveCode Forums

Web Scraping

Web Scraping

Re: Web Scraping

Re: Web Scraping

Re: Web Scraping