Page 1 of 1

copying files from a html server

Posted: Thu Mar 31, 2011 7:07 pm
by adventuresofgreg
Hi: I'm trying to find the fastest way to COPY a whole whack of ".csv.gz" files from a URL to my hard drive.

I am able to extract the list of the file URL's, but I don't want to read each file into memory, then write it to a new file on my harddrive - that will take too long. Is there a way to simply copy the file?

Thanks!
Greg

Re: copying files from a html server

Posted: Thu Mar 31, 2011 7:43 pm
by Klaus
Hi Greg,

doesn't "libUrlDownloadToFile" work for you?
This is non-blocking and does not read the whole file into memory like "load" does".


Best

Klaus

Re: copying files from a html server

Posted: Thu Mar 31, 2011 8:11 pm
by adventuresofgreg
yep - works GREAT! thanks.