Search found 144 matches

by Andycal
Thu Aug 20, 2015 5:30 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Agree with that. Here's the bit of genius that I really liked: repeat for each item N in "7,9,13,14,15,16,18,23,24" put (item N of tLine) + (item N of tProc) into item N of tProc end repeat So instead of my clunky checking every little bit, do it in one swoop. There's a lot of arrays going on as wel...
by Andycal
Thu Aug 20, 2015 4:49 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

I think it may be solved! Thierry dropped me a PM and took a look, and he only blummin' well got it down to 30 seconds!!! Rather than me just pile in here with the source, I'm going to look at it, digest it and understand it. It's also highlighted some other areas where I need to be altering my data...
by Andycal
Thu Aug 20, 2015 1:15 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Hmmmmmm, I'm going to have to take a look on a bigger screen, I must be code blind!
by Andycal
Thu Aug 20, 2015 12:59 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Yes, you're right, however they're actually very rarely used in the data. For example, in the whole dataset there are probably only 100 or so with no email, so that little bit of the routine wouldn't get called very often. Also, there are actually only about 1000 dupes in my data, so again, that rou...
by Andycal
Thu Aug 20, 2015 11:24 am
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Right, finally generated some dummy data with dupes. Taken hours, but helped me with the debugging process a lot. I discovered I hadn't converted all my fields to variables. Anyway, the data dump is here : https://www.dropbox.com/s/83eoycq83hjw3tg/dummydata.csv?dl=0 That's generated with some online...
by Andycal
Thu Aug 20, 2015 8:32 am
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

AxWald wrote:Hi,

Cannot help but thinking that this is something where a database would be the most suitable tool. SQLite, for instance, may make your life a lot more comfortable.
That's not a bad idea actually! Anyway, just generating lots of lovely dummy data to test it with.
by Andycal
Wed Aug 19, 2015 7:31 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Well, lockscreen sped it up some more, however it still comes up as not responding and appears to have crashed when I move focus to another window, which is odd. There are actually 56,000 rows in there, I guess whatever I do it's going to be slow as the routine that checks for duplicates is going to...
by Andycal
Wed Aug 19, 2015 6:34 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Interesting article. I'm using everything there except lock screen. It's a lot faster now I'm using variables, I get it to update the counter every 500 lines now because I'm processing the full 50K. However, it still freezes after a while, the window says "not responding" and only updates when it's ...
by Andycal
Wed Aug 19, 2015 5:03 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Oh yeah, that's quicker, much quicker.

Cheers buddy!
by Andycal
Wed Aug 19, 2015 4:39 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Re: Manipulating large text file stalling

Ah, OK, variables then, I get you. I just noticed by the way that the counter stops when I take focus away from the stack to go do something else. Field names: Yes, they're numbers. I'm a writer by trade so I automatically write numbers under 20 verbose! Bad habit for coding, I know! So using a coun...
by Andycal
Wed Aug 19, 2015 4:14 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Manipulating large text file stalling
Replies: 26
Views: 4309

Manipulating large text file stalling

I've got a text file with 50,000 rows in it all comma delimited. It's a list of people who have visited salons and who may have had various treatments, picked up loyalty cards etc. So, for example, it could have lines like this: Name, Loyalty Card, Wax Treatment, EyeBrow treatment, email Jane, 1,2,1...
by Andycal
Thu Feb 07, 2013 2:58 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: comparing two fields
Replies: 4
Views: 1086

Re: comparing two fields

Hi. Try this. I hope you see which fields are which. on mouseUp put fld "masterList" into masterList put fld "fieldToCheck" into fieldToCheck repeat for each line tLine in masterList if tLine is not among the lines of fieldToCheck then put tLine & return after fld "missingLines" end repeat end mous...
by Andycal
Thu Feb 07, 2013 2:36 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: comparing two fields
Replies: 4
Views: 1086

Re: comparing two fields

OK, I found the 'Not found' bit in the docs, however the find starts from the last found, so I've got this: on mouseUp repeat for each line tLine in field one find string item one of tLine in field two if the result is "Not found" then put tLine & CR after field three end repeat end mouseUp However ...
by Andycal
Thu Feb 07, 2013 2:20 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: comparing two fields
Replies: 4
Views: 1086

comparing two fields

I've got two fields each one has a list of product codes in them, but the second one has fewer codes. What I'm trying to do is check to see if each product from the first field is in the second field. If it's not, pop the code into a third field. Sounds easy, but I'm baffled. The find command just p...
by Andycal
Tue Jan 31, 2012 5:45 pm
Forum: Getting Started with LiveCode - Complete Beginners
Topic: Finding a whole line
Replies: 5
Views: 1068

Re: Finding a whole line

You guys are amazing, thanks!

I use LiveCode only occasionally to manipulate data but each time I learn something new, great to know there's such a community around here.

Go to advanced search