LiveCode Forums

Agree with that. Here's the bit of genius that I really liked: repeat for each item N in "7,9,13,14,15,16,18,23,24" put (item N of tLine) + (item N of tProc) into item N of tProc end repeat So instead of my clunky checking every little bit, do it in one swoop. There's a lot of arrays going on as wel...

I think it may be solved! Thierry dropped me a PM and took a look, and he only blummin' well got it down to 30 seconds!!! Rather than me just pile in here with the source, I'm going to look at it, digest it and understand it. It's also highlighted some other areas where I need to be altering my data...

Hmmmmmm, I'm going to have to take a look on a bigger screen, I must be code blind!

Yes, you're right, however they're actually very rarely used in the data. For example, in the whole dataset there are probably only 100 or so with no email, so that little bit of the routine wouldn't get called very often. Also, there are actually only about 1000 dupes in my data, so again, that rou...

Right, finally generated some dummy data with dupes. Taken hours, but helped me with the debugging process a lot. I discovered I hadn't converted all my fields to variables. Anyway, the data dump is here : https://www.dropbox.com/s/83eoycq83hjw3tg/dummydata.csv?dl=0 That's generated with some online...

AxWald wrote:Hi,

Cannot help but thinking that this is something where a database would be the most suitable tool. SQLite, for instance, may make your life a lot more comfortable.

That's not a bad idea actually! Anyway, just generating lots of lovely dummy data to test it with.

Well, lockscreen sped it up some more, however it still comes up as not responding and appears to have crashed when I move focus to another window, which is odd. There are actually 56,000 rows in there, I guess whatever I do it's going to be slow as the routine that checks for duplicates is going to...

Interesting article. I'm using everything there except lock screen. It's a lot faster now I'm using variables, I get it to update the counter every 500 lines now because I'm processing the full 50K. However, it still freezes after a while, the window says "not responding" and only updates when it's ...

Oh yeah, that's quicker, much quicker.

Cheers buddy!

Ah, OK, variables then, I get you. I just noticed by the way that the counter stops when I take focus away from the stack to go do something else. Field names: Yes, they're numbers. I'm a writer by trade so I automatically write numbers under 20 verbose! Bad habit for coding, I know! So using a coun...

I've got a text file with 50,000 rows in it all comma delimited. It's a list of people who have visited salons and who may have had various treatments, picked up loyalty cards etc. So, for example, it could have lines like this: Name, Loyalty Card, Wax Treatment, EyeBrow treatment, email Jane, 1,2,1...

Hi. Try this. I hope you see which fields are which. on mouseUp put fld "masterList" into masterList put fld "fieldToCheck" into fieldToCheck repeat for each line tLine in masterList if tLine is not among the lines of fieldToCheck then put tLine & return after fld "missingLines" end repeat end mous...

OK, I found the 'Not found' bit in the docs, however the find starts from the last found, so I've got this: on mouseUp repeat for each line tLine in field one find string item one of tLine in field two if the result is "Not found" then put tLine & CR after field three end repeat end mouseUp However ...

I've got two fields each one has a list of product codes in them, but the second one has fewer codes. What I'm trying to do is check to see if each product from the first field is in the second field. If it's not, pop the code into a third field. Sounds easy, but I'm baffled. The find command just p...

You guys are amazing, thanks!

I use LiveCode only occasionally to manipulate data but each time I learn something new, great to know there's such a community around here.