Threaded Python Program
So I wrote my first threaded python program.
I'd written the entire 350 line python script in a messy procedural style, so I spent about 5 hours rewriting the whole thing as tidy object-oriented code with all the logic packed away into methods. After that was done, getting it to play nicely with threads was a cinch.
The scraping is now running about 460% faster, so that's a win for threaded design. I should be able to do each pass in an afternoon, rather than 2 whole days.
Now I can say I know how to write threaded python code.
10 October 2022