A credit union wants to get their own data out of a vendor's online system. Vendor wants $160,000. I wrote a #pythonnotesfollow script with #Playwrightnotesfollow to download the data just as though a user would. It's going to run for about 6 weeks to download around 250k records and 70GB of images.
you could split to buckets like alphanumerically and parallelize it if you don't want to wait that long. Probably need to launch a few instances but still cheaper lol.
The slowness is intentional. I wanted to make it look more like a user doing it than a script so it doesn't set off any alarms. I have it waiting from 1 to 3 seconds between clicks to slow it down. :-) So far so good!
almost done beating fear and hunger.... so hard!!!
@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
@archivist_eyes๐profilefollowYour mind is also supposed to create happiness, not just to receive it. You're supposed to find solutions, to invent, to imagine, to remember, to love. This much we always forget.replied to@ku๐คprofilefollowHai I am ku:
Same here! Though I don't even remember which r/ brought me here.
@ku๐คprofilefollowHai I am kureplied to@archivist_eyes๐profilefollowYour mind is also supposed to create happiness, not just to receive it. You're supposed to find solutions, to invent, to imagine, to remember, to love. This much we always forget.:
Turned Stepper (self-hosted AWS StepFunctions) into client-server. Server hosts state machines, clients poll for tasks. New resources about running #claudenotesfollow. claude -p works, now thinking if I need interactive session management.
Inspired by two projects of github:schildep I start to explore what can be expressed in Lean and make coding agents implement and prove the implementation at the same time.