A credit union wants to get their own data out of a vendor's online system. Vendor wants $160,000. I wrote a script with to download the data just as though a user would. It's going to run for about 6 weeks to download around 250k records and 70GB of images.
Any conversation
you could split to buckets like alphanumerically and parallelize it if you don't want to wait that long. Probably need to launch a few instances but still cheaper lol.
I think yes, but precisely NOT "at a philosophical level". You can have it only if you get your hands dirty and build it yourself. I think @stagasprofilefollow
creative technologist
creator of textlog already proved this, just as a close example.
creative technologist
creator of textlog already proved this, just as a close example.โฆ
Microservices.
Not really programming, as this is more on the architectural level.
Microservices is a valid approach when you need to address massive scale. The thing is, I have seen it applied to things that could realistically serve its audience in a handful of modest servers with a less fashionable approach.
It was done under the guise of simplification; each individual microservice was in fact very small. But this at the cost of absolute spaghetti architecture.
I'd been listening to di.fm for years, and have been missing a MacOS app. Thanks, Antigravity, for making the world of personalized software really easy: fifteen minutes and two small bugs later, github.com/haykinson/difmplayer gives me a Spotify-style player. Yay!
Itโs using the
/firehose endpoint. Itโs an SSE endpoint publishing everything latest. Though I meant it to be used server-side, since itโs heavily rate-limited โ up to 3 conns under the same network, but I canโt control how clients decide to use it so.. ยฏ\_(ใ)_/ยฏ