I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
Any conversation
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
โ โ โ โ โ โ โ โ โ โ โ โ โ โ โขโฃโฃโ โ โข โ โขนโขณโขโ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ โ
โ โ โ โ โ โ โ โ โ โ โกคโ โกโ โฃตโ โ โ โกโขธโ โขธโ โกโ โ โ โ โ โขโกดโ โ โกงโฃโฃโกโ โ โ โ โ โ โ โ โ โ โ
โ โ โ โ โ โ โ โ โ โกฐโ โ โขฐโ โ โกโ โ โขฐโ โกโ โกโกโกโ โ โ โกฐโกฑโกโ โกโ โกโ โขโ โ โ คโกโ โ โ โ โ โ โ
โ โ โ โ โ โ โขโกโขโ โขโ โ โขโ โ ธโกโ โ โกโกโ โกโ โกโ โ โกฐโขกโกฑโ โกโขโ โขโขดโ โ โ โ โฃโกโกโ โ โ โ โ
โ โ โ โ โ โ โกโ โ นโฃฆโ โขโ โ โกโ โ ฑโ โ โขฐโขโ โขโขธโกโ โข โขโขงโ โกฐโขโ โข โกพโ โ โ โก โ โก โ โ โฃโ โ โ
&
หข แต แต แถ โฑ โฟ แต ~ ELDER FUTHARK:
แ แข แฆ แจ แฑ แฒ แท แน
แบ แพ แ แ แ แ แ แ
แ แ แ แ แ แ แ แ
โฆ
Microservices.
Not really programming, as this is more on the architectural level.
Microservices is a valid approach when you need to address massive scale. The thing is, I have seen it applied to things that could realistically serve its audience in a handful of modest servers with a less fashionable approach.
It was done under the guise of simplification; each individual microservice was in fact very small. But this at the cost of absolute spaghetti architecture.
Overvalued, maybe. Extremely valuable, yes, though.
For sure. We're well past the point of being able to reasonably claim that the tools have no practical use.
But I share the article's skepticism that LLM-based AI will "produce a fully automated drop-in replacement for most knowledge workers". Which it at this point has to in order to justify these companies' stupendous valuations.
Tomorrow no but there will always be the โhopeโ which is enough for the next 20 years before giving up. Which meanwhile would be replacing larger and larger chunks of the workforce so it wonโt really matter, weโll be adjusting our lives around it as well so we meet in the middle.
Tesla has been overvalued for over a decade with the promise of โfully autonomous carsโ and itโs still not losing its value, despite not meeting that (and probably never will, as the computation necessary to achieve it is bounded by physics).
Today I wanted to share some Music from my youth :)
www.youtube.com/watch?v=8Hn-pNxtByM
I hate it when I donโt remember if I took my midday pill or not. Not that it matters a lot, but still, annoying. I have notifications set up but I discard them by habit because they are exact times and my sleep pattern fluctuates.
โฆ
@drewfishprofilefollow
retired programmer, new DM, learning Scottish Gaelicreplied to@stagas๐คธprofilefollow
creative technologist
creator of textlog:
retired programmer, new DM, learning Scottish Gaelicreplied to@stagas๐คธprofilefollowcreative technologist
creator of textlog:I once saw someone flip their pill bottle upside down after taking a pill. Not sure it'd help me, because I suspect that somehow I'd still only pay half-attention when taking pills and so still get forgetful and confused :shrug:
@stagas๐คธprofilefollowcreative technologist
creator of textlogreplied to@drewfishprofilefollowretired programmer, new DM, learning Scottish Gaelic:
creative technologist
creator of textlogreplied to@drewfishprofilefollowretired programmer, new DM, learning Scottish Gaelic:It actually works!