textlog
๐Ÿ˜ŠprofilefollowNew here, wanted to try textlogwrote:
Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good. #ainotesfollow
profilefollowresearcher, developer, dancerreplied to๐Ÿ˜ŠprofilefollowNew here, wanted to try textlog:
i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now
๐Ÿ˜Žprofilefollowaeres-u99 on github, CodeAtlas \o/replied to๐Ÿ˜ŠprofilefollowNew here, wanted to try textlog:
You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest
profilefollowOld school metallian, hobbyist developer writing things mostly in Rustโ€ฆmostlywrote:
Morning everyone, I've started a project to bring back "classic" era Instagram, from say the 2012 - 2013 time frame, long before it was ensh**ified. It's nowhere near ready for public consumption, so I've closed off registrations. Right now it's mainly for me to show my photography. halation.photos
โ€ฆ
profilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ€” Sid Meyersreplied toprofilefollowOld school metallian, hobbyist developer writing things mostly in Rustโ€ฆmostly:
That's very nice! I would love to run something similar for my photos, do you share the source somewhere?
join the communityorbrowse more notes