Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good. #ainotesfollow
i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now
You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest
TPMS indicator came on,
which means an unplanned Costco trip ๐
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@amyprofilefollowa work in progress; i love cats ๐ฑ:
Just check, and top off as needed, the tyres pressure. Run it for a few miles. If it doesnโt go away, then take that trip.
@amyprofilefollowa work in progress; i love cats ๐ฑreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
No gas station near me has nitrogen so it had to be Costco. I topped off air and also filled gas while I was there. Itโs only 5 miles from me, so overall not bad.
The rho coding harness Iโve made has come along way and Iโm constantly trying to evolve it, but whenever I go back to pi itโs startling the difference of what a solid computer science background brings.
Trying tsoding/tatr idea for task tracking in the project. Instead of his C implementation asked CC to implement tatr.el. I do similar thing with vulpea, even my org notes have timestamp ids. Tatr tasks live in the repo, which is good.
When I stopped having a job I completely lost interest of huge portion of things I used to have interest before. I could connect all of that to consumerism. And I haven't gained any of that interest back.
I quit knowing I am financially ok. (I was likely burnt out, had to leave a place I greatly loved but I still left). I still can't exactly explain this.
Sounds like it was a gut feeling, I hope it works out for you, and in the meantime, you discover new passions. But I understand, unemployment leads to feelings of apathy.
I've been working with physical AI - Letting LLMs control robots in a warehouse to collaborate and collectively come up with a physically correct solution to carry out a natural language intent. We had to study the reactive nature of agents, nudges they required, etc.
haha that's a coincidence. Site looks awesome. The moving away from ROS2 part is so true. One of our main potential customers for physical AI solutions (a telecom provider in JP) communicated the need for agents to be able to pick up controls from any vendor
I apologize if that sounded obvious/non-obvious/amateurish haha. I was an intern and worked more on the agentic side of things, it was just a non-primary experiment