Hello! Is anyone else trying local AI? Im dont know what im…

Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good.

500 chars / 20 lines max · use #hashtags, @mentions and more

😀😃😄😁😆😅😂🤣😊😇🙂🙃😉😌😍🥰😘😋😛😜🤪🤨🧐🤓😎🤩🥳😏😒😞😔😟😕🙁☹️😣😖😫😩🥺😢😭😤😠😡🤬🤯😳🥵🥶😱😨😰😥😓🤗🤔🫣🤭🫢🤫🤥😶😐😑😬🙄😯😦😧😮😲🥱😴🤤😪😵🤐🥴🤢🤮🤧😷🤒🤕🤑🤠😈👿👻💀☠️👽🤖🎃😺😸😹😻😼😽🙀😿😾❤️🧡💛💚💙💜🖤🤍🤎💔❣️💕💞💓💗💖💘💝💟👍👎👌🤌✌️🤞🤟🤘🤙👈👉👆👇☝️✋🤚🖐️🖖👋🤝👏🙌🫶👐🤲🙏✍️💪👀👁️🧠🫀🫁🌱🌿☘️🍀🌸🌺🌻🌞🌙⭐✨⚡🔥🌈☀️☁️❄️☕🍕🍎🎉🎊🎈🎁🎵🎶🎨📚💡✅❌⚠️🚀🌍💻📱🔒🔑

example.com or https://example.com
Regular links: [title](example.com) or [title](https://example.com)
Markdown links: ~text~ or ~~text~~
Strikethrough: *text* or **text**
Bold: _text_ or __text__
Underline: /text/
Italics: > text
Quote: :smile
Emoji autocomplete: 1. first 2. second 3. third
Numbered lists: - first - second - third
Bulleted lists: Name | Status | Count ----- | :----- | ----: notes | ready | 3
Tables: |redacted|
Redacted: `code`
Inline code: ```…```
Code fences: $inline$
Inline LaTeX: $$block$$
Block LaTeX

Which one? #poll First option Second option
PollsUse 2–8 unique options.: Which one? #quiz Wrong answer > Correct answer Explanation revealed after answering
QuizzesMark exactly one of 2–8 unique answers with >. Text after a blank line is revealed after answering.: Visible text #spoiler Hidden text
SpoilersText after #spoiler is hidden until revealed. Aliases: #tldr, #sensitive, #contentwarning, #cw, and #triggerwarning.: Going hiking #map Kallikratis, Crete
MapsShows a map preview for the first location line. Alias: #location.: #flying Heraklion to Berlin
FlightsHover over the itinerary to see a map connecting the airports. The next three words form the itinerary: airport, to (or → or ->), airport. Use single-word airport names or IATA/ICAO codes.: Today #todo [ ] First task [x] Finished task
TodosOnly [ ] and [x] lines become items. Click your items to toggle them.: Run this #exec ```js console.log(6 * 7) ```
Executable codeRuns the next language-tagged code fence and shows its output beneath the note.: Keep this visible #pin
Pinned notesYour latest #pin is shown first on your profile, independently for notes and replies.: No more replies #lock
Locked conversationsPrevents new replies to this note and every reply beneath it.: About textlog #meta
Meta conversationsKeeps this note and its replies out of public discovery feeds. Aliases: #tlog and #textlog.: Continue quietly #whisper
Whisper conversationsKeeps the branch out of all and hot. Participants, mentions, and tag followers can receive it in my feed. It remains public elsewhere.: For @someone and @another #private
Private conversationsOnly the author and mentioned users can read this branch.: Answer before reading #HiddenReplies
Hidden repliesHides all replies until you reply.

moreless

continued:

Its to replace using central ai for basic tasks like text editing, analysis and brainstorming.

replied to:

If you have Mac, you might check out this app: blaizzy.github.io/nativ/

replied to:

i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now

replied to:

You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest

join the communityorbrowse more notes

share with friends