you can give “unloading some layers to RAM” a try though… that way you can get your hands on the “usable” 31b models. browse around to find some good 31b ones… GL

I didn;t try any 7b ones lately, they may be better fit for 16gb I think. I was able to try the 2b ones as I mentioned (on cpu). they are subpar. like mentioned the usable ones were 31b, I think you need atleast 24gb vram for most models though. maybe someone else can suggest better.

funny I tried the 8B bonsai https://huggingface.co/prism-ml/Bonsai-8B-gguf when loaded it takes ~7GB RAM!! When prompting it stalls my llama.cpp container (I’m running on a weak 4th gen i5)

Interesting thanks!

hey, thanks for your response… yeah that’s what I meant, the 2b models aren’t usable in today’s state, but more practical for everyday use if they work out…

I actually meant the 31b models are useful for my purpose. I don’t do full-on agentic coding, just interactive chat/prompting. Example, I make good use for making linux shell scripts (as I don’t know howto myself). Currently I use qwen3.5-flash via cloud. It’s as good as the frontier models back then if not better…

“more” is not the keyword here… “condensed” is what I’m looking for. I dont think you understand my point

doesn’t that make the situation worse with a busier feed??

is it global trending or personal feed? thanks

I wasn’t even thinking about the interoperable fact, but indeed that is a bonus…

yeah that comparison makes sense

hey! that thing is for domestic chinese??

yeah, but any update failure of a container is less fatal. and only affects the isolated service… it’s way easy to manage this situation than an unbootable server.

okay thank you

I’m getting 1W 433 modules for like $15 now

haha I guess cheap is relative :) I was considering parts at 4 to 5$ range. But i’m talking about low power ble/zigbee etc…

wow didnt’ know that Ebyte modules were that popular! I’ve come across them in site like lcsc and Ali… Making use of them is what my current skill level allows. some of the varieties are relatively expensive though…

Okay great! Thanks for all the great insight!

Wow, thank you for the very detailed post! I see that impedance matching is an important base subject. Is it covered in standard circuit theory textbooks. I’m looking to use this book. I tried to skim the contents but couldn’t find it… Maybe I need to separately learn it? Thanks.

I see, that reference design suggestion sounds good. And it sounds like there’s more practical consideration in tracing/routing on top of the theory… Thanks for the input!

As much as I like the interface and idea of lemmy, I think the content traffic is not enough for me… and keep going back to reddit :/

Oh cool. I couldn’t find any info on doing this. And struggled lots at I don’t understand Iptables