Ask HN: Local AI Models for Coding and General Tasks?

Hi,

I'm looking at Gemma and Qwen as a local AI. I wanted to try it out for coding but also some other basic tasks. My system has an AMD based GPU with 12GB VRAM. What are some considerations or other options that I should look at?

3 points | by giantg2 6 hours ago

3 comments

  • giantg2 28 minutes ago
    I was doing some more research and think Gemma 4 12B would be a good model for my uses. I like that it has audio support, which I might have a use case for. It seems like it's close to Claude code running on older version of Sonnet, which would be good for me.

    Anybody have experience running Gemma 4 12B locally? How do you like it? Any similar alternatives I should consider?

  • Muralnick 2 hours ago
    [dead]
  • theGlenn 5 hours ago
    [dead]