I was curious about opencode and tried to run it with mistral:7b as well as qwencode3:8b, but it simply couldn’t execute a single command.

It was necessary, I think, to be able to execute commands because it kept attempting to write to /home/user. So I told it to run pwd to find out where it was. That always failed.

Was j using a wrong model? Or is opencode just incapable of running commands?

  • chrisashtear@lemmy.zip
    1·
    2 months ago

    Those sound like old models which doesnt help. Generally the best model in my experience is qwen3.6-27b. Ornith 9b is the smallest model ive used that is decent at tool use.

    The attempting to write to the wrong folder can be helped by denying a permission in your config. Dont have it off the top of my head.

    • onlinepersona@programming.devOP
      1·
      2 months ago

      I only have 8GB VRAM. So I’m limited, hence those smaller models.

      What do you mean by deny a permission? Shouldn’t it be allowing a permission? I didn’t even know there were permissions beyond read write

      • SirDimples@programming.devM
        2·
        2 months ago

        Older models may not know how to tool call which is required for read/write access, in general stay with models released this year.

        Qwen3.6-35B-A3B works well for 24GB RAM + 8GB VRAM (I run it on 32+8 via llama.cpp).

        Regarding permissions, opencode should have default write permissions by default to current folder and will ask for permission for read/write to external folders (such as /tmp) only when needed.

        • SirDimples@programming.devM
          1·
          2 months ago

          A quick test to make sure opencode is working fine, first make sure you’re in Build mode by pressing TAB until you see Build. Then prompt:

          Write today's date/time to `today.md`

          if it fails to run date then writing today.md correctly in current directory, then the model is most likely not able to do tool calling.