• 1 Post
  • 886 Comments
Joined 3 years ago
cake
Cake day: August 22nd, 2023

help-circle

  • I’m not the OP, but I’m trying to figure out if local models are always painfully slow or if I’m missing something obvious in my tuning.

    Stable Diffusion can whip up a picture in less time on the same hardware, than lama.cpp takes to decide to call an MCP function.

    It seems like I must be missing something in my lama.cpp setup, but none of the guides I’ve read have clued me in to what I’ve done wrong.

    Ollama performs similarly poorly on the same harsware, so I’ve probably managed to make the se mistake(s) at least twice.

    Anyway, that’s the main thing I’m reading along for. Trying to increase my understanding until I catch my own mistakes.







  • Will posting about AI cost us clients?

    Maybe.

    The respect of our peers?

    Absolutely.

    For better or worse, there’s more idiots thoughtlessly adopting AI today, than engineers carefully working with it.

    Also, it’s not a coincidence that the very best of the best have less use for AI.

    AI provides access to faster-but-worse solutions for folks who lacked access before.

    That former lack of access can be for many different reaaons, but inexperience is perceived as the most common.

    So, whether fair or not, talking about use of AI signals:

    1. Willingness to try new things.
    2. Disregard to the harm done to the original creators whose work is being ripped off.
    3. Disregard for the harm being done to the planet.

    and

    1. Inexperience with computers.

    Edit: My source is that I, myself, work with AI and frequently must talk about it professionally - often in nuanced ways to un-receptive audiences.

    So I try to stay aware of how it is impacting my professional image. The above is from my experiences.