Report finds newer inferential models hallucinate nearly half the time while experts warn of unresolved flaws, deliberate deception and a long road to human-level AI reliability
  • vivendi@programming.devEnglish
    0·
    2 months ago

    Fuck ClosedAI

    I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!

    • Valmond@lemmy.worldEnglish
      0·
      2 months ago

      Any pointers on how to do that?

      Also, what hardware do you need for this kind of stuff?

      • vivendi@programming.devEnglish
        0·
        2 months ago

        First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both

        • Valmond@lemmy.worldEnglish
          0·
          2 months ago

          I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.

          • vivendi@programming.devEnglish
            1·
            2 months ago

            download “LM Studio” and you can download models and run them through it

            I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes