Fediverse is worse than Reddit. Mod abuse, admin abuse, disinformation, and people simping for literal terrorists.

  • 0 Posts
  • 56 Comments
Joined 2 years ago
cake
Cake day: January 3rd, 2024

help-circle














  • Try to install Mullvad VPN. Don’t use the .rpm because if you happen to be able to install that it bricks your system. In my case that didn’t even work, luckily, but the app just won’t seem to work within a suggested DistroBox setting either. Can’t get ROCm to properly work either, which is already a pain in the ass on a regular distro.




  • ggml_cuda_compute_forward: ADD failed
    CUDA error: shared object initialization failed
      current device: 0, in function ggml_cuda_compute_forward at ggml/src/ggml-cuda.cu:2365
      err
    ggml/src/ggml-cuda.cu:107: CUDA error
    

    I didn’t do anything past using yay to install the AUR koboldcpp-hipblas package, and customtkinter, since the UI wouldn’t work otherwise. The koboldcpp-rocm page very specifically does not mention any other steps in the Arch section and the AUR page only mentions the UI issue.



  • I distrohopped so much after each previous distro eventually broke and me clearly not being smart enough to recover. I’m honestly kinda sick of it, even if the immutable nature also annoys the shit out of me.

    My GPU is a 6650 XT, which should in principle work with ROCm.

    Which model specifically are you recommending? Llama-3.1-8B-Lexi-Uncensored-V2-GGUF? Because the original meta-llama ones are censored to all hell and Huggingface is not particularly easy to navigate, on top of figuring out the right model size & quantization being extremely confusing.