Ive been playing koboldai horde but the queue annoys me. I want a nsfw ai for playing on tavernai chat
You must log in or register to comment.
Install ollama. It has ROCm support (on Linux at least). Then hook it up to your favorite client. It has its own API and an openai compatible one.
Get una-thebeagle-7b-v1.Q4_K_M. I found it looking at this guide.
I cant clone it
What do you mean?