nettieddgz655642 - Profile
About me
Profile
You may have to make use of the gpu_memory_limit and/or lora_on_cpu config possibilities to prevent jogging outside of memory. If you still run outside of CUDA memory, you could try and merge in
https://www.imtoken.icu/