Transformers / vLLM compatible version for local generation
#1
by lewtun - opened
For those wanting to chat with this model using transformers / vLLM (or any other local inference engine), I converted the weights to the correct format: https://huggingface.co/lewtun/talkie-1930-13b-it-hf