Hacker Newsnew | past | comments | ask | show | jobs | submit | rahduro's commentslogin

It might have something to do with quantization though, I have used the Q6_K version from https://huggingface.co/bartowski/mathstral-7B-v0.1-GGUF with Llamafile. It always shows 9.11 is bigger than 9.9.


Excellent tutorial, new to python, and I always hated when things just install without letting you know where it's going..and next time there is some upgrade all sorts of weird errors keep coming..Thanks a lot.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: