Interesting how Arduino is now planning to release a SBC, while Raspberry Pi also has a microcontroller lineup. Now using a RPi or an Arduino board in a project won't mean much when their products are nearly the same.

I think there have been multiple leaks in the past, and this website is not the first either...

I wonder if FauxPilot's models (Salesforce Codegen family) can be quantized and run on the CPU. I was able to run the 350M model on my machine but it wasn't able to compete with Copilot in any way. Salesforce claims their model is competitive with OpenAI Codex their github description[1]. Maybe their largest 16B model is, but I haven't been able to try it.

[1] https://github.com/salesforce/CodeGen

We will add quantized CodeGen for fast inference on CPUs up on cformers (https://github.com/NolanoOrg/cformers/) by later today.

> by later today

Wow, that's the timeframe things are moving at right now, we better get used to it!

Whoa is there a PR or wiki about this

4bit GPTQ maybe?

Really interesting writeup!

Only the PRoot method has some overhead, as it hijacks system calls with ptrace(). Linux namespaces or chroot shouldn't have noticable overhead.

Maybe you are looking for cheat.sh?

YESSSSSSS!!! Thank you.

see also https://github.com/tldr-pages/tldr