Why? After all, if libc is optional then you could simply provide a statically linked binary and be done with it, there would be no way to change the addresses.
If you link against libc, that’s the only place you can enter the kernel from. If you statically link that is relaxed to “system calls can come from anywhere on your code”. The former has stronger protections, obviously, but as far as I can tell you still have protection from “wild shellcode in a RWX region can make syscalls”.