"annoying" when dealing with graphics cards / passthrough if you're talking about virtualization and probably would not be allowed since the hypervisor would be a ring above the kernel module, effectively neutering it.
If you mean dual-boot, sure, that's a very reasonable solution as well. I just don't like to reboot often and would personally have a 2nd computer as it probably takes me an hour or more to go from "booted" to "productive"