We build a small, versioned depot of ruby + rails and other gems. Running this with Apache/mod_fcgid works really well and is very stable.