Hi, creator of VibePod here (https://github.com/VibePod/vibepod-cli)

I spent lots of time on this topic, and had a similar path. Meanwhile the tool also supports a quick way to add custom or local providers to agents: https://vibepod.dev/news/vibepod-cli-0-24/