I think it's difficult to signal genetic fitness without actually being genetically fit.

There are proxies to genetic fitness that are frequently and successfully mimicked, though. See e.g.: https://en.wikipedia.org/wiki/Batesian_mimicry