How do you choose an embedding model for a domain-specific corpus?

We're building retrieval over clinical notes and medical literature. General-purpose embedding models (OpenAI, Cohere) perform worse than we expected on domain-specific terminology. How do practitioners evaluate and select embedding models for specialist corpora? Is fine-tuning embeddings worth the overhead?

— Data Engineer, Healthcare analytics