We may not have the full answer, but we have the lay of the land to guide your decision-making process and encourage you to consider responsible/trustworthy AI as a key differentiator.
“A Framework for Designing Foundation Model based Systems” https://arxiv.org/abs/2305.05352
“Towards Responsible AI in the Era of ChatGPT: A Reference Architecture for Designing Foundation Model-based AI Systems” https://arxiv.org/abs/2304.11090