In this session, actuaries and data scientists will describe how the Cleveland Clinic has utilized large language models to support caregivers with difficult end of life conversations with patients and their loved ones. While artificial intelligence is often prefaced with words of caution, it can also be harnessed for good. The group will discuss concepts like prompt engineering and retrieval-augmented generation which helped arm the organization's advanced care planning staff with detailed information about the patients. We hope the audience will be able to leave this session with a strong understanding of tactics for creating business products that incorporate large language models, an awareness of pitfalls and approaches to overcome them and additional ideas on how artificial intelligence can be a force for good.