Abstract – This paper investigates the complexities of integrating Large Language Models (LLMs) into software products, with a focus on the challenges encountered for determining their readiness for release. Our systematic review of grey literature identifies common challenges in deploying LLMs, ranging from pre-training and fine-tuning to user experience considerations. The study introduces a comprehensive checklist designed to guide practitioners in evaluating key release readiness aspects such as performance, monitoring, and deployment strategies, aiming to enhance the reliability and effectiveness of LLM-based applications in real-world settings.
Online list of references is available as both markdown and csv format.
- Markdown file can be found at
./grey-resource.md. - CSV file can be found at
./grey-resources.csv.
Mindmap is available as both image and interactive format.
- Mindmap image can be found at
./mind-map/mind-map.png. - Interactive mindmap requires cloning/downloading this repository and opening
./mind-map/index.html.
- Harsh Patel @harsh8398
- Dr. Dominique Boucher
- Dr. Emad Fallahzadeh
- Dr. Ahmed E. Hassan
- Dr. Bram Adams