Released: Jan 11, 2025

Updates in 2025.1.2

Features

• Added initial support for multimodal capabilities with vision handling (VLM).
• Added support for the LMK model format.
• Introduced the Prompt class.
• Introduced the Attachment class.
• Added overloads to the Submit and SubmitAsync methods in the MultiTurnConversation class to support prompts with image attachments.
• Added overloads to the Submit and SubmitAsync methods in the SingleTurnConversation class to support prompts with image attachments.
• Enhanced GPU device memory management.
• Optimized dynamic sampling mechanisms.
• Various performance improvements.