Enhanced Support for Local AI Engines
- A major focus of Kai 1.1.1 is continued enhancement of the integration with Ollama and LM Studio.
- Kai 1.1 introduced a significantly more flexible architecture for connecting to AI providers and local models. With Kai 1.1.1, Embarcadero expanded their testing across a wider range of local models and configurations and made additional refinements to the local-model experience.
- This release also enhances how Kai provides instructions and available tools to local models, along with support for longer sequences of tool calls. These improvements are especially valuable for agentic workflows, where Kai may inspect a project, read files, make changes, and carry out multiple operations as part of completing a request.
- The result is improved reliability and broader compatibility when using Kai with Ollama and LM Studio across a range of local models and configurations. Testing included multiple Ollama models as well as successful code-modification workflows with LM Studio.
- Local models can vary considerably in context-window size, tool-calling capabilities, and configuration, so results will depend on the selected model and local inference environment. For more advanced agentic development workflows, a capable model with a sufficiently large context window will provide the best experience.
Other Quality Improvements in Kai 1.1.1
- Improved reliability when creating files and modifying units.
- Improved the display of long MCP tool descriptions.
- Refined Select All / Deselect All behavior in the MCP Tools configuration.
- Improved MCP Tools column header display when using a dark IDE theme.