Repository navigation
Offer Recursive Flint as a model on this Mac - #562
Closed
brunobergher wants to merge 3 commits into
Closed
brunobergher wants to merge 3 commits into
brunobergher wants to merge 3 commits into
Conversation
Flint is an open-weight coding model (40B MoE, 2.5B active) with an official Q4_1 GGUF for Apple Silicon. It needs llama.cpp's new flint architecture, so the bundled llama-server moves to b11814. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
No new code issues found. See session Reviewed the merge with current CI: current-head macOS Swift build and website checks passed; regression tests were skipped by the PR workflow. Full app packaging and native Flint inference were not exercised in this review. Reviewed 14e6809 |
Lamp's prompt alone is over 20K tokens, so the usual 32K ran out within a few turns. Each catalog model now has its own context, given to llama-server through its presets file (a size on its command line would override it) and to pi. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…el-option-516837 # Conflicts: # Sources/Lamp/LocalModels.swift # build.sh
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Recursive Flint to the models Lamp can download and run on this Mac (Settings → AI Providers → Native Mac AI, and the welcome's picker).
LocalModels.catalog):RecursiveSI/flint-int4-gguf, the official Q4_1 GGUF (26 GB, needs 48 GB of memory per its card). Text only, so the blurb says it can't see screenshots. It sits after Qwen3.6 35B-A3B, which stays the recommended pick on 48 GB+ Macs becauselook_at_appneeds vision.request (33506 tokens) exceeds the available context size).LocalModelSpec.contextSizegives Flint 131,072 (its cache is about 3.4 GB there: all but 13 of its 49 layers look back only 513 tokens). The size goes to llama-server through a presets file (models.ini,[*]for the rest at 32K, a section per model), since a-con the command line overrides presets, and to pi'smodels.json.Tested on a 64 GB M-series Mac, with the bundled llama-server started using Lamp's own router flags (
--models-dir,--jinja,-ngl 999,-c 32768):Engines: only pi runs local models, so pi is the only engine this touches. I didn't run a full build in Lamp with Flint selected.
🤖 Generated with Claude Code