Skip to content

[Feature Request] Model architecture Qwen3VLForConditionalGeneration not supported #219

Closed

Description

@shahzaib3120

ServerArgs(model_path='path_to_qwen/', tp_info=DistributedInfo(rank=0, size=1), dtype=torch.bfloat16, max_running_req=4, attention_backend='auto', moe_backend='auto', nvfp4_backend='triton', expert_load='auto', moe_cache_size=0, moe_cache_rate=None, moe_cache_auto=False, kv_reserve_tokens=8192, moe_cache_policy='lru', moe_prefill_overlap=True, moe_prefill_hit_d2d=False, moe_collect_stats=False, moe_cpu_threads=0, moe_cpu_layers=None, moe_hybrid_max_fetch=-1, cuda_graph_bs=None, cuda_graph_max_bs=None, page_size=1, memory_ratio=0.9, linear_state_cache_ratio=2.0, swa_full_tokens_ratio=0.2, swa_num_pages_override=None, distributed_timeout=60.0, use_dummy_weight=False, use_pynccl=True, max_seq_len_override=None, num_page_override=None, num_token_override=None, max_extend_tokens=8192, cache_type='radix', offline_mode=False, decode_log_interval=40, special_token_ckpt=False, _unique_suffix='.pid=3215311', server_host='127.0.0.1', server_port=1919, num_tokenizer=0, silent_output=False, shell_mode=False, served_model_name='qwen3vl-fiber-merged-v5', tool_call_parser='qwen25', reasoning_parser='qwen3', sampling_defaults='model', max_output_tokens=None, enable_cache_report=False, cors_origins='tauri://localhost,http://tauri.localhost,http://localhost:1420')

[2026-08-27|00:42:09|FrontendAPI] ERROR Backend supervisor: ValueError: Model architecture Qwen3VLForConditionalGeneration not supported

ValueError: Model architecture Qwen3VLForConditionalGeneration not supported

g: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '

Activity

  1. jason-fxz commented on Sep 17, 2026

    @jason-fxz
    Collaborator

    Qwen3VLForConditionalGeneration is supported since #454, released in FreeToken 0.1.3 (https://github.com/FlashML-org/FreeToken/releases/tag/v0.1.3), along with Qwen3VLMoeForConditionalGeneration. Images go through the OpenAI, Anthropic and Responses APIs; the per-family image flags are in docs/models.md (https://github.com/FlashML-org/FreeToken/blob/main/docs/models.md#image-input).

    Please update and reopen if your merged checkpoint still fails to load.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions