Skip to content

Error with quantization and lora #110

Closed

Description

@imikod

When I use a model with lora it works as expected but when I pass --type q8_0 it does not work at all.
The model works without lora and with quantization.
I tested different loras and models with the same result.

Activity

  1. FSSRepo commented on Dec 8, 2023

    @FSSRepo
    Contributor

    The results of Loras with quantized models are very poor anyway. I do not recommend it.

  2. imikod commented on Dec 8, 2023

    @imikod
    Author

    I believe you. In fact I read the warning and wanted to see how bad it was.

  3. leejet commented on Nov 13, 2025

    @leejet
    Owner

    This PR #969 should fix the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions