Skip to content

.pth to .ggml Out of Memory #76

Closed
Closed
.pth to .ggml Out of Memory#76
Labels
hardwareHardware relatedwontfixThis will not be worked on

Description

@cs-mt
cs-mt
opened on Mar 13, 2023

I have 16 GBs of memory (14 GB free) and running python3 convert-pth-to-ggml.py models/7B/ 1 causes an OOM error (Killed) on Linux.

Here's the dmesg message:
Out of memory: Killed process 930269 (python3) total-vm:15643332kB, anon-rss:13201980kB, file-rss:4kB, shmem-rss:0kB, UID:0 pgtables:26524kB oom_score_adj:0

I will be receiving my new RAM in a few days but I think this is supposed to work with 16 GB memory?

Activity

  1. cs-mt commented on Mar 13, 2023

    @cs-mt
    cs-mt
    on Mar 13, 2023
    Author

    Oh, never mind. Allocating extra swap space worked.

  2. cs-mt
    closed this as completedon Mar 13, 2023

  3. kassane commented on Mar 15, 2023

    @kassane
    kassane
    on Mar 15, 2023
    Contributor

    @cs-mt ,
    I got the same error having 16GiB RAM. Probably 32GiB would be ideal.

    Ref: #138

  4. gjmulder
    added
    wontfixThis will not be worked on
    hardwareHardware related
    on Mar 15, 2023
  5. Hades32
    added a commit that references this issue on Mar 21, 2023

    Merge pull request ggml-org#76 from anzz1/patch-3

    2cbe796
  6. spiritbuun
    added 2 commits that reference this issue on Apr 6, 2026

    docs: experiment #76 — temperature grid search confirms defaults optimal

    545743f

    merge: experiment #76 — temperature grid search confirms αV=1.3 optimal

    8078fc3
  7. phuongncn
    added a commit that references this issue on Apr 28, 2026

    iq4_nl: faster quantization (ggml-org#76)

    6dec411
  8. Copilot
    added a commit that references this issue on Aug 26, 2026

    fix: resolve code scanning alerts ggml-org#76-#100

    76dfbd3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    hardwareHardware relatedwontfixThis will not be worked on

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions