Repository navigation
[bug] Unable to ingest resource #2210
Description
Which part?
Desktop app
What happened?
Unable to ingest resource
SurfSense 2.1.0
Windows 10.0.19045 (x64)
Electron 44.2.0 · Chromium 152.0.7977.76 · Node 24.20.0
What did you expect?
to have the resource ingested at least within 15 mins of me putting it, I've put a simple small pdf to try it and it never finished ingesting the resource and it even fails
How to reproduce
No response
Logs
Activity
MODSetter commentedon Oct 9, 2026
@omarkhaledmohammedelfeky-design What is the PDF size and your machine hardware? Can you also share logs (can get it from settings > report issue)
omarkhaledmohammedelfeky-design commentedon Oct 10, 2026
Size: 14.4 MB
01:24:13 [audiocpp] audio.cpp is optimized for CUDA. The cpu server backend is intended for portability and testing, but performance and model coverage may be lower than CUDA.
01:24:14 [llamacpp] 0.01.415.325 I cmn common_param: common_params_print_info: verbosity = 3 (adjust with the
-lv NCLI arg)01:24:14 [llamacpp] 0.01.415.664 I srv init: The UI is disabled
01:24:14 [llamacpp] 0.01.415.674 I srv init: Use --ui/--no-ui (or deprecated --webui/--no-webui) to enable/disable
01:24:14 [llamacpp] 0.01.421.611 I srv load_models: Loaded 0 cached model presets
01:24:15 [llamacpp] 0.01.422.018 I srv load_models: Loaded 1 local model presets from ~.surfsense\models
01:24:15 [llamacpp] 0.01.424.490 I srv load_models: Loaded 1 custom model presets from ~.surfsense\models\models.ini
01:24:15 [llamacpp] 0.01.424.723 I srv operator(): Available models (1) (: custom preset)
01:24:15 [llamacpp] 0.01.424.731 I srv operator(): * Qwen3-1.7B-Q8_0
01:24:15 [llamacpp] 0.01.425.031 W srv llama_server: -----------------
01:24:15 [llamacpp] 0.01.425.040 W srv llama_server: CORS is set to allow all origins ('') and no API key is set
01:24:15 [llamacpp] 0.01.425.041 W srv llama_server: this can be a security risk (cross-origin attacks)
01:24:15 [llamacpp] 0.01.425.046 W srv llama_server: more info: ggml-org/llama.cpp#25655
01:24:15 [llamacpp] 0.01.425.046 W srv llama_server: -----------------
01:24:15 [llamacpp] 0.01.425.063 W srv llama_server: -----------------
01:24:15 [llamacpp] 0.01.425.064 W srv llama_server: the following feature(s) are enabled:
01:24:15 [llamacpp] 0.01.425.068 W srv llama_server: router mode
01:24:15 [llamacpp] 0.01.425.069 W srv llama_server: do not expose the server to untrusted environments
01:24:15 [llamacpp] 0.01.425.069 W srv llama_server: -----------------
01:24:15 [llamacpp] 0.01.425.075 I srv llama_server: starting server in router mode. models will be automatically loaded on-demand
01:24:15 [llamacpp] 0.01.445.790 I srv llama_server: listening on http://127.0.0.1:52446
01:24:17 [worker-studio] 2026-10-10 01:24:17,229 Context impl SQLiteImpl.
01:24:17 [worker-studio] 2026-10-10 01:24:17,229 Will assume non-transactional DDL.
01:24:17 [worker-ingest] 2026-10-10 01:24:17,245 Context impl SQLiteImpl.
01:24:17 [worker-ingest] 2026-10-10 01:24:17,245 Will assume non-transactional DDL.
01:24:17 [worker-studio] 2026-10-10 01:24:17,260 Context impl SQLiteImpl.
01:24:17 [worker-studio] 2026-10-10 01:24:17,260 Will assume non-transactional DDL.
01:24:17 [worker-ingest] 2026-10-10 01:24:17,276 Context impl SQLiteImpl.
01:24:17 [worker-ingest] 2026-10-10 01:24:17,276 Will assume non-transactional DDL.
01:24:17 [worker-studio] 2026-10-10 01:24:17,307 studio: worker consuming with 4 threads
01:24:17 [worker-studio] 2026-10-10 01:24:17,307 Huey consumer started with 4 thread, PID 11860 at 2026-10-10 08:24:17.307531
01:24:17 [worker-studio] 2026-10-10 01:24:17,307 Scheduler runs every 1 second(s).
01:24:17 [worker-studio] 2026-10-10 01:24:17,307 Periodic tasks are enabled.
01:24:17 [worker-studio] 2026-10-10 01:24:17,307 The following commands are available:
01:24:17 [worker-studio] + modules.artifacts.tasks.studio_job
01:24:17 [worker-ingest] 2026-10-10 01:24:17,323 ingest: worker consuming with 1 threads
01:24:17 [worker-ingest] 2026-10-10 01:24:17,323 Huey consumer started with 1 thread, PID 8064 at 2026-10-10 08:24:17.323154
01:24:17 [worker-ingest] 2026-10-10 01:24:17,323 Scheduler runs every 1 second(s).
01:24:17 [worker-ingest] 2026-10-10 01:24:17,323 Periodic tasks are enabled.
01:24:17 [worker-ingest] 2026-10-10 01:24:17,323 The following commands are available:
01:24:17 [worker-ingest] + modules.documents.tasks.ingest_document
01:24:17 [api] INFO: Started server process [12532]
01:24:17 [api] INFO: Waiting for application startup.
01:24:17 [api] INFO: Application startup complete.
01:24:17 [api] INFO: Uvicorn running on http://127.0.0.1:52445 (Press CTRL+C to quit)
01:24:21 [api] INFO: 127.0.0.1:52472 - "GET /llm/connections/1/models HTTP/1.1" 403 Forbidden
01:24:22 [llamacpp] 0.09.093.400 I srv load: spawning server instance with name=Qwen3-1.7B-Q8_0 on port 52482
01:24:22 [llamacpp] 0.09.093.458 I srv load: spawning server instance with args:
01:24:22 [llamacpp] 0.09.093.459 I srv load: ~\AppData\Local\Programs\surfsense-local-electron\resources\llamacpp\llama-server.exe
01:24:22 [llamacpp] 0.09.093.459 I srv load: --host
01:24:22 [llamacpp] 0.09.093.459 I srv load: 127.0.0.1
01:24:22 [llamacpp] 0.09.093.475 I srv load: --jinja
01:24:22 [llamacpp] 0.09.093.475 I srv load: --port
01:24:22 [llamacpp] 0.09.093.476 I srv load: 52482
01:24:22 [llamacpp] 0.09.093.476 I srv load: --reasoning-format
01:24:22 [llamacpp] 0.09.093.476 I srv load: deepseek
01:24:22 [llamacpp] 0.09.093.477 I srv load: --no-webui
01:24:22 [llamacpp] 0.09.093.477 I srv load: --alias
01:24:22 [llamacpp] 0.09.093.477 I srv load: Qwen3-1.7B-Q8_0
01:24:22 [llamacpp] 0.09.093.478 I srv load: --ctx-size
01:24:22 [llamacpp] 0.09.093.478 I srv load: 8192
01:24:22 [llamacpp] 0.09.093.478 I srv load: --cache-type-k
01:24:22 [llamacpp] 0.09.093.479 I srv load: q8_0
01:24:22 [llamacpp] 0.09.093.479 I srv load: --cache-type-v
01:24:22 [llamacpp] 0.09.093.480 I srv load: q8_0
01:24:22 [llamacpp] 0.09.093.480 I srv load: --flash-attn
01:24:22 [llamacpp] 0.09.093.480 I srv load: on
01:24:22 [llamacpp] 0.09.093.481 I srv load: --fit-ctx
01:24:22 [llamacpp] 0.09.093.481 I srv load: 8192
01:24:22 [llamacpp] 0.09.093.482 I srv load: --fit-target
01:24:22 [llamacpp] 0.09.093.482 I srv load: 1024
01:24:22 [llamacpp] 0.09.093.483 I srv load: --model
01:24:22 [llamacpp] 0.09.093.483 I srv load:
.surfsense\models\Qwen3-1.7B-Q8_0.gguf.surfsense\models\Qwen3-1.7B-Q8_0.gguf'01:24:22 [llamacpp] 0.09.093.497 I srv load: --parallel
01:24:22 [llamacpp] 0.09.093.498 I srv load: 1
01:24:22 [llamacpp] [52482] 0.00.191.599 I cmn common_param: common_params_print_info: verbosity = 3 (adjust with the
-lv NCLI arg)01:24:22 [llamacpp] [52482] 0.00.191.743 I srv init: The UI is disabled
01:24:22 [llamacpp] [52482] 0.00.191.747 I srv init: Use --ui/--no-ui (or deprecated --webui/--no-webui) to enable/disable
01:24:22 [llamacpp] [52482] 0.00.191.892 W srv llama_server: -----------------
01:24:22 [llamacpp] [52482] 0.00.191.897 W srv llama_server: CORS is set to allow all origins ('*') and no API key is set
01:24:22 [llamacpp] [52482] 0.00.191.897 W srv llama_server: this can be a security risk (cross-origin attacks)
01:24:22 [llamacpp] [52482] 0.00.191.899 W srv llama_server: more info: ggml-org/llama.cpp#25655
01:24:22 [llamacpp] [52482] 0.00.191.899 W srv llama_server: -----------------
01:24:22 [llamacpp] [52482]
01:24:22 [llamacpp] [52482] 0.00.194.966 I srv load_model: loading model '
01:24:23 [audiocpp] stopped (code=1 signal=null)
01:24:23 [audiocpp] audio.cpp is optimized for CUDA. The cpu server backend is intended for portability and testing, but performance and model coverage may be lower than CUDA.
01:24:24 [llamacpp] [52482] 0.01.253.754 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden
01:24:24 [llamacpp] [52482]
01:24:24 [llamacpp] [52482]
01:24:24 [llamacpp] [52482]
01:24:24 [llamacpp] [52482]
01:24:25 [llamacpp] [52482]
01:24:25 [llamacpp] [52482]
01:24:25 [llamacpp] [52482]
01:24:25 [llamacpp] [52482]
01:24:25 [llamacpp] [52482] 0.02.973.648 I cmn init: llama threadpool init, n_threads = 4
01:24:26 [llamacpp] [52482] 0.03.295.410 I srv load_model: initializing, n_slots = 1, n_ctx_slot = 8192, kv_unified = 'false'
01:24:26 [llamacpp] [52482] 0.03.328.032 I srv llama_server: model loaded
01:24:26 [llamacpp] [52482] 0.03.328.042 I srv llama_server: listening on http://127.0.0.1:52482
01:24:26 [llamacpp] [52482]
01:24:26 [llamacpp] [52482] 0.03.328.663 I srv operator(): child server monitoring thread started, waiting for EOF on stdin...
01:24:27 [api] INFO: 127.0.0.1:52484 - "DELETE /workspaces/3/documents/3 HTTP/1.1" 204 No Content
01:24:29 [api] INFO: 127.0.0.1:52484 - "DELETE /workspaces/3/documents/1 HTTP/1.1" 204 No Content
01:24:39 [llamacpp] 0.26.401.448 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.431.101 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.475.611 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.503.386 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.536.744 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.578.405 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] 0.26.611.322 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [api] INFO: 127.0.0.1:52488 - "POST /chat/threads/3/messages HTTP/1.1" 200 OK
01:24:40 [llamacpp] 0.26.661.571 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:24:40 [llamacpp] [52482] 0.17.550.436 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1
01:24:40 [llamacpp] [52482] 0.17.550.569 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0
01:24:51 [api] INFO: 127.0.0.1:52509 - "PUT /artifacts/2/flashcard-state/mark HTTP/1.1" 200 OK
01:24:52 [api] INFO: 127.0.0.1:52509 - "PUT /artifacts/2/flashcard-state/order HTTP/1.1" 200 OK
01:24:53 [api] INFO: 127.0.0.1:52509 - "PUT /artifacts/2/flashcard-state/order HTTP/1.1" 200 OK
01:24:53 [api] INFO: 127.0.0.1:52509 - "PUT /artifacts/2/flashcard-state/order HTTP/1.1" 200 OK
01:24:54 [api] INFO: 127.0.0.1:52509 - "PUT /artifacts/2/flashcard-state/mark HTTP/1.1" 200 OK
01:24:58 [llamacpp] [52482] 0.35.627.472 I slot print_timing: id 0 | task 0 | prompt eval time = 17138.32 ms / 186 tokens ( 92.14 ms per token, 10.85 tokens per second)
01:24:58 [llamacpp] [52482] 0.35.627.494 I slot print_timing: id 0 | task 0 | eval time = 938.52 ms / 10 tokens ( 104.28 ms per token, 9.59 tokens per second)
01:24:58 [llamacpp] [52482] 0.35.627.495 I slot print_timing: id 0 | task 0 | total time = 18076.84 ms / 196 tokens
01:24:58 [llamacpp] [52482] 0.35.627.496 I slot print_timing: id 0 | task 0 | graphs reused = 9
01:24:58 [llamacpp] [52482] 0.35.627.613 I slot release: id 0 | task 0 | stop processing: n_tokens = 195, truncated = 0
01:25:01 [api] INFO: 127.0.0.1:52488 - "PUT /artifacts/2/flashcard-state/mark HTTP/1.1" 200 OK
01:25:18 [llamacpp] 1.04.439.811 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.470.363 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.505.589 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.556.698 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.602.901 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.634.304 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.667.938 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.707.518 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] 1.04.758.970 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [api] INFO: 127.0.0.1:52515 - "POST /chat/threads/3/messages HTTP/1.1" 200 OK
01:25:18 [llamacpp] 1.04.794.927 I srv proxy_reques: proxying request to model Qwen3-1.7B-Q8_0 on port 52482
01:25:18 [llamacpp] [52482] 0.55.687.309 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, f_sim_best = 0.875 (> 0.100 thold), f_keep = 0.933
01:25:18 [llamacpp] [52482] 0.55.687.536 I slot launch_slot_: id 0 | task 11 | processing task, is_child = 0
01:25:30 [llamacpp] [52482] 1.08.004.285 I slot print_timing: id 0 | task 11 | n_gen = 100, tg = 9.61 t/s, tg_3s = 9.70 t/s
01:25:33 [llamacpp] [52482] 1.11.029.088 I slot print_timing: id 0 | task 11 | n_gen = 129, tg = 9.60 t/s, tg_3s = 9.59 t/s
01:25:36 [llamacpp] [52482] 1.14.058.215 I slot print_timing: id 0 | task 11 | n_gen = 158, tg = 9.60 t/s, tg_3s = 9.57 t/s
01:25:39 [llamacpp] [52482] 1.17.088.137 I slot print_timing: id 0 | task 11 | n_gen = 187, tg = 9.59 t/s, tg_3s = 9.57 t/s
01:25:42 [llamacpp] [52482] 1.20.121.136 I slot print_timing: id 0 | task 11 | n_gen = 216, tg = 9.59 t/s, tg_3s = 9.56 t/s
01:25:45 [llamacpp] [52482] 1.23.160.258 I slot print_timing: id 0 | task 11 | n_gen = 245, tg = 9.58 t/s, tg_3s = 9.54 t/s
01:25:48 [llamacpp] [52482] 1.26.210.463 I slot print_timing: id 0 | task 11 | n_gen = 274, tg = 9.58 t/s, tg_3s = 9.51 t/s
01:25:52 [llamacpp] [52482] 1.29.253.718 I slot print_timing: id 0 | task 11 | n_gen = 303, tg = 9.57 t/s, tg_3s = 9.53 t/s
01:25:54 [llamacpp] [52482] 1.31.993.482 I slot print_timing: id 0 | task 11 | prompt eval time = 2012.70 ms / 26 tokens ( 77.41 ms per token, 12.92 tokens per second)
01:25:54 [llamacpp] [52482] 1.31.993.504 I slot print_timing: id 0 | task 11 | eval time = 34293.17 ms / 329 tokens ( 104.55 ms per token, 9.56 tokens per second)
01:25:54 [llamacpp] [52482] 1.31.993.506 I slot print_timing: id 0 | task 11 | total time = 36305.87 ms / 355 tokens
01:25:54 [llamacpp] [52482] 1.31.993.507 I slot print_timing: id 0 | task 11 | graphs reused = 334
01:25:54 [llamacpp] [52482] 1.31.993.576 I slot release: id 0 | task 11 | stop processing: n_tokens = 536, truncated = 0
01:26:56 [api] INFO: 127.0.0.1:52561 - "POST /workspaces/3/documents/upload HTTP/1.1" 201 Created
01:27:03 [worker-ingest] 2026-10-10 01:27:03,828 Executing modules.documents.tasks.ingest_document: d15ee6a8-fa8b-458e-9764-af333e726e46 2 retries
01:27:04 [api] INFO: 127.0.0.1:52564 - "POST /internal/events HTTP/1.1" 202 Accepted
01:27:04 [worker-ingest] 2026-10-10 01:27:04,555 HTTP Request: POST http://127.0.0.1:52445/internal/events "HTTP/1.1 202 Accepted"
01:27:36 [worker-ingest] 2026-10-10 01:27:36,366 detected formats: [<InputFormat.PDF: 'pdf'>]
01:27:39 [worker-ingest] 2026-10-10 01:27:39,782 Going to convert document batch...
01:27:39 [worker-ingest] 2026-10-10 01:27:39,782 Initializing pipeline for StandardPdfPipeline with options hash 499d423772fcb6347c48b705e652c223
01:27:39 [worker-ingest] 2026-10-10 01:27:39,798 Loading plugin 'docling_defaults'
01:27:39 [worker-ingest] 2026-10-10 01:27:39,798 Registered picture descriptions: ['picture_description_vlm_engine', 'vlm', 'api']
01:27:39 [worker-ingest] 2026-10-10 01:27:39,798 Loading plugin 'docling_defaults'
01:27:39 [worker-ingest] 2026-10-10 01:27:39,815 Registered ocr engines: ['auto', 'easyocr', 'kserve_v2_ocr', 'nemotron-ocr', 'ocrmac', 'rapidocr', 'tesserocr', 'tesseract']
01:27:40 [worker-ingest] 2026-10-10 01:27:40,415 Accelerator device: 'cpu'
01:27:40 [worker-ingest] [INFO] 2026-10-10 01:27:40,465 [RapidOCR] base.py:23: Using engine_name: onnxruntime
01:27:40 [worker-ingest] [INFO] 2026-10-10 01:27:40,731 [RapidOCR] main.py:63: Using ~\AppData\Local\Programs\surfsense-local-electron\resources\models\docling\RapidOcr\PP-OCRv6_det_small.onnx
01:27:40 [worker-ingest] [INFO] 2026-10-10 01:27:40,948 [RapidOCR] base.py:23: Using engine_name: onnxruntime
01:27:40 [worker-ingest] [INFO] 2026-10-10 01:27:40,948 [RapidOCR] main.py:63: Using ~\AppData\Local\Programs\surfsense-local-electron\resources\models\docling\RapidOcr\ch_ppocr_mobile_v2.0_cls_mobile.onnx
01:27:41 [worker-ingest] [INFO] 2026-10-10 01:27:41,098 [RapidOCR] base.py:23: Using engine_name: onnxruntime
01:27:41 [worker-ingest] [INFO] 2026-10-10 01:27:41,098 [RapidOCR] main.py:63: Using ~\AppData\Local\Programs\surfsense-local-electron\resources\models\docling\RapidOcr\PP-OCRv6_rec_small.onnx
01:27:41 [worker-ingest] 2026-10-10 01:27:41,312 Loading plugin 'docling_defaults'
01:27:41 [worker-ingest] 2026-10-10 01:27:41,315 Registered layout engines: ['layout_object_detection', 'docling_layout_default', 'docling_experimental_table_crops_layout']
01:27:44 [worker-ingest] 2026-10-10 01:27:44,497 Initializing Transformers object-detection engine
01:27:44 [worker-ingest] 2026-10-10 01:27:44,497 Accelerator device: 'cpu'
01:27:47 [worker-ingest] Loading weights: 0%| | 0/770 [00:00<?, ?it/s]
01:27:47 [worker-ingest] Loading weights: 37%|###6 | 282/770 [00:00<00:00, 2818.59it/s]
01:27:48 [worker-ingest] Loading weights: 73%|#######3 | 564/770 [00:00<00:00, 2819.06it/s]
01:27:48 [worker-ingest] Loading weights: 100%|##########| 770/770 [00:00<00:00, 2888.56it/s]
01:27:48 [worker-ingest] 2026-10-10 01:27:48,147 Transformers engine ready (device=cpu, dtype=torch.float32)
01:27:48 [worker-ingest] 2026-10-10 01:27:48,163 Loading plugin 'docling_defaults'
01:27:48 [worker-ingest] 2026-10-10 01:27:48,163 Registered table structure engines: ['docling_tableformer', 'docling_tableformer_v2', 'granite_vision_table']
01:27:48 [worker-ingest] 2026-10-10 01:27:48,180 Accelerator device: 'cpu'
01:27:49 [worker-ingest] 2026-10-10 01:27:49,646 Processing document Make It Stick, The Science of Successful Learning (Peter C. Brown, Mark A. McDaniel etc.) (z-library.sk, 1lib.sk, z-.pdf
01:28:09 [worker-ingest] 2026-10-10 01:28:09,279 Orphan pdf_cell 56 recovered to row=9 by nearest-row fallback (col=1, y=916.2, dist=27.0)
01:28:09 [worker-ingest] 2026-10-10 01:28:09,279 Orphan pdf_cell 57 recovered to row=9 by nearest-row fallback (col=1, y=916.4, dist=27.2)
01:30:31 [api] INFO: 127.0.0.1:52628 - "GET /llm/connections/1/models HTTP/1.1" 403 Forbidden
01:34:55 [api] INFO: 127.0.0.1:52784 - "GET /llm/connections/1/models HTTP/1.1" 403 Forbidden
MODSetter commentedon Oct 17, 2026
@omarkhaledmohammedelfeky-design The issue is that the PDF must have shit ton of pages. Try the new release 2.2.2. It should now get processed.
AnishSarkar22 commentedon Oct 28, 2026
@omarkhaledmohammedelfeky-design can you please confirm if this issue is still appearing for you?