Repository navigation
large models loading with mlcontext.model.load ends up OutOfMemoryException #6948
Description
System Information (please complete the following information):
- OS & Version: Windows 11 Pro 23H2 64GB RAM
- ML.NET Version: Microsoft.ML Ver3.0.0, Microosft.ML.AutoML Ver0.21.0
- .NET Version: .NET 8
Describe the bug
When loading models which size are over 100MB, mlcontext.model.load throws Exception.
Viewing stack tace, 'System.Reflection.TargetInvocationException' (Microsoft.ML.Core.dll)
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
---> System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
Additional context
When loading models which size are less than 100MB, no problem.
Activity
michaelgsharp commentedon Jan 10, 2024
Is it a tensorflow/torchsharp model or a normal ML.NET model?
Are you able to upload the model for us to have a repro?
boneatjp commentedon Jan 11, 2024
I just use Microsoft.ML.AutoML, mostly models are LightGBM, I guess.
Uploading models isn't any trouble for me. I'm not sure if I could upload it here with that kind of size.
boneatjp commentedon Jan 14, 2024
I found out that I could use GitLFS to upload large files. Where is the good place to upload it?
boneatjp commentedon Jan 21, 2024
model.zip.001.zip
model.zip.002.zip
model.zip.003.zip
model.zip.004.zip
model.zip.005.zip
model.zip.006.zip
model.zip.007.zip
model.zip.008.zip
Using 7-zip, model.zip is splitted to model.zip.001 to model.zip.008. Here files must have extension like .zip so renamed like model.zip.001 to model.zip.001.zip. They should be renamed refore combining.
rosebyte commentedon Oct 22, 2026
Triage: we will need to investigate the issue.