Failed to open serialized model file: models/dali/1/model.dali

[wurthel]

Hello!

I'm trying to use autoserialization feature: taking the pipeline definition and config from this example, but it doesn't work. Triton tries to load the model, but then fails:

I0714 12:40:59.798507 1 dali_model.h:92] Loading DALI pipeline from file models/dali/1/model.dali
E0714 12:40:59.798660 1 dali_model.cc:32] Failed to open serialized model file: models/dali/1/model.dali
I0714 12:40:59.798695 1 dali_backend.cc:169] TRITONBACKEND_ModelFinalize: delete model state
E0714 12:40:59.798719 1 model_repository_manager.cc:1348] failed to load 'dali' version 1: Unknown: DALI Backend error: Failed to open serialized model file: models/dali/1/model.dali

Triton image I use: nvcr.io/nvidia/tritonserver:22.06-py3

[wurthel]

Also tested it using the latest version of dali_backend (built from docker build section). Same behaviour.

UPD
Model loading works correctly if I do serialization manually and then put the model.dali file into the model repo.

[szalpal]

Hi @wurthel !

Apologies for the late response.

Could you give any more details about your use case? It's hard to figure out the reason without them. Maybe you could paste more logs from the server? --log-verbose=1 option would come in handy here.