Skip to content

[Feature]: Check for presence of files at startup #7780

@cduk

Description

@cduk

🚀 The feature, motivation and pitch

Checks for files such as templates etc. should be done right at the start of vLLM loading. Not right at the end after 30 minutes of loading the model.

[rank0]: ValueError: The supplied chat template (./chat_template/llama3.jinja) looks like a file path, but it failed to be opened. Reason: [Errno 2] No such file or directory:

Alternatives

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions