Skip to content

Eval bug: failed to prepare ubatch #12726

@lostmsu

Description

@lostmsu

Name and Version

LlamaSharp-0.23.0

Relevant change: SciSharp/LLamaSharp#1140

Operating systems

Windows

GGML backends

CUDA

Hardware

2x3090

Models

gemma-3-27b-it-Q4_K_M.gguf

Problem description & steps to reproduce

Instead of returning

First Bad Commit

AFAIK e0dbec0

Relevant log output

decode: failed to prepare ubatch
llama_decode: failed to decode, ret = -3

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions