How to let the user cancel loading the model and stop it from fetching params

[JohnReginaldShutler]

Hello quick question! I was wondering, after you create the engine (in the step below) and the cache starts getting populated, how do you code a cancel button for a user to cancel downloading the model/quit the task. Is there a method that can be called? In this example to stop the response llm.abort(); but I would like to understand what abort() is being called on and how can I get there from the simple implementation found below.

const engine = await CreateMLCEngine(
selectedModel,
{ initProgressCallback: initProgressCallback }, // engineConfig
);

Thank you!

@customautosys

[CharlieFRuan]

May relate to this:

• Abort reload() if receiving another reload() call #484

[Neet-Nestor]

#484 is talking about avoiding having multiple loadings concurrently, but not about an API for cancelling like abort(). I will add this to our tracking list and have a look of whether we can provide this easily.

[JohnReginaldShutler]

Thank you so much for looking into it! Do drop me a ping when an API like this has been created. Really appreciate the work you guys are doing <3 (@customautosys)

[TomYeoman]

This would be really helpful

For my understanding the current state is we can only use unload() to cancel a currently reloading model (I.E loading from cache ), however there's no way to cancel a currently downloading model?

[akre54]

Adding my +1 to this. Is this easy to expose? It'd be helpful for my use case