Skip to content

Conversation

jasoncouture
Copy link
Contributor

@jasoncouture jasoncouture commented Jan 30, 2024

Build llama against CLBLAST (windows only for now)

Passing build: https://github.com/jasoncouture/LLamaSharp/actions/runs/7714965548/job/21028424704

Step 1 of #464
Step 2 will be to update the binaries, and add a new NuGet package spec.

using bash expansion expression, combined with mkdir -p (--parents), allows us to create all of the directories at once.

`deps/{avx,avx2,avx512,osx-arm64,osx-x64,cu11.7.1,cu12.1.0,clblast}`
expands to: deps/avx deps/avx2 deps/avx512 deps/osx-arm64 deps/osx-x64 deps/cu11.7.1 deps/cu12.1.0 deps/clblast
@martindevans
Copy link
Member

Is this good to merge now? I can see you've got the Linux stuff in there but commented out, do you want to include that in this PR, or merge as is and leave it for the future?

@jasoncouture
Copy link
Contributor Author

@martindevans it should be good to go.

Sorry for the close and reopen, fat fingers on my phone.

@jasoncouture
Copy link
Contributor Author

jasoncouture commented Jan 31, 2024

Llamacpp doesn't build clblast on Linux, I'll figure that out eventually, but for now windows only.

@martindevans martindevans merged commit 3b08874 into SciSharp:master Jan 31, 2024
@martindevans
Copy link
Member

Thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants