Skip to content

xorprime

every bit of experiences | Sydney, New South Wales Australia

Month: January 2025

Install Python Llama with CUDA in Windows 11

set FORCE_CMAKE=1
$env:CMAKE_ARGS = '-DGGML_CUDA=on -DLLAMA_AVX=off -DLLAMA_AVX2=off -DLLAMA_FMA=off -DCMAKE_GENERATOR_TOOLSET="cuda=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6"'
pip install llama-cpp-python --no-cache-dir --force-reinstall --verbose
Author xorprimePosted on 17 January 2025Categories TechnologyLeave a comment on Install Python Llama with CUDA in Windows 11

About

I am a geek. I work with marketing. I code. And I survive meetings. I am passionate towards web design, web analytics, mobile apps, social media and startups.

Categories

  • Blog
  • Technology

Archives

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

License

Creative Commons License
This work is licensed under a Creative Commons Attribution 2.5 Australia License.
xorprime Proudly powered by WordPress