Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Current Build Does Not Install and/or ReadMe is outdated/incorrect for Linux #94

Open
F1zzyD opened this issue Jan 16, 2025 · 1 comment

Comments

@F1zzyD
Copy link

F1zzyD commented Jan 16, 2025

The ReadMe States:
To install, either use the file "easy_KCPP-ROCm_install.sh" or navigate to the folder you want to download to in Terminal then run

git clone https://github.com/YellowRoseCx/koboldcpp-rocm.git -b main --depth 1 && \
cd koboldcpp-rocm && \
make LLAMA_HIPBLAS=1 -j4 && \
python ./koboldcpp.py

Neither of these options work and lead to errors on a fresh Linux install. Further...

  • following the first step for Linux which states to "You will have to compile your binaries from source. A makefile is provided, simply run make." Running make leads to an error 127.
  • following the second step "For an ROCm only build, do make LLAMA_HIPBLAS=1 -j4 (-j4 means it will use 4 cores of your CPU; you can adjust accordingly or leave it off altogether)" also leads to an error 127.
  • The other steps more than likely fail, however I have not tested those.

It seems that either a dependency is needed but is not listed in the ReadMe or this project is not yet functional on a fresh install of Linux. Here is the full log:

/bin/sh: 1: cc: not found
/bin/sh: 1: g++: not found
/bin/sh: 1: cc: not found
/bin/sh: 1: g++: not found
/bin/sh: 1: /usr/bin/hipcc: not found
/bin/sh: 1: /usr/bin/hipcc: not found
I koboldcpp build info:
I UNAME_S:  Linux
I UNAME_P:  x86_64
I UNAME_M:  x86_64
I UNAME_O:  GNU/Linux
I CFLAGS:   -I. -Iggml/include -Iggml/src -Iggml/src/ggml-cpu -Iinclude -Isrc -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -std=c11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_CPU -DGGML_USE_CPU_AARCH64 -DNDEBUG -s -DGGML_USE_LLAMAFILE -pthread -Wno-deprecated -Wno-deprecated-declarations -Wno-unused-variable -pthread -march=native -mtune=native
I CXXFLAGS: -I. -Iggml/include -Iggml/src -Iggml/src/ggml-cpu -Iinclude -Isrc -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -std=c++17 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_CPU -DGGML_USE_CPU_AARCH64 -DNDEBUG -s -DGGML_USE_LLAMAFILE -pthread -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -Wno-unused-variable -pthread
I LDFLAGS:  -ldl
I CC:
I CXX:
I HIP CC:
I HIP CXX:

cc  -I. -Iggml/include -Iggml/src -Iggml/src/ggml-cpu -Iinclude -Isrc -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -std=c11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_CPU -DGGML_USE_CPU_AARCH64 -DNDEBUG -s -DGGML_USE_LLAMAFILE -pthread -Wno-deprecated -Wno-deprecated-declarations -Wno-unused-variable -pthread -march=native -mtune=native  -c ggml/src/ggml.c -o ggml.o
make: cc: No such file or directory
make: *** [Makefile:482: ggml.o] Error 127
@Ayandaftary
Copy link

you are lacking base development tools, install them first from your distro's package manager (base-devel on arch linux and build-essential on debian)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants