cmake -DSM=86 -DWITH_TESTING=ON .. -DCMAKE_POLICY_VERSION_MINIMUM=3.5 && make -j32
-- USE_CUDNN is set to 0. Compiling without cuDNN support
-- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
-- USE_CUDSS is set to 0. Compiling without cuDSS support
-- USE_CUFILE is set to 0. Compiling without cuFile support
-- Added CUDA NVCC flags for: -gencode;arch=compute_86,code=sm_86
CMake Warning at /root/miniconda3/envs/ksana/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/root/miniconda3/envs/ksana/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:121 (append_torchlib_if_found)
3rdparty/LLM_kernels/cmake/test.cmake:28 (find_package)
3rdparty/LLM_kernels/CMakeLists.txt:130 (include)
-- Found Torch: /root/miniconda3/envs/ksana/lib/python3.12/site-packages/torch/lib/libtorch.so
CMake Warning (dev) at 3rdparty/LLM_kernels/cmake/test.cmake:44 (find_package):
Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules
are removed. Run "cmake --help-policy CMP0148" for policy details. Use
the cmake_policy command to set the policy and suppress this warning.
Call Stack (most recent call first):
3rdparty/LLM_kernels/CMakeLists.txt:130 (include)
This warning is for project developers. Use -Wno-dev to suppress it.
-- Found PythonLibs: /root/miniconda3/envs/ksana/lib/libpython3.12.so (found version "3.12.0")
-- Found Python3: /root/miniconda3/envs/ksana/bin/python3.12 (found version "3.12.0") found components: Interpreter Development Development.Module Development.Embed
-- GEMM_WRAPPER_TEST_SRCS /code/KsanaLLM/3rdparty/LLM_kernels/csrc/kernels/nvidia/gemm_wrapper/gemm_algo_map_test.cu;/code/KsanaLLM/3rdparty/LLM_kernels/csrc/kernels/nvidia/gemm_wrapper/gemm_wrapper_test.cu
-- ROTARY_EMBEDDING_TEST_SRCS : /code/KsanaLLM/3rdparty/LLM_kernels/csrc/kernels/nvidia/rotary_embedding/rotary_embedding_test.cu
-- SAMPLERS_TEST_SRCS : /code/KsanaLLM/3rdparty/LLM_kernels/csrc/kernels/nvidia/samplers/samplers_test.cu
-- Regenerating CUTLASS kernels...
running develop
/root/miniconda3/envs/ksana/lib/python3.12/site-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` and ``easy_install``.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://github.com/pypa/setuptools/issues/917 for details.
********************************************************************************
!!
easy_install.initialize_options(self)
error: [Errno 17] File exists: '/root/miniconda3/envs/ksana/bin/python3.12'
CMake Error at 3rdparty/LLM_kernels/csrc/kernels/nvidia/asymmetric_gemm/CMakeLists.txt:81 (message):
Failed to set up the CUTLASS library due to 1.
-- Configuring incomplete, errors occurred!