[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NVIDIA TF] Support building against CUDA 12.0 #58867

Merged
merged 11 commits into from
Jan 18, 2023
Merged

[NVIDIA TF] Support building against CUDA 12.0 #58867

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
be94c45
Use major version for cupti lib with CUDA>=12
nluehr Dec 9, 2022
9145a60
Update CUDA stub libraries for CUDA 12
nluehr Dec 9, 2022
dee09e9
Migrate remaining calls to cusparseCsrmvEx to cusparseSpMV for CUDA 12
nluehr Nov 10, 2022
6481f1a
Switch from CUSPARSE_CSR2CSC_ALG2 to CUSPARSE_CSR2CSC_ALG1 for CUDA >…
nluehr Nov 10, 2022
4ff3164
Replace csrGemmV2 with calls to SpGEMM APIs when compiling for CUDA 12.
nluehr Nov 10, 2022
4aa8b6f
Update algorithm enum sparse mat_mul_op for CUDA 12
nluehr Nov 16, 2022
25656bd
Bump NCCL version to 2.16.2 to support CUDA 12 and NVIDIA Hopper GPUs.
nluehr Dec 12, 2022
c3b2dbb
Update cudaGraph APIs for CUDA 12.
nluehr Dec 12, 2022
51cb95a
Reduce memory overheads in sparse-sparse matmul.
nluehr Jan 4, 2023
ae70777
Guard cuda_blas_utils include to fix ROCM build.
nluehr Jan 9, 2023
4a04c65
Load cupti dso using correct version.
nluehr Jan 10, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Load cupti dso using correct version. 
Fixes issue where minor version was incorrectly included in dso
name with cuda 12.
  • Loading branch information
@nluehr
nluehr committed Jan 10, 2023
commit 4a04c65383f333fc23d70dc72e8a76b605ccc465
3 changes: 2 additions & 1 deletion tensorflow/tsl/platform/default/dso_loader.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ namespace internal {
namespace {
string GetCudaVersion() { return TF_CUDA_VERSION; }
string GetCudaRtVersion() { return TF_CUDART_VERSION; }
string GetCuptiVersion() { return TF_CUPTI_VERSION; }
string GetCudnnVersion() { return TF_CUDNN_VERSION; }
string GetCublasVersion() { return TF_CUBLAS_VERSION; }
string GetCusolverVersion() { return TF_CUSOLVER_VERSION; }
Expand Down Expand Up @@ -113,7 +114,7 @@ StatusOr<void*> GetCurandDsoHandle() {

StatusOr<void*> GetCuptiDsoHandle() {
// Load specific version of CUPTI this is built.
auto status_or_handle = GetDsoHandle("cupti", GetCudaVersion());
auto status_or_handle = GetDsoHandle("cupti", GetCuptiVersion());
if (status_or_handle.ok()) return status_or_handle;
// Load whatever libcupti.so user specified.
return GetDsoHandle("cupti", "");
Expand Down
1 change: 1 addition & 0 deletions third_party/gpus/cuda/cuda_config.h.tpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ limitations under the License.

#define TF_CUDA_VERSION "%{cuda_version}"
#define TF_CUDART_VERSION "%{cudart_version}"
#define TF_CUPTI_VERSION "%{cupti_version}"
#define TF_CUBLAS_VERSION "%{cublas_version}"
#define TF_CUSOLVER_VERSION "%{cusolver_version}"
#define TF_CURAND_VERSION "%{curand_version}"
Expand Down
2 changes: 2 additions & 0 deletions third_party/gpus/cuda_configure.bzl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -869,6 +869,7 @@ filegroup(name="cudnn-include")
{
"%{cuda_version}": "",
"%{cudart_version}": "",
"%{cupti_version}": "",
"%{cublas_version}": "",
"%{cusolver_version}": "",
"%{curand_version}": "",
Expand Down Expand Up @@ -1333,6 +1334,7 @@ def _create_local_cuda_repository(repository_ctx):
{
"%{cuda_version}": cuda_config.cuda_version,
"%{cudart_version}": cuda_config.cudart_version,
"%{cupti_version}": cuda_config.cupti_version,
"%{cublas_version}": cuda_config.cublas_version,
"%{cusolver_version}": cuda_config.cusolver_version,
"%{curand_version}": cuda_config.curand_version,
Expand Down