[HIPIFY][8.0][FILE][feature][Linux] Initial support of cuFile to hipFile hipification

[derobins]

AIROCFILE-7
AIROCFILE-15

Adds types and API calls from ROCm/hipFile:

• hipfile/include/hipfile.h

[derobins]

We just used version placeholders, so this will probably need some fixing.

[ranapratap55]

Suggested change

	const string sHIPFILE = "cuFile_API_supported_by_HIP";
	const string sHIPFILE_md = sHIPFILE + md_ext;
	const string sHIPFILE_csv = sHIPFILE + csv_ext;
	const string sHIPFILE_and_ROC_md = sHIPFILE + sandROC + md_ext;
	const string sHIPFILE_and_ROC_csv = sHIPFILE + sandROC + csv_ext;
	const string sROCFILE = "cuFile_API_supported_by_ROC";
	const string sROCFILE_md = sROCFILE + md_ext;
	const string sROCFILE_csv = sROCFILE + csv_ext;
	const string sCUFILE = "cuFile";
	const string sHIPFILE = "cuFile_API_supported_by_HIP";

Could we keep same format as before?

[derobins]

How is the format different? I think I just copied one of the other libraries that has both hip and roc flavors (perhaps hipSolver/rocSover) because we have both hipFile and rocFile and would like to support both.

[emankov]

I guess the request was to keep the existing formatting.

[ranapratap55]

How is the format different? I think I just copied one of the other libraries that has both hip and roc flavors (perhaps hipSolver/rocSover) because we have both hipFile and rocFile and would like to support both.

Suggested change

	const string sHIPFILE = "cuFile_API_supported_by_HIP";
	const string sHIPFILE_md = sHIPFILE + md_ext;
	const string sHIPFILE_csv = sHIPFILE + csv_ext;
	const string sHIPFILE_and_ROC_md = sHIPFILE + sandROC + md_ext;
	const string sHIPFILE_and_ROC_csv = sHIPFILE + sandROC + csv_ext;
	const string sROCFILE = "cuFile_API_supported_by_ROC";
	const string sROCFILE_md = sROCFILE + md_ext;
	const string sROCFILE_csv = sROCFILE + csv_ext;
	const string sCUFILE = "cuFile";
	const string sHIPFILE = "cuFile_API_supported_by_HIP";

I meant to use existing format.

[derobins]

Is this all okay now?

[emankov]

@derobins, could you please let us know the first CUDA version in which gds-nvidia-fs (with cuFile in it) appeared in the CUDA Toolkit Linux distribution?

[derobins]

@derobins, could you please let us know the first CUDA version in which gds-nvidia-fs (with cuFile in it) appeared in the CUDA Toolkit Linux distribution?

It looks like cuFile was released with CUDA 11.4.0. I don't see a cuFile section in the 11.3.x docs. It's confusing, though - 11.3 and 11.2 mention the library and header file in the list of things that are included, but there's no API documentation. Maybe the answer is 11.2?

https://docs.nvidia.com/cuda/archive/11.4.0/cufile-api/index.html

We'll have to grab header files from the various CUDA releases to see how the API has evolved and when new API calls were introduced.

[emankov]

@derobins, I'll detect the former versions in the fs releases a bit later.

[emankov]

{HIP_8000, HIP_0, HIP_0, HIP_8000}},,
or
{HIP_7000, HIP_0, HIP_0}},,
if hipFile were really shipped with HIP 7.0.0

[derobins]

HIP_8000 is probably the right value, but the enum stops at HIP_7020 and I don't see any HIPIFY branches that look like they are prep for ROCm 8.0.