[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Does matmulfreellm support Windows 10? #22

Open
fangkuoyu opened this issue Jun 17, 2024 · 4 comments
Open

Does matmulfreellm support Windows 10? #22

fangkuoyu opened this issue Jun 17, 2024 · 4 comments

Comments

@fangkuoyu
Copy link

I have installed matmulfreellm with Triton for Windows via triton-2.0.0-cp310-cp310-win_amd64.whl which makes matmulfreellm work on the 'configuration' file but fail on the 'generate' file. The 'generate' file with 'ridger/MMfreeLM-370M' gets some problems at model.generate. A brief of error messages are

File "C:\Users\hp\Anaconda3\envs\mat_env\lib\subprocess.py", line 1457, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError:

printout executable and args are

None whereis libcuda.so

Does matmulfreellm supports Windows 10?

Some libraries are listed as follows.

torch              2.3.1+cu118
torchaudio         2.3.1+cu118
torchvision        0.18.1+cu118
transformers       4.41.2
triton             2.0.0
@ridgerchu
Copy link
Owner

Hi, we have not tested Windows 10 yet since the server we used are all Linux... You can try to upgrade triton to 2.2.0 and cuda to 12.2 or above

@fangkuoyu
Copy link
Author

@ridgerchu Thanks for your comments. I have upgraded to Triton 2.1.0 for Windows (triton-2.1.0-cp310-cp310-win_amd64.whl). However, the system still doesn't work. I haven't found Trion 2.2.0 for Windows yet. I will suspend my test for now. Do you have any plans to support Windows officially?

@ridgerchu
Copy link
Owner

It depends when the triton 2.2.0 for windows release I think, without 2.2.0 this repo cannot work well

@fangkuoyu
Copy link
Author

@ridgerchu Got it. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@fangkuoyu @ridgerchu