You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, we haven't considered this approach yet, but it might be possible to address it through continued pre-training. This could potentially allow us to adapt existing models to the matmulfreellm framework. However, further research and experimentation would be needed to determine the feasibility and effectiveness of such an approach.
I came across another repo https://github.com/astramind-ai/BitMat/tree/main, They convert existing models to 1.58bit. Would something similar be possible with matmulfreellm.
The text was updated successfully, but these errors were encountered: