Discussions

• 1 You must be logged in to vote

  🙏

  enable_input_require_grads is called twice with use_gradient_checkpointing=True and bnb quantisation; is there any effect?

  nzw0301 asked Apr 5, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Help Needed: Implementing QLoRA on AutoGPTQ Model - Unsupported Module Error

  SkanderGhariani asked Jun 14, 2024 in Q&A · Answered

  

  

  5
• 1 You must be logged in to vote

  🙏

  What are good configs for training UNet3DConditionModel on 8 GB VRAM? (64x64x64 inputs)

  RandomGamingDev asked Jun 3, 2024 in Q&A · Closed · Answered

  

  

  7
• 1 You must be logged in to vote

  🙏

  GPU Memory-Usage, full finetuning vs LoRA vs LoRA + CPU Offloading

  EthanChen1234 asked May 27, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does inference with a PEFT model require all merged LoRA models or just the final saved LoRA and the base model?

  BGFGB asked May 29, 2024 in Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  💬

  rslora guidance for alpha value?

  andysalerno started Jan 23, 2024 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there any reason not to use the tokenizer after applying LORA?

  seona21 asked May 16, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Trained layers with LoRA will be merged into model?

  lavinal712 asked May 12, 2024 in Q&A · Unanswered

  

  

  14
• 2 You must be logged in to vote

  🙏

  QLoRa with Vision Transformers

  anwai98 asked Apr 23, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I train the adalora about nn.Conv1d?

  girlsending0 asked Apr 11, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  Qlora + Deepspeed Zero3

  AnirudhVIyer started Apr 9, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  prompt-tuning & p-tuning with Seq2Seq2LM t5

  whdnjsdyd111 asked Apr 5, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  The multi-task prompt tuning of PEFT library

  lhyscau asked Mar 25, 2024 in Q&A · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  peft provides the position of the model input?

  ciaoyizhen asked Mar 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to train a custom model

  nguyenhoanganh2002 asked Mar 14, 2024 in Q&A · Answered

  

  

  12
• 1 You must be logged in to vote

  🙏

  What is the intended way of doing EMA with PEFT?

  samedii asked Mar 12, 2024 in Q&A · Answered

  

  

  10
• 2 You must be logged in to vote

  🙏

  Possible issue with whisper example notebook

  rosyvs asked Aug 1, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  What is the intended way of saving the base model when finetuning both an adapter and some layers in the base model?

  samedii asked Mar 9, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Vision Foundation Model deployment in the edge cases - How adapters will be useful to deploy VFM in the edge device?

  solomonmanuelraj started Dec 15, 2023 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Load and unload different LORAs during training

  antoni4040 asked Feb 14, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Resume training from a checkpoint with different hyperparameters when training with transformers

  jonflynng asked Feb 16, 2024 in Q&A · Unanswered

  

  

  1
• 4 You must be logged in to vote

  🙏

  Is there any way to extract lora adapter from merged model?

  tjtanaa asked Dec 5, 2023 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  💬

  Train Embedding Layer with LoRA

  RADxEEn started Feb 6, 2024 in General · Closed

  

  

  10
• 1 You must be logged in to vote

  🙏

  Multitask Prompt Tuning Confusion

  atastats asked Feb 1, 2024 in Q&A · Unanswered

  

  

  

  

  5
• 13 You must be logged in to vote

  💬

  Hallucinations with 8bit Whisper PEFT model - solved with full / half precision

  sanchit-gandhi started May 19, 2023 in General

  

  

  

  

  5