Discussions

• 1 You must be logged in to vote

  🙏

  load_weights_into_gpt Getting error Ch : 5

  question Further information is requested

  athul-22 asked Jun 17, 2024 in Q&A · Unanswered

  

  

  

  

  22
• 1 You must be logged in to vote

  💬

  How do you think about the interpretablity research?

  jingedawang started Jun 19, 2024 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  Will this book talk about RLHF?

  question Further information is requested

  jingedawang asked Jun 19, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  💡

  ch03/01_main-chapter-code/ch03.ipynb - Masked MHA

  d-kleine started May 28, 2024 in Ideas · Closed

  

  

  29
• 1 You must be logged in to vote

  🙏

  Questions about token level features and casual attention mechanism

  jingedawang asked Jun 19, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  ch06 - fine-tuning an LLM for binary classification task - add vs update output layer

  kevalshah90 asked Jun 2, 2024 in Q&A · Answered

  

  

  31
• 1 You must be logged in to vote

  #️⃣

  Which evaluation method to include in Chapter 7: Instruction finetuning

  rasbt started Jun 5, 2024 in Polls

  

  

  23
• 1 You must be logged in to vote

  🙏

  A comment on "ch05/01_main-chapter-code /ch05.ipynb"

  lasp73 asked Jun 9, 2024 in Q&A · Closed · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  loss function calculation and text_generation

  nicolaleo asked Apr 1, 2024 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  ch07 - OpenAI API key

  d-kleine started May 26, 2024 in Ideas · Closed

  

  

  6
• 3 You must be logged in to vote

  🙏

  pos_embedding_layer question

  nicolaleo asked Dec 28, 2023 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  ch06 - 02_bonus_additional-experiments

  d-kleine asked May 21, 2024 in Q&A · Closed · Answered

  

  

  15
• 12 You must be logged in to vote

  📣

  Chapter 6 now finally available

  rasbt announced May 31, 2024 in Announcements

  

  

  3
• 1 You must be logged in to vote

  💬

  Sixth chapter is unavailable on the Manning website*

  Finterio started May 27, 2024 in General · Closed

  

  

  8
• 1 You must be logged in to vote

  🙏

  MultiHeadAttention Module

  vamsikumbuf asked May 20, 2024 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  💡

  Folder names and restructuring

  d-kleine started Apr 9, 2024 in Ideas

  

  

  8
• 8 You must be logged in to vote

  📣

  Updated publication date: Summer 2024

  rasbt announced May 9, 2024 in Announcements

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  ch06 model overfitting comment

  nicolaleo asked May 7, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  💡

  suggestion of adding torch.profile

  frankchieng started May 7, 2024 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  Getting an error when running the code SelfAttentionv1(d_in,d_out)

  AIstatistican asked May 5, 2024 in Q&A · Answered

  

  

  8
• 1 You must be logged in to vote

  💬

  Handling zero batches in calc_loss_loader to avoid Division Errors.

  rmaestre started Apr 19, 2024 in General

  

  

  3
• 1 You must be logged in to vote

  🙌

  Offering Chinese Translation 我提供了一个中文翻译

  Intelligence-Manifesto started Mar 30, 2024 in Show and tell

  

  

  1
• 1 You must be logged in to vote

  🙏

  Replacing the LlamaDecoderLayer Class hugging Face With New LongNet

  younesselbrag asked Mar 31, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💬

  Simple and Scalable Strategies to Continually Pre-train Large Language Models

  rasbt started Mar 31, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  generate function with sampling without temperature rescaling

  nicolaleo started Mar 30, 2024 in General · Closed

  

  

  1