[go: nahoru, domu]
Skip to content
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
@StellaAthena
StellaAthena committed Sep 1, 2021
1 parent 00d8d70 commit 51078df
Showing 1 changed file with 8 additions and 8 deletions.
16 changes: 8 additions & 8 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -38,25 +38,25 @@ For more information on how to get these set up, see the colab notebook, or read

| Model and Size | Pile BPB | Pile PPL | Wikitext PPL | Lambada PPL | Lambada Acc | Winogrande | Hellaswag |
|------------------|------------|-----------|--------------|-------------|-------------|------------|------------|
| **GPT-Neo 125M** | | | 32.285 | 30.266 | 37.36% | 50.43% | 28.67% |
| GPT-3 124M | | | ----- | 18.6 | 42.7% | 52.0% | 33.7% |
| **GPT-Neo 350M** | | | 22.5657 | 13.876 | 47.27% | 51.14% | 32.16% |
| GPT-3 350M | | | ----- | 9.09 | 54.3% | 52.1% | 43.6% |
| **GPT-Neo 125M** | ----- | ----- | **32.285** | **30.266** | **37.36%** | **50.43%** | **28.67%** |
| GPT-3 124M | ----- | ----- | ----- | 18.6 | 42.7% | 52.0% | 33.7% |
| **GPT-Neo 350M** | ----- | ----- | **22.5657** | **13.876** | **47.27%** | **51.14%** | **32.16%** |
| GPT-3 350M | ----- | ----- | ----- | 9.09 | 54.3% | 52.1% | 43.6% |
| GPT-3 Ada | 0.9631 | ----- | ----- | 9.954 | 51.60% | 52.90% | 35.93% |
| **GPT-Neo 1.3B** | **0.7527** | **6.159** | **13.10** | **7.498** | **57.23%** | **55.01%** | **38.66%** |
| GPT-3 1.3B | | | ----- | 5.44 | 63.6% | 58.7% | 54.7% |
| GPT-3 1.3B | ----- | ----- | ----- | 5.44 | 63.6% | 58.7% | 54.7% |
| GPT-2 1.5B | 1.0468 | ----- | 17.48 | 10.634 | 51.21% | 59.40% | 40.03% |
| **GPT-Neo 2.7B** | **0.7165** | **5.646** | **11.39** | **5.626** | **62.22%** | **56.50%** | **42.73%** |
| GPT-3 2,7B | | | ----- | 4.60 | 67.1% | 62.3% | 62.8% |
| GPT-3 2.7B | ----- | ----- | ----- | 4.60 | 67.1% | 62.3% | 62.8% |


#### Physical and Scientific Reasoning

| Model and Size | MathQA | PubMedQA | Piqa |
|------------------|------------|------------|------------|
| **GPT-Neo 125M** | 22.78% | 55.10% | 63.06% |
| **GPT-Neo 125M** | **22.78%** | **55.10%** | **63.06%** |
| GPT-3 124M | ----- | ----- | 64.6% |
| **GPT-Neo 350M** | 23.45% | 53.80% | 65.07% |
| **GPT-Neo 350M** | **23.45%** | **53.80%** | **65.07%** |
| GPT-3 350M | ----- | ----- | 70.2% |
| GPT-3 Ada | 24.29% | 52.80% | 68.88% |
| **GPT-Neo 1.3B** | **24.05%** | **54.40%** | **71.11%** |
Expand Down

0 comments on commit 51078df

Please sign in to comment.