huggingface / transformers

No successful builds yet. Click here to see all builds.

How the Repository is Evaluated

The full sotabench.py file - source
STATUS
BUILD
COMMIT MESSAGE
RUN TIME
Merge branch 'master' of https://github.com/huggingface/transfor…
PiotrCzapla   7c4cc1c  (+297 commits )  ·  Nov 08 2019
unknown
unknown
unknown
Remove `.eval` and use evaluation loop explicitly
PiotrCzapla   df27a94  ·  Oct 09 2019
unknown
unknown
unknown
Clean up sotabench_setup.sh
PiotrCzapla   d2c7d85  ·  Oct 08 2019
unknown
Move sotabench files to sotabench/
PiotrCzapla   f54f739  ·  Oct 04 2019
unknown
Add distilgpt2 + model selection via env var MODEL
PiotrCzapla   ad2e7b4  ·  Oct 04 2019
unknown
Fix distilbert and rename langauge_model[l]ing
PiotrCzapla   c35b5fe  (+42 commits )  ·  Oct 04 2019
unknown
disable DistilBert temporarliy
PiotrCzapla   ae970ba  ·  Oct 04 2019
unknown
fix squad
PiotrCzapla   009b71b  ·  Oct 03 2019
unknown
Add cache support & more squad models
PiotrCzapla   f2b9f75  ·  Oct 03 2019
unknown
Update to latest sotabench-eval
PiotrCzapla   af884ec  ·  Oct 03 2019
unknown
fully disable cache & first batch calc.
PiotrCzapla   35e8751  ·  Oct 02 2019
unknown
Disable cache in squad for the time being
PiotrCzapla   6b50a88  ·  Oct 02 2019
unknown
Fix broken pretrained model names
PiotrCzapla   0a319de  ·  Oct 02 2019
unknown
add fixed sotabench squad
PiotrCzapla   e57d472  ·  Oct 02 2019
unknown
Remove squad from sotabench.py to see wikitext results
PiotrCzapla   326c8b9  ·  Oct 02 2019
unknown
Temporarliy copy original uils_squad files.
PiotrCzapla   a5f0969  (+2 commits )  ·  Oct 02 2019
unknown
Remove TensorbordX deps
PiotrCzapla   919da8b  ·  Oct 02 2019
unknown
Fix missing force_full_run
PiotrCzapla   c689aff  ·  Oct 02 2019
unknown
Fix missing modules in squad.py
PiotrCzapla   9436a67  ·  Oct 02 2019
unknown
Add crud quad evaluator
PiotrCzapla   0ed3267  ·  Oct 02 2019
unknown
unknown
Rename sotabench.sh back to _setup.sh
PiotrCzapla   5bebbaf  ·  Oct 02 2019
unknown
change sotabench_setup to sotabench
PiotrCzapla   af01520  ·  Oct 02 2019
unknown
Temp sotabenc_scripts folder
PiotrCzapla   abe74c1  ·  Oct 02 2019
unknown
unknown
unknown
move sotabench.py to sotabench folder
PiotrCzapla   426204e  ·  Oct 02 2019
unknown
Clean up imports and remove XLNet
PiotrCzapla 9ae6f57    0eb7d2f  ·  Oct 02 2019
unknown
# 9
XLNet fixes
PiotrCzapla   6bf7f73  ·  Oct 01 2019
unknown
# 8
Final fix to the wikitext extraction?
PiotrCzapla   a82971e  ·  Oct 01 2019
unknown
# 7
Dataset setup fix, gpt2 large batch size=1
PiotrCzapla   1934d82  ·  Oct 01 2019
unknown
# 6
fix sotabench setup + add more models
PiotrCzapla   8663259  ·  Oct 01 2019
unknown
# 5
fixes to sotabench_setup.sh
PiotrCzapla   ea3fbb4  ·  Oct 01 2019
unknown
# 4
Fix to sotabench setup to unzip data and install torch
PiotrCzapla   a652120  ·  Oct 01 2019
unknown
# 3
add torch installation
PiotrCzapla   41c2da5  ·  Oct 01 2019
unknown
# 2
Fix sotabench setup
PiotrCzapla   573cbe4  ·  Oct 01 2019
unknown
# 1
Add downloading of datasets
PiotrCzapla   76c010a  ·  Oct 01 2019
unknown
# 0
unknown