Build Results

BLEU SCORE SACREBLEU
MODEL CODE PAPER
ε-REPR
CODE PAPER
ε-REPR
PAPER
ConvS2S
35.34 -- 30.89 --
DynamicConv
37.64 -- 37.73 --
DynamicConv
(without GLUs)
38.28 -- 37.93 --
LightConv
36.63 -- 36.53 --
LightConv
(without GLUs)
37.78 -- 37.51 --
Transformer Big
32.76 -- 32.61 --
BLEU SCORE SACREBLEU
MODEL CODE PAPER
ε-REPR
CODE PAPER
ε-REPR
PAPER
ConvS2S
22.81 25.16 22.34 --
DynamicConv
29.76 29.70 28.49 --
DynamicConv
(without GLUs)
29.17 -- 28.42 --
LightConv
29.17 28.90 28.62 --
LightConv
(without GLUs)
28.44 -- 27.80 --
Transformer Big
25.39 29.30 24.77 --