Build Results

BLEU SCORE SACREBLEU
MODEL CODE PAPER
ε-REPR
CODE PAPER
ε-REPR
PAPER
ConvS2S
31.45 -- 35.16 --
DynamicConv
37.64 -- 37.58 --
DynamicConv
(without GLUs)
38.28 -- 37.93 --
LightConv
36.63 -- 36.53 --
LightConv
(without GLUs)
37.78 -- 37.51 --
Transformer Big
32.76 -- 32.61 --
BLEU SCORE SACREBLEU
MODEL CODE PAPER
ε-REPR
CODE PAPER
ε-REPR
PAPER
ConvS2S
22.81 25.16 25.17 --
DynamicConv
29.10 29.70 28.49 --
DynamicConv
(without GLUs)
29.17 -- 28.42 --
LightConv
29.17 28.90 28.62 --
LightConv
(without GLUs)
28.44 -- 27.80 --
Transformer Big
25.39 29.30 24.77 --