图片: TextBox整体框架
图片: TextBox整体框架
| 类别 | 模型 | 引用 |
|---|---|---|
| VAE | LSTMVAE | (Bowman et al., 2016) |
| CNNVAE | (Yang et al., 2017) | |
| HybridVAE | (Semeniuta et al., 2017) | |
| CVAE | (Li et al., 2018) | |
| GAN | SeqGAN | (Yu et al., 2017) |
| TextGAN | (Zhang et al., 2017) | |
| RankGAN | (Lin et al., 2017) | |
| MaliGAN | (Che et al., 2017) | |
| LeakGAN | (Guo et al., 2018) | |
| MaskGAN | (Fedus et al., 2018) | |
| PLM | GPT-2 | (Radford et al., 2019) |
| XLNet | (Yang et al., 2019) | |
| BERT2BERT | (Rothe et al., 2020) | |
| BART | (Lewis et al., 2020) | |
| T5 | (Raffel et al., 2020) | |
| ProphetNet | (Qi et al., 2020) | Seq2Seq | RNN | (Sutskever et al., 2014) |
| Transformer | (Vaswani et al., 2017b) | |
| Context2Seq | (Tang et al., 2016) | |
| Attr2Seq | (Dong et al., 2017) | |
| HRED | (Serban et al., 2016) |
| 任务 | 数据集 |
|---|---|
| Unconditional | Image COCO Caption |
| EMNLP2017 WMT News | |
| IMDB Movie Review | |
| Translation | IWSLT2014 German-English |
| WMT2014 English-German | |
| Summarization | GigaWord |
| Dialog | Persona Chat |
| Attribute to Text | Amazon Electronic |
| Poem Generation | Chinese Classical Poetry Corpus |
| 模型 | 实例 |
|---|---|
| RNNVAE | people playing polo to eat in the woods . |
| LeakGAN | a man is standing near a horse on a lush green grassy field . |
| GPT-2 | cit a large zebra lays down on the ground. |
| 模型 | 实例 |
|---|---|
| RNNVAE | lewis holds us in total because they have had a fighting opportunity to hold any bodies when companies on his assault . |
| LeakGAN | we ' re a frustration of area , then we do coming out and play stuff so that we can be able to be ready to find a team in a game , but I know how we ' re going to say it was a problem . |
| GPT-2 | russ i'm trying to build a house that my kids can live in, too, and it's going to be a beautiful house. |
| 模型 | 实例 |
|---|---|
| RNNVAE | best brilliant known plot , sound movie , although unfortunately but it also like . the almost five minutes i will have done its bad numbers . so not yet i found the difference from with |
| LeakGAN | i saw this film shortly when I storms of a few concentration one before it all time . It doesn t understand the fact that it is a very good example of a modern day , in the <|unk|> , I saw it . It is so bad it s a <|unk|> . the cast , the stars , who are given a little |
| GPT-2 | be a very bad, low budget horror flick that is not worth watching and, in my humble opinion, not worth watching any time. the acting is atrocious, there are scenes that you could laugh at and the story, if you can call it that, was completely lacking in logic and |
| Model | ROUGE-1 | ROUGE-2 | ROUGE-L | ROUGE-W |
|---|---|---|---|---|
| RNN with Attention | 36.32 | 17.63 | 38.36 | 25.08 |
| Transformer | 36.21 | 17.64 | 38.10 | 24.89 |
| BART | 39.34 | 20.07 | 41.25 | 27.13 |
| BERT2BERT | 38.16 | 18.89 | 40.06 | 26.21 | ProphetNet | 38.49 | 18.41 | 39.84 | 26.12 | T5 | 38.83 | 19.68 | 40.76 | 26.73 |
| 文章 | japan 's nec corp. and computer corp. of the united states said wednesday they had agreed to join forces in supercomputer sales . |
| 真实摘要 | nec in computer sales tie-up |
| RNN with Attention | nec computer corp . |
| Transformer | nec computer to join forces in chip sales | BART | nec computer corp. | BERT2BERT | nec computer form alliance for supercomputer sales | ProphetNet | nec computer to join forces in supercomputer sales | T5 | nec computer to join forces in supercomputer sales |
| 模型 | 解码策略 | BLEU-2 | BLEU-3 | BLEU-4 | BLEU |
|---|---|---|---|---|---|
| RNN with Attention | Top-k sampling | 26.68 | 16.95 | 10.85 | 19.66 |
| Greedy search | 33.74 | 23.03 | 15.79 | 26.23 | |
| Beam search | 35.68 | 24.94 | 17.42 | 28.23 | |
| Transformer | Top-k sampling | 30.96 | 20.83 | 14.16 | 23.91 |
| Greedy search | 35.48 | 24.76 | 17.41 | 28.10 | |
| Beam search | 36.88 | 26.10 | 18.54 | 29.49 | |
| BART | Beam search | 29.02 | 19.58 | 13.48 | 22.42 | BERT2BERT | Beam search | 27.61 | 18.41 | 12.46 | 21.07 |
| 源语言（德语） | wissen sie , eines der großen < unk > beim reisen und eine der freuden bei der < unk > forschung ist , gemeinsam mit den menschen zu leben , die sich noch an die alten tage erinnern können . die ihre vergangenheit noch immer im wind spüren , sie auf vom regen < unk > steinen berühren , sie in den bitteren blättern der pflanzen schmecken . |
| 真实目标语言（英语） | you know , one of the intense pleasures of travel and one of the delights of < unk > research is the opportunity to live amongst those who have not forgotten the old ways , who still feel their past in the wind , touch it in stones < unk > by rain , taste it in the bitter leaves of plants . |
| RNN with Attention | you know , one of the great < unk > trips is a travel and one of the friends in the world & apos ; s investigation is located on the old days that you can remember the past day , you & apos ; re < unk > to the rain in the < unk > chamber of plants . |
| Transformer | you know , one of the great < unk > about travel , and one of the pleasure in the < unk > research is to live with people who remember the old days , and they still remember the wind in the wind , but they & apos ; re touching the < unk > . |
| Model | Distinct-1 | Distinct-2 | BLEU-1 | BLEU-2 | BLEU-3 | BLEU-4 |
|---|---|---|---|---|---|---|
| RNN with Attention | 0.24 | 0.72 | 17.51 | 4.65 | 2.11 | 1.47 |
| Transformer | 0.38 | 2.28 | 17.29 | 4.85 | 2.32 | 1.65 |
| HRED | 0.22 | 0.63 | 17.29 | 4.72 | 2.20 | 1.60 |
| Model | Distinct-1 | Distinct-2 | BLEU-1 | BLEU-2 | BLEU-3 | BLEU-4 |
|---|---|---|---|---|---|---|
| Context2Seq | 0.07 | 0.39 | 17.21 | 2.80 | 0.83 | 0.43 |
| Attr2Seq | 0.14 | 2.81 | 17.14 | 2.81 | 0.87 | 0.48 |