Skip to content

Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.

License

Notifications You must be signed in to change notification settings

bansky-cl/Diffusion_NLP_Papers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

65 Commits
 
 
 
 

Repository files navigation

Diffusion_in_NLP_Papers

Key information in this table:

  • Model = Model's name or shorthand.
  • Date = Arxiv or other first E-print release date.
  • Author = First author's name.
  • Accepted = Accepted at a famous proceeding or journal.
  • Code = Official Github or unofficial implementation, maybe is empty at the moment.
  • Paperlink = Arxiv or official link.

[Last updated: 2024-11-14]

Model Date Author Code Accepted Paper
2024.10 Ren How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework
DiffLM 2024.10 Zhou DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
DiffuLLaMA 2024.10 Gong github Scaling Diffusion Language Models via Adaptation from Autoregressive Models
Meta-DiffuB 2024.10 Chuang github NeurIPS 2024 Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration
REPA 2024.10 Yu github Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think
DiffusionCLS 2024.9 Chen github EMNLP 2024 An Effective Deployment of Diffusion LM for Data Augmentation in Low-Resource Sentiment Classification
FMSeq 2024.9 Liu null EMNLP 2024 Enable Fast Sampling for Seq2Seq Text Diffusion
20249.9 Zheng Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
ReflectDiffu 2024.9 Yuan ReflectDiffu: Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework
SpecDiff 2024.8 Christopher Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
SEDD 2023.10 Lou github ICML 2024 Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
2024.7 Lovelace github ACL 2024 Diffusion Guided Language Modeling
GDP 2024.7 Zhu null ACL 2024 Pinpointing Diffusion Grid Noise to Enhance Aspect Sentiment Quad Prediction
DiffusPoll 2024.7 Cheng github ACL 2024 DiffusPoll: Conditional Text Diffusion Model for Poll Generation
2024.4 Zhang github COLM 2024 Forcing Diffuse Distributions out of Language Models
RADD 2024.6 Ou github Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data
MDLM 2024.6 Sahoo github ICML 2024 Simple and Effective Masked Diffusion Language Models
2024.7 Discrete Diffusion Language Model for Long Text Summarization
2024.6 Deschenaux Promises, Outlooks and Challenges of Diffusion Language Modeling
DIFFGLAT 2024.6 Qian NAACL 2024 Diffusion Glancing Transformer for Parallel Sequence-to-Sequence Learning
P3Sum 2024.6 Liu github NAACL 2024 P3Sum: Preserving Author’s Perspective in News Summarization with Diffusion Language Models
DiffusionDialog 2024.4 Xiang github LREC-COLING 2024 DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space
LDP 2024.4 Zou github Enforcing Paraphrase Generation via Controllable Latent Diffusion
LanguageFlow 2024.3 Zhang NAACL 2024 LanguageFlow: Advancing Diffusion Language Generation with Probabilistic Flows
FlowSeq 2024.3 Hu github EACL 2024 Flow Matching for Conditional Text Generation in a Few Sampling Steps
IPED 2024.3 Zhao null NAACL 2024 IPED: An Implicit Perspective for Relational Triple Extraction based on Diffusion Model
TEncDM 2024.2 Shabalin TEncDM: Understanding the Properties of Diffusion Model in the Space of Language Model Encodings
DiffuCOMET 2024.2 Gao github ACL 2024 DiffuCOMET: Contextual Commonsense Knowledge Diffusion
DiffusionABSA 2024.2 Liu github LREC-COLING 2024 Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models
TREC 2024.2 Liu AAAI 2024 Text Diffusionwith Reinforced Conditioning
Thinker-DDM 2024.2 Nachmani Rethinking Human-like Translation Strategy: Integrating Drift-Diffusion Model with Large Language Models for Machine Translation
QE-CDLM 2024.2 Kang github Quantized Embedding Vectors for Controllable Diffusion Language Models
DoT 2024.2 Ye github Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
AR2Diff 2024.1 Han Transfer Learning for Text Diffusion Models
ROIC-DM 2024.1 Yuan ROIC-DM: Robust Text Inference and Classification via Diffusion Model
LDSeq 2023.12 Ding CSAI 2023 LDSeq: Latent Diffusion Models for Sequence to Sequence Text Generation
CodeFusion 2023.12 Singh github EMNLP 2023 CodeFusion: A Pre-trained Diffusion Model for Code Generation
DWGF 2023.10 Shi github EMNLP 2023 A Diffusion Weighted Graph Framework for New Intent Discovery
ScanDL 2023.10 Bolliger github EMNLP 2023 ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts
DeTiME 2023.10 Xu github EMNLP 2023 DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM
InfoDiffusion 2023.10 Wang github EMNLP 2023 InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation
DiffuSeq-v2 2023.10 Gong github EMNLP 2023 DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models
Diffusionllm 2023.8 Ye github Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning
ParaGuide 2023.8 Horvitz github AAAI 2024 ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer
Diff-KPE 2023.8 Luo LREC-COLING 2024 Enhancing Phrase Representation by Information Bottleneck Guided Text Diffusion Process for Keyphrase Extraction
XDLM 2023.7 Chen github XDLM: Cross-lingual Diffusion Language Model for Machine Translation
2023.7 Wang github ECAI 2023 How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data?
PLANNER 2023.6 Zhang github NeurIPS 2023 PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
PoetryDiffusion 2023.6 Hu github AAAI 2024 PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generation
DiffuDetox 2023.6 Floto github ACL 2023 DiffuDetox: A Mixed Diffusion Model for Text Detoxification
BG-diffusion 2023.6 Tang github ACL 2023 Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!
DIFFUSEMP 2023.6 Bi github ACL 2023 DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation
SIDDMs 2023.6 Xu NeurIPS 2023 Semi-Implicit Denoising Diffusion Models
2023.5 Zou A Survey of Diffusion Models in Natural Language Processing
TESS 2023.5 Mahabadi github EACL 2024 TESS: Text-to-Text Self-Conditioned Simplex Diffusion
Diffusion-NAT 2023.5 zhou EACL 2024 Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation
DiffuSum 2023.5 Zhang github ACL 2023 DiffuSum: Generation Enhanced Extractive Summarization with Diffusion
AR-Diffusion 2023.5 Wu github NeurIPS 2023 AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
DiffuSeq_StylePTB 2023.5 Lyu github ACL 2023 Fine-grained Text Style Transfer with Diffusion-Based Language Models
2023.5 Li github IJCAI 2023 Diffusion Models for Non-autoregressive Text Generation: A Survey
SSD-2 2023.5 Han null NAACL 2024 David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs
Plaid 2023.5 Gulrajani github NeurIPS 2023 Likelihood-Based Diffusion Language Models
GlyphDiffusion 2023.4 Li GlyphDiffusion: Text Generation as Image Generation
Masked-Diffuse LM 2023.4 Chen github EMNLP 2023 A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
RDM 2023.2 Zheng github COLM 2024 A reparameterized discrete diffusion model for text generation
ControlNet 2023.2 Zhang github ICCV 2023 Adding Conditional Control to Text-to-Image Diffusion Models
DINOISER 2023.2 Ye github TACL 2024 DINOISER: diffused conditional sequence learning by manipulating noises
2023.2 Pidstrigach Infinite-Dimensional Diffusion Models for Function Spaces
SeqDiffuSeq 2022.12 Yuan github NAACL 2024 Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation
LD4LG 2022.12 Lovelace github NeurIPS 2023 Latent Diffusion for Language Generation
GENIE 2022.12 Lin github ICML 2023 Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise
Difformer 2022.12 Gao github NAACL 2024 Empowering Diffusion Models on the Embedding Space for Text Generation
SED 2022.11 Strudel github Self-conditioned Embedding Diffusion for Text Generation
DiffusionBERT 2022.11 He github ACL 2023 DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
CDCD 2022.11 Dieleman unofficial Continuous diffusion for categorical data
DiffusER 2022.10 Reid null ICLR 2023 DiffusER: Discrete Diffusion via Edit-based Reconstruction
SSD-LM 2022.10 Han github ACL2023 Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
DiffuSeq 2022.10 Gong github ICLR 2023 DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
2022.9 Yang github ACM Computing Surveys Diffusion Models: A Comprehensive Survey of Methods and Applications
LatentOps 2022.8 Liu github EMNLP 2023 Composable Text Controls in Latent Space with ODEs
Bit Diffusion 2022.8 Chen github ICLR 2023 Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
Classifier-Free 2022.7 Ho github NeurIPS 2021 Classifier-Free Diffusion Guidance
Diffusion-LM 2022.5 Li github NeurIPS 2022 Diffusion-LM Improves Controllable Text Generation
SUNDAE 2021.12 Savinov unofficial ICLR 2022 Step-unrolled Denoising Autoencoders for Text Generation
LDM 2021.12 Rombach github CVPR 2022 High-Resolution Image Synthesis with Latent Diffusion Models
2021.11 Nachmani Zero-Shot Translation using Diffusion Models
ARDM 2021.10 Hoogeboom github ICLR 2022 Autoregressive Diffusion Models
VDM 2021.7 Kingma github NeurIPS 2021 Variational Diffusion Models
D3PMs 2021.7 Austin unofficial NeurIPS 2021 Structured Denoising Diffusion Models in Discrete State-Spaces
Classifier-guidance 2021.5 Dhariwal github NeurIPS 2021 Diffusion Models Beat GANs on Image Synthesis
IDDPM 2021.2 Nichol github ICML 2021 Improved Denoising Diffusion Probabilistic Models
Argmax Flows 2021.2 Hoogeboom github NeurIPS 2021 Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
TimeGrad 2021.1 Rasul github ICML 2021 Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
DDIM 2020.10 Song github ICLR 2021 Denoising Diffusion Implicit Models
DDPM 2020.6 Ho github NeurIPS 2020 Denoising Diffusion Probabilistic Models

If you find any mistakes or have additional information, you can contact the author by E-mail and I will take the time to update the information.

About

Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published