← All publications

Transferable Multi-Bit Watermarking Across Frozen Diffusion Models via Latent Consistency Bridges

Hong-Hanh Nguyen-Le , Van-Tuan Tran , Thuc D. Nguyen , Nhien-An Le-Khac

Co-first author

Second Workshop on Technical AI Governance Research (TAIGR 2026) · 2026

watermarkingdiffusion modelscontent provenanceAI governancelatent consistency models

As generative AI advances, global governance frameworks increasingly mandate verifiable content provenance. However, existing watermarking techniques face a critical policy-to-technology disconnect: sampling-based methods require computationally prohibitive inversion, while fine-tuning approaches are tethered to specific model checkpoints, hindering standardized, cross-model oversight. To bridge this gap, we introduce DiffMark, a plug-and-play multi-bit watermarking framework. DiffMark embeds a persistent, learned perturbation into every denoising step of a frozen diffusion model, accumulating a recoverable signal in the final latent space. To enable efficient training through the frozen network, we utilize Latent Consistency Models (LCMs) as a differentiable training bridge. DiffMark achieves 64-bit extraction in a single 16.4 ms forward pass, which is a 45× speed-up over inversion baselines. By enabling per-image key flexibility and cross-architecture transferability without retraining, DiffMark provides the practical, scalable technical tooling necessary to operationalize user accountability and enforce emerging AI governance mandates.