RDJSCC: Robust Deep Joint Source-Channel Coding Enabled Distributed Image Transmision with Imperfect Channel State Information

RDJSCC

Robust Deep Joint Source-Channel Coding Enabled Distributed Image Transmision

Harbin Institute of Technology, Shenzhen
Nanjing University of Posts and Telecommunications

In this paper, we investigate the lossy access of correlated source in the scenario of distributed deep joint source-channel coding (DJSCC). Based on characteristic that the mismatched or low-correlated source can lead to a degradation of transmission performance. We propose a robust DJSCC (RDJSCC) scheme to maximize the advantages of distributed DJSCC in noisy environments. Unlike exiting methods, RDJSCC explores the trade-off between complementarity and consistency of the correlated source. Accordingly, novel cross-view information extraction (CVIE) mechanism and complementarity-consistency fusion (CCF) mechanism are developed in RDJSCC to upgrade distributed DJSCC. Information-theoretic analysis proves the rationality of exploring the above trade-off. Simulation results show that our proposed RDJSCC can effectively leverage the advantages of correlated sources even under severe fading conditions, leading to an improved reconstruction performance.

Overview

pipeline

Transmission Performance

We use PSNR, MS-SSIM and LPIPS to comprehensively evaluate the multi-view image transmission performance of the proposed model.

PSNR under Cityscape
PSNR results animated
MS-SSIM under Cityscape
MS-SSIM results animated
LPIPS under Cityscape
LPIPS results animated

Some Discussions and Analysis

Ablation Study, PAPR Reduction and Dynamic Weight

Ablation Study
PSNR results animated
PAPR Reduction
MS-SSIM results animated
Dynamic Weight
LPIPS results animated

Visual Comparison

pipeline

Acknowledgements

This website is inspired by the template of Pixel Nerf and NTSCC++. Please send any questions or comments to dongbiao26@gmail.com .