On Achievable Distortion in Sending Gaussian Sources over a Bandwidth-Matched Gaussian MAC with No Transmitter CSI

This paper investigates the minimum mean square error (MMSE) of communicating a pair of Gaussian sources over a a bandwidth-matched Gaussian multiple-access channel with block Rayleigh fading in the absence of channel state information (CSI) at the transmitters. The achievable MMSE is not known. To this end, we derive several upper-bounds to the minimum achievable average MMSE as a function of the transmitter powers, the average channel fading power-to-noise ratio, and the correlation coefficient of the two sources. To derive nontrivial upper bounds which improve on those of separate source-channel coding and uncoded transmission, we incorporate ideas from joint source-channel coding and hybrid digital–analog coding to construct specific coding schemes for which the achievable MMSE can be determined.


Introduction
An important problem in wireless communication is the design of systems that are robust against random variations in the channel signal-to-noise ratio (CSNR) caused by fading. If the channel response can be measured at both transmitter and receiver prior to transmitting each codeword and the channel remains stationary during the transmission of a codeword, adaptive transmitters and receivers can be used to achieve optimal communication. Although the receiver adaptation is feasible in most cases, the transmitter adaptation can be impractical in some cases. An obvious case is a single transmitter communicating with multiple receivers over a broadcast channel (BC). Another case is multiple transmitters communicating with a common receiver over a multiple-access channel (MAC) where the individual transmitters have no access to the respective CSNRs observed at the receiver. An important practical application of the latter case is a wireless sensor network (WSN) [1], where possibly correlated, sampled analog signals sensed at multiple locations are transmitted to a single receiver over a MAC [2]. The work presented in this paper is an attempt to characterize the theoretical limits to performance achievable in transmitting a pair of sampled Gaussian sources over a Gaussian MAC (GMAC) to a common receiver. More specifically, the basic question of interest is, "what is the total minimum mean square error (MMSE) with which we can reconstruct at a common receiver, a pair of Gaussian sources transmitted over a two-user power-limited GMAC with block fading, when the receiver knows the channel state information (CSI) but the transmitters only have prior knowledge of the distribution of CSI?" The problem involves averaging the achievable MMSE for a given channel state over the CSI distribution. A complete answer to this question remains an open problem. In this paper, we partially answer this question by considering certain coding schemes for which the MMSE can be computed. The answer to our question partly depends on whether or not the two sources are the uncoded transmission is optimal regardless of the CSNR [12], whereas the SSC coding is suboptimal. This result is not surprising if one considers the fact that, for a single memoryless Gaussian source and a memoryless Gaussian channel with identical bandwidths, the uncoded transmission is optimal [13].
The trade-off between the energy per channel use and the achievable distortion in transmission of two correlated Gaussian sources over a NF-GMAC is studied in [14]. The focus in [14] is the minimum transmit energy pairs, which can achieve a given distortion pair with no restriction on the source-channel bandwidth ratio. Interestingly, the analysis in [14] reveals that, with no feedback from the receiver to the transmitters, uncoded transmission is more energy efficient than SSC coding for sufficiently large distortion targets.

Main Contributions
This paper derives a number of upper-bounds to the average MMSE, referred to as the fading-averaged MMSE (FA-MMSE), achievable in sending a pair of Gaussian sources over a GMAC with Rayleigh-fading and no transmit-side CSI, as a function of transmitter powers, average channel fading power-to-noise ratio, and source correlation coefficient. We refer to the MMSE in this case as the distortion power function (DPF) for Gaussian sources and GMAC. What is derived here are the upper bounds of the unknown DPF.
1. The obvious and relatively straightforward to-determine upper-bounds to the DPF are the FA-MMSEs, which are achievable with uncoded transmission and SSC coding. In this paper, we derive an alternative bound by considering conventional hybrid digital-analog (HDA) coding, wherein vector quantization error in conventional digital coding is transmitted in analog form by superposition. As expected, the numerical results show that, for uncorrelated sources, HDA coding improves on both SSC coding and uncoded transmission. For correlated sources, uncoded transmission has an advantage over HDA coding at low CSNRs where digital coding frequently suffers receiver outages due to lack of CSI at the the transmitters. 2. It is shown in [10] that when the sources are correlated and the GMAC is fixed (no fading), although uncoded transmission of the sources over the GMAC is optimal at SNRs below a threshold determine by the source correlation, the uncoded transmission of vector quantized sources directly over the GMAC (JSC-VQ) is asymptotically (as the CSNR approaches infinity) optimal. Furthermore, it has been shown that this scheme, when enhanced with a superimposed uncoded transmission of the sources (HDA-JSC-VQ), is nearly optimal at all CSNRs. Based on these observations, we derive two upper bounds to the DPF for the fading GMAC, referred as the JSC-VQ bound and HDA-JSC-VQ bound, respectively. Although these bound do not have expressions that can be readily interpreted, they can be numerically computed. It is observed that JSC-VQ and HDA-JSC-VQ bounds are not significantly different, regardless of the source correlation. However, the comparison of these bounds with the distortion bound for SSC coding shows a gap that grows with source correlation and CSNR. Although there exists a gap even when the sources are uncorrelated, this gap is relatively much smaller. The HDA-JSC-VQ bound established here is the lowest known upper bound to unknown DPF. It is shown that, for highly correlated sources and under low average CSNRs, uncoded transmission can achieve performance approaching the HDA-JSC-VQ bound.

Problem Definition
We begin with a formal statement of the basic problem addressed in this paper. Suppose we observe two continuous-valued information sources, S 1 and S 2 , at different locations and there is no communication link between the two locations. We wish to communicate and reproduce these two sources at a central location, where the communication takes place over a wireless channel modeled by a two-to-one GMAC with block Rayleigh fading (BF-GMAC). The fading gains of the GMAC are known to the receiver, but are not known to the the respective transmitters. Each source is a circularly symmetric complex-valued Gaussian variable, S i ∈ C, with mean zero, variance of E{|S i | 2 } = σ 2 , and the correlation E{S * 1 S 2 } = ρσ 2 , where |ρ| < 1. A sequence of n samples from the source S i , denoted by S S S i = (S i,1 , . . . , S i,n ), is assumed to be independent and identically distributed (iid). Our interest in this paper is the transmission of a sequence of n source samples in n uses of the GMAC.
The encoder for source S i is therefore a mapping f (n) i : C n → C n , where the channel codeword X X X i = (X i,1 , . . . , X i,n ) is given by and X i,k ∈ C is the channel input for S i at time k = 1, . . . , n (the superscript in f (n) i emphasizes the fact that each encoder is a block-encoder for n connective source samples.) The transmitter for S i has an average power constraint, P i , so that Let the GMAC output for the input codeword pair (X X X 1 , h i,k ∈ C is the gain of the channel between S i and the receiver at time k and W k ∈ C is complex-valued channel noise. As usual, it is assumed that (h 1,k , h 2,k ) are iid complex Gaussian random variables with mean zero and independent real and complex parts. In a BF-GMAC, h 1,k and h 2,k remain constant during the transmission of a length n codeword. Therefore, henceforth we will drop the time index, k, denote the channel gains by h 1 and h 2 , and denote (h 1 , h 2 ) by h h h. The channel noise, W k , is assumed to be circularly symmetric Gaussian random variable with mean zero and variance N. The noise W W W = (W 1 , . . . W n ) is assumed to be an iid sequence. For convenience, define the CSNR Γ i = |h i | 2 /N and γ i = |h i | 2 , which is the exponentially distributed power gain of the channel i = 1, 2. Let E{γ i } =γ. The total output CSNR in the channel state h h h is , and Γ 12 = γ 12 /N. We will refer toΓ =γ N as the "fading power-to-noise ratio" (FPNR) of the channel, which is a figure-of-merit for the BF-GMAC. Note that ρ x depends on the encoding scheme. For example, if SSC coding is used, the GMAC inputs are independent and we will have ρ x = 0 regardless of source correlation ρ. On the other hand, if uncoded transmission is used, ρ x = ρ.
The receiver observes the channel output Y Y Y and the channel state h h h = (h 1 , h 2 ) and reconstructs the sequences S S S 1 and S S S 2 . This decoder can be described by a pair of mappings φ (i) i : C n × C 2 → C n , such that the decoded source sequences are given bŷ We will measure the distortion between S S S i andŜ S S i using the average MSE, given by For notational simplicity, we denote the minimum achievable d i for a fixed channel state h h h by d i (h h h) and let Our main goal in this paper is to determine the distortion power function (DPF) for two Gaussian sources and a BF-GMAC, given by where p(h h h) = p 1 (h 1 )p 2 (h 2 ) and p i (h) is the pdf of h i , i = 1, 2. Note that D(P 1 , P 2 ) is defined for a given source correlation ρ and a FPNRΓ of a bandwidth-matched BF-GMAC. An alternative description of D(P 1 , P 2 ) is the achievable power region (P 1 , P 2 ) for a given target D. Note that DPF for a single Gaussian source and a point-point AWGN channel can be found by evaluating the distortion rate function of the source at the rate equal to the channel capacity, i.e., D(P) = σ 2 2 − log 2 (1+P/N) [4]. Finding D(P 1 , P 2 ) in general is difficult. Therefore, our end goal is to find useful upper-bounds to D(P 1 , P 2 ), by considering certain coding schemes for which d 1 (h h h) and d 2 (h h h) can be found in closed-form, and therefore Equation (2) can be at least numerically evaluated.

Notation and Terminology
For simplicity of presentation, throughout the paper we define the index variable i ∈ {1, 2}. The index j ∈ {1, 2} is always defined in relation to i as follows, The complex conjugate of X is denoted by X * . The transpose and conjugate transpose (Hermitian) of a matrix X X X are denoted by X X X T and X X X H , respectively. The time-averaged expectation of a length n sequence X 1 , . . . , X n will be denoted by 1 n n ∑ k=1 E{X k } = E{X} n .

Separate Source-Channel Coding
As a benchmark, we consider ubiquitous SSC coding. In this case, the encoder mapping X X X i = f (n) i (S S S i ) is a concatenation of two-stages. In the first, the sequence S S S i is vector-quantized to produce a "digital" index I i = Π (n) i (S S S i ). In the second stage, the index I i is encoded into a channel codeword X X X i = Λ 2 ) is an optimal distributed VQ for (S S S 1 , S S S 2 ) [15]. The decoder φ (n) i also consists of two stages. The first stage (channel decoder) decodes the index I i using Y Y Y and h h h. As usual, we will say that a transmitted channel codeword is "correctly decodable", or simply decodable, if the codeword can be recovered from the channel output with an arbitrarily small error probability by letting n → ∞. The second stage (source decoder) optimally estimates S S S i using recovered (I 1 , I 2 ), i.e., with MMSE estimation,Ŝ S S i = E{S S S i |I 1 , I 2 }. However, as the transmitters do not observe h h h, the source and channel codes cannot be chosen adaptively to guarantee the error-free recovery of (I 1 , I 2 ). With fixed f (n) i , i = 1, 2, depending on the realization of h h h the received channel codewords may or may not be decodable. The event where only a single codeword, either X X X 1 or X X X 2 , can be decoded is referred to as a "partial outage" and that where both codewords are undecodable is referred to as a "total outage".
Let E i denote the event that I i is decoded correctly and E 12 denote the no-outage event that both codewords are decoded correctly (no-outage event). Further, let E i denote the partial-outage event that only the codeword I i is correctly decoded and E 12 denote the total-outage event. The probabilities of outage events for uncorrelated sources and transmitters with the same power have been determined in [16]. In general, P(E |R 1 , R 2 ), given (R 1 , R 2 ), can be found as shown in Appendix A. Let d(E |R 1 , R 2 ) denote the conditional MMSE under the outage event E , given (R 1 , R 2 ). If the conditional fading-averaged MMSE (FA-MMSE), given (R 1 , R 2 ), isd(R 1 , R 2 ), then the minimum FA-MMSE achievable with SSC coding is

Uncorrelated Sources
In this case, the reconstruction of S S S i only requires I i and straightforwardlȳ

Correlated Sources
When the sources are correlated, the source encoders must constitute a distributed VQ. One issue with an optimal distributed VQ is that, due to the mutual dependence of quantizers for the two sources, the reconstruction of neither source is possible unless the channel codewords from both transmitters can be correctly decoded. Therefore, where p 12 = Pr(E 12 |R 1 , R 2 ) and d(E 12 |R 1 , R 2 ) in this case are the minimum achievable MSE D DVQ (R 1 , R 2 ) of a distributed VQ with rates (R 1 , R 2 ), which is given by the the following lemma.
and R sum = R 1 + R 2 . The MMSE of a distributed VQ for a pair of mean-zero, variance σ 2 Gaussian sources with the correlation coefficient ρ is given by Proof. See Appendix B.

Conventional HDA Coding
Both fully analog (uncoded) transmission and fully digital SSC coding are special cases of more general HDA coding, where the total power and/or channel bandwidth are split between an analog encoder and a conventional digital encoder. When CSI is not available at the transmitters, an HDA system with a power allocation optimized for the channel state distribution can always outperform (in a FA-MMSE sense) both the uncoded and SSC-coded transmission. In this section, we analyze an HDA scheme that uses a conventional SSC encoder (optimal VQ in cascade with a channel coder for GMAC) as the digital part and the quantization error as the analog part [17]. The conventional approach to combining the analog and digital channel signals is by superposition as considered below.
Later, in Section 5.1, we will consider an alternative approach where a vector quantizer is used a JSC code in the digital part. A conventional HDA system is shown in Figure 1. The analog and digital components of each transmitter output share the same channel bandwidth via superposition, whereas the total available transmitter power is split between the two components via digital and analog scaling factors (α di , α ai ). The decoding at the GMAC output relies on the principle of successive interference cancellation (SIC). Each encoder is parameterized by (R i , t i ), where R i is VQ rate and 0 ≤ t i ≤ 1 is the digital-analog power allocation factor to be introduced below, i = 1, 2. Note that in this HDA system, each source encoder is a rate-distortion optimal VQ for the respective source, regardless of whether the sources are correlated or not. Therefore, unlike in Section 3, the source reconstruction becomes possible even under partial-outage events. Furthermore, if the sources are correlated, the quantization errors are also correlated (which is not the case if a distributed VQ is used), allowing analog components of the HDA transmission to interfere, on average, in a constructive manner over the GMAC. Let the quantized value and quantization error for source sequence S S S i beS S S i and Z Z Z i , respectively. For rate-distortion optimal VQ of a Gaussian source, the quantization error variance is [4] . Furthermore,S S S i and Z Z Z i are uncorrelated, and therefore For correlated Gaussian sources, the following results regarding the time-averaged asymptotic cross-correlations hold [10].
Further, we define the correlation coefficients The VQ codewordS S S i (specifically, an index identifying it) is encoded into a channel codeword C C C i of a capacity achieving channel code for the GMAC. The channel input for source sequence S S S i is given by We define the digital-analog power allocation factors as t i = The resulting GMAC output is given by The analog channel inputs act as noise to the digital channel decoder which jointly decodes the two codewords C C C 1 and C C C 2 . Recall that with asymptotically optimal VQ,Z i,k s are iid Gaussian variables and therefore the total noiseZ Z Z i + W W W i at the input of the channel decoder is also iid Gaussian. Digital codewords are decoded first and the correctly decoded codewords are then used to cancel out the digital channel inputs from the observed channel output. The source sequences are then linearly estimated from the correctly decoded channel codewords and the residual channel output. The achievable MMSE of the HDA system in any given channel state h h h depends on the the decodability of digital codewords C C C 1 and C C C 2 . Let d i (E |R 1 , R 2 , t 1 , t 2 ) be the conditional MMSE for source i under the event E , given R 1 , R 2 , t 1 , and t 2 , i = 1, 2. The necessary and sufficient conditions for each event can be found using the basic achievable rate region for a GMAC [4].

•
No outage event E 12 : Both C C C 1 and C C C 2 are decodable if and only if ( [4], Equations 15.147-15.149) • Total outage event E 12 : Neither C C C i nor C C C j is decodable if and only if Equation (11) is violated for i = 1, 2 and Equation (12) is violated.
It can be verified that, when the sources are uncorrelated, Equations (11)-(14) describe regions of (γ 1 , γ 2 ) for these decoding events as shown in Figure 2. For correlated sources, these regions not only depend on γ 1 and γ 2 , but also on γ 12 . We now proceed to evaluate MMSE under each event.

No Outage Event (E 12 )
In this case, the digital channel codewords C C C i , i = 1, 2 are correctly decoded at the receiver. Therefore h 1X1 + h 2X2 can be perfectly canceled from the received signal Y to obtain the residual Y Y Y = Ỹ 1 , . . . ,Ỹ n , whereỸ and the source components (S 1 , S 2 ) can be estimated from the recovered source codewordsS 1 and S 2 , and the residual sequenceỸ. The asymptotically optimal estimator is linear, and therefore the estimated source sequence S i is given bŷ where q i,1 , q i,2 , and q i,3 are the coefficients of the optimal linear estimator. The MSE of the optimal estimator is where q il and c l , l = 1, 2, 3 are found in Appendix C.1. Now, for given (R 1 , R 2 , t 1 , t 2 ), the total FA-MMSE can be found by evaluatinḡ Remark 1.

2.
On the other hand, by setting t 1 = t 2 = 0, we obtain the achievable MMSE of a purely digital SSC coding system. However, for correlated sources, this MMSE is less than that given by the Lemma 1. This is because the digital encoder in Figure 1 does not achieve a distributed coding gain, as does the digital encoder in Section 3. To achieve a coding gain, a distributed VQ must be used, but this will render the quantization errors of the two source uncorrelated, preventing us from exploiting the correlation between the GMAC inputs to our advantage. The advantage of the HDA scheme in Figure 1 is its robustness against unknown CSI. In particular, when the two sources are correlated, so will be their quantization errors. This correlation allows for a form of statistical cooperation at the GMAC output as reflected by the appearance of ρ z in Equation (16), see Appendix C.

Partial Outage Event (E i )
The optimal estimates of the source sequences arê and the corresponding MSEs are where q il , q il , c l and c l , l = 1, 2 are found in Appendix C.2. The total FA-MMSE can be found by evaluatinḡ

Total Outage Event (E 12 )
In this case, neither digital codeword is decodable, and the source sequences are reconstructed aŝ where q i and c i are found in Appendix C.3. For given (R 1 , R 2 , t 1 , t 2 ), the total FA-MMSE can be found by evaluatingd Finally, the total FA-MMSE of the superposition-based HDA scheme can be obtained by solving wherē

JSC-VQ
One problem of digital coding with no knowledge of CSI at the transmitter is the unavoidable outage condition, which also exists in HDA coding schemes that use the quantization error of the digital encoder as the analog component. Although the problem does not exist in uncoded transmission, on a GMAC, uncoded transmission becomes inferior to SSC coding as the CSNR increases (for example, see Figures 3 and 4). A simple way to improve the performance of uncoded transmission at high CSNR is suggested in [10]. Rate-distortion optimal VQ is applied to each source to be transmitted over the GMAC; the VQ codewords are scaled to meet the individual power constraints and directly transmitted over the channel. As the source codewords and channel codewords are the same in this case, optimal detection at the receiver can be used for joint source-channel decoding. More importantly, even if detection of VQ codewords fails, some estimate of the sources can still obtained from the observed channel output. The interest in [10] is the transmission of correlated sources over a NF-GMAC, or equivalently a BF-GMAC with CSI available at the transmitters. However, as we will demonstrate here, this approach can outperform HDA coding, even when the sources are uncorrelated, i.e., when the transmitters do not observe instantaneous CSI. In the following, we determine the FA-MMSE for this joint source-channel VQ (JSC-VQ) scheme. Our analysis considers the general case of two correlated Gaussian sources with the correlation coefficient ρ (the result for uncorrelated source can be obtained by setting ρ = 0.) The JSC-VQ scheme has an additional advantage with correlated sources, since it allows the two correlated sources to statistically cooperate over a GMAC, i.e., create on the average constructive interference at the channel output. Furthermore, whenever one of the codewords is decoded correctly, the effective CSNR for the other codeword increases. As in HDA coding, the achievable MMSE is determined by three possible outage conditions at the decoder. However, the advantage here is that, even when none of the two codewords can be decoded correctly some estimates of the two sources can still be obtained from the observed channel output.
The JSC-VQ encoder i vector-quantizes the source sequence S S S i using a rate-R i codebook, scales the resulting codeword U U U o i to satisfy its power constraint P i , and transmits the scaled codeword X X i = 1, 2. Note that, when S S S 1 and S S S 2 are correlated, so will be the channel inputs X X X 1 and X X X 2 , and therefore the advantage of this scheme. Upon observing the resulting channel output Y Y Y, the decoder first uses the same VQ codebooks used by the encoders to jointly detect the transmitted codewords (U U U o 1 , U U U o 2 ) by considering their correlation (detection step). In the second step, the detected VQ codewords are used to estimate the source sequences S S S 1 and S S S 2 (estimation step). Note that (S S S 1 , are asymptotically jointly Gaussian, and therefore the optimal (MMSE) estimator is linear. Let the codeword pair found in the detection step be (Û U U 1 ,Û U U 2 ). In general, the estimated source sequences are given byŜ where coefficients q i1 , q i2 , and q i3 of the optimal linear estimator are to be determined. For given (R 1 , R 2 , α 1 , α 2 ) used by the encoders, it is not guaranteed that (U U U o 1 , U U U o 2 ) can be correctly decoded in all channel states, and therefore q i1 , q i2 , and q i3 will depend on the state (outage event) of the decoder. Let H 12 , H i , and H 12 , respectively, be the set of (h 1 , h 2 ), for which the outage events E 12 , E i , and E 12 occur for given (fixed) (R 1 , R 2 , α 1 , α 2 ). Define the encoder parameter vector t t t = (R 1 , R 2 , α 1 , α 2 ). The FA-MMSE for given t t t can then be given bȳ The minimum achievable FA-MMSE can be found by We next consider all possible outage events to determine the conditional MMSEs in Equation (22).
• No-outage event E 12 : The set of all rate pairs for which E 12 occurs are given by the following lemma.

Proof.
See Appendix D.
Denote all (R 1 , R 2 ) pairs that satisfy the above constraints by R(E 12 ). Let the codeword pair found in the detection step be ( In this case, the linear estimator need not use the channel output Y Y Y (q i3 = 0), and the source sequences can be reconstructed asŜ The MMSE of the linear estimator for (R 1 , R 2 ) ∈ R(E 12 ) is given by Equation (A24). • Partial outage event E i : The set of all rate pairs for which E i (i = 1, 2) occurs are given by the following lemma.

Proof.
The proof, considering the case i = 1 and j = 2, is given in Appendix D.
Denote all (R 1 , R 2 ) pairs which satisfy above constraints by R(E i ). If (R 1 , R 2 ) ∈ R(E i ), then U U U i = U U U o i andÛ U U i = 0 0 0. The source sequences are reconstructed aŝ The expressions for the MMSE of the linear estimator for (R 1 , R 2 ) ∈ R(E i ) are given by Equations (A25) and (A26).

•
Total outage event E 12 : The set of all rate pairs for which E 12 occurs is given by the following lemma.

Proof.
Follows from Equations (24) and (25) in the previous two lemmas.
Denote all (R 1 , R 2 ) pairs which satisfy above constraints by R(E 12 ). The source sequences are reconstructed asŜ The expressions for the MMSE of the linear estimator for (R 1 , R 2 ) ∈ R(E 12 ) are given Equation (A27).

HDA-JSC-VQ Coding
Finally, we consider an HDA scheme based on the aforementioned JSC-VQ scheme, which possibly provides the lowest known upper bound to the distortion power function D(P 1 , P 2 ) for a pair of correlated Gaussian sources and a fading GMAC. In this scheme, a scaled (analog) version of each source is superimposed on the JSC-VQ codewords in the scheme discussed in Section 5.1. In particular, the resulting HDA scheme (which we will refer to as HDA-JSC-VQ coding) can be shown to outperform the JSC-VQ at all CSNRs on a non-fading GMAC [10]. This improvement can be attributed to the optimality of analog transmission as SNR → 0. In this section, we determine the minimum achievable FA-MMSE of the HDA-JSC-VQ coding over the BF-GMAC. In this case, there is an additional gain due to combining an analog transmission with JSV-VQ as this prevents the complete outages that would otherwise occur with JSV-VQ. We will also demonstrate that this scheme achieves a better FA-MMSE than any other known scheme, even for the uncorrelated Gaussian sources.
Using the same notation as in the previous section, the channel codeword generated by the encoder i of our HDA-JSC-VQ system can be given by where U U U o i is the VQ codeword for S S S i , and α i and β i are constants. Using the transmit power constraint, we have and the digital-analog power allocation factor α i must be chosen to minimize the FA-MMSE. Given the observed channel output Y Y Y = h 1 X X X 1 + h 2 X X X 2 + W W W, the receiver first decodes (U U U o 1 , U U U o 2 ) as (Û U U 1 ,Û U U 2 ) and then linearly estimates the source sequence S S S i aŝ where the coefficients q il , l = 1, 2 are chosen to minimize the reconstruction MMSE for given (h 1 , h 2 ). The evaluation FA-MMSE can proceed as in the case of JSC-VQ system. Specifically, by redefinition of the encoder parameters as t t t = (R 1 , R 2 , α 1 , β 1 , α 2 , β 2 ), the conditional FA-MMSE can be found by Equation (22). The minimum achievable FA-MMSE in this case is given by What remains is to determine the conditional MMSEs in Equation (22), by considering every possible outage event. We obtain the required MMSEs by proving a set of lemmas.

•
No-outage event E 12 : For fixed (h 1 , h 2 ), the bounds on VQ rates required to guarantee error-free decoding of (U U U o 1 , U U U o 2 ) can be found through a slight generalization of the results in ( [10], Theorem IV.6) to account for channel-gains and complex-valued random variables. In particular we can prove the following lemma.
For (R 1 , R 2 ) satisfying the bounds in Lemma 4, the minimum achievable MMSE is given by Equation (A28). • Partial outage event E i : Rate pairs (R 1 , R 2 ) for which only one codeword can be decoded is given by the following lemma.

•
Total outage event E 12 : Rate pairs (R 1 , R 2 ) for which neither codeword can be decoded is given by the following lemma.
Lemmas 4-6 can be proven (details omitted for brevity) by considering the "genie-aided" decoder argument in ( [10], Appendix F), in conjunction with the rate conditions for three-types decoding events established in Appendix D of this paper. In particular, the decoding events of HDA-JSC-VQ scheme can be mapped to those of the JSC-VQ scheme in Section 5.1, by re-expressing the channel output in the form Y Y Y = β 1 U U U o 1 + β 2 U U U o 2 + W W W such that the additive noise W W W satisfies the properties required by the proofs in Appendix D. It can be verified (see [10], Lemma F.1) that the desired representation for Y Y Y is obtained by choosing β 1 and β 2 as in Equations (28) and (29), respectively.

Comparison of Bounds and Discussion
In summary, Equations (3), (19), (23), and (27) are all computable upper bounds to the (unknown) distortion power function D(P 1 , P 2 ) of Gaussian sources and a Rayleigh fading GMAC, under the constraint that CSI is not observable at the transmitters (the function minimizations required to evaluate these bounds have been carried out by using global optimization software). These bounds have been numerically evaluated for certain examples and the results are presented in Figures 3-5. For simplicity of presentation, we consider the symmetric case of P 1 = P 2 andΓ 1 =Γ 2 = 1 (CSNR is thus the same as P). We consider sources with variance σ 2 = 1.
Recall that if CSI is available at the transmitters as well, SSC coding is optimal for uncorrelated sources, whereas uncoded transmission is not. The performance curves in Figure 3 confirm that this is not the case if CSI is not available to the transmitters. The lack of CSI forces the coded transmitters to choose an encoding rate (based on prior knowledge of the CSI distribution) to minimize the MSE considering the unavoidable receiver outages. In the lower-power regime where outage probability is very high, uncoded transmission therefore achieves a better distortion than coded transmission. At the high-power regime, however, the two sources cannot be completely separated from the sum created by the MAC if transmitted completely uncoded and hence the MMSE of uncoded system reaches a constant (which in this case is σ 2 /2 = 0.5 or −3 dB.) As seen in Figure 3 (right) conventional HDA coding essentially remains uncoded transmission up to about P = 6.5 dB (all power allocated to analog part), and then diverges thereafter due to the increasing power allocation to the digital part. While the exact DPF is not known, the HDA-JSC-VQ provides lowest known upper bound to the DPF. Note that JSC-VQ bound coincides with the HDA-JSC-VQ bound for high P where all available power gets allocated to the VQ codewords. For correlated sources, SSC coding would not be optimal even if CSI was known to the transmitters. Figure 4 shows that at ρ = 0.9, SSC coding has a significant gap (~3-6 dB) to the JSC-VQ and HDA-JSC-VQ bounds. Figure 5 left and right shows the achievable FA-MMMSE of each system as a function of the source correlation coefficient, at low and high transmitter powers, respectively. It is known that on a fixed GMAC, uncoded transmission is optimal for power-to-noise ratios P/N ≤ ρ 1−ρ 2 [10]. For example, if ρ = 0.9, uncoded transmission must be optimal for the fixed channel if P/N ≤ 6.75 dB. Clearly, uncoded transmission can only be optimal for a fraction of time in a system with fading and fixed (non-adaptive) transmitters and therefore cannot be optimal in a FA-MMSE sense. As Figure 4 shows, the uncoded system performs identical to the JSC-VQ system in the low-power regime (P less than about 15 dB in this example). This should be expected, as the the limiting optimal JSC-VQ system (as P → 0) is the uncoded system, i.e., the receiver operates in outage nearly all the time, and therefore the optimal system has a rate that approaches infinity. The HDA-JSC-VQ system, on the other hand, exhibits a different behavior. The analog-digital power allocation and VQ rates in the HDA-JSC-VQ system ensure that the receiver achieves an optimal operating point with respect to all four outage events. This allows the HDA-JSC-VQ system to achieve a lower FA-MMSE at a given P, compared to both JSC-VQ and uncoded system in the lower power regime, as evident from Figure 4. So far, we have considered the symmetric case, that is, P 1 = P 2 . As an example for an asymmetric case, Figure 6 shows the FA-MMSE of JSC-VQ and HDA-JSC-VQ schemes for P 2 = P 1 /10 (i.e., P 2 is 10 dB below P 1 ) when ρ = 0.9 andΓ = 1. Note that at high CSNR, the high correlation between the two sources allows the receiver to achieve D 2 ≈ D 1 , despite the transmitter powers being very different. When comparing this figure to Figure 4, note that the total transmitter output power (P 1 + P 2 ) is lower here (1.1P 1 compared to 2P 1 ), which explains the higher total FA-MMSE compared to Figure 4. Although practical code construction methods related to our problem have been reported in previous work, e.g., [18][19][20], those methods perform well only when CSI is available at both the transmitter and the receiver. Furthermore, [18,19] also suffer an additional performance loss due to being zero-delay coding schemes. The results presented in this paper serve as a guide to developing good practical multiple-access block codes for transmitting Gaussian-like sources in systems with no CSI at the transmitters. If the average CSNR is low, uncoded transmission can achieve nearly the same performance as an HDA-JSC-VQ system. The relative performance of the uncoded system improves with the source correlation. However, at moderate to high CSNRs, HDA-JSC-VQ will have a definite advantage, regardless of source correlation. Optimal VQ and typical sequence detection, as considered here to analyze HDA-JSC-VQ, are obviously not practically realizable. A potential approach to practically realizing a HDA-JSC-VQ system is by using trellis-coded quantization (TCQ) [21] at the transmitters (with optimal rates and power allocations found as described in this paper) and joint maximum likelihood (ML) sequence detection at the receiver [22]. On the one hand, TCQ allows computationally efficient way of quantizing long source sequences with distortion close to the distortion rate bound for optimal VQ; on the other hand, the joint detection of a pair of long VQ codewords can be efficiently implemented using a suitable variant of the Vitterbi algorithm operating on a combined trellises of two TCQs. Our preliminary experimental results suggest that this approach can achieve performance very close to the FA-MMSE bound derived in this paper. A complete set of experimental results will be reported in a future paper. Writing-review and editing, P.Y.

Conflicts of Interest:
The authors declare no conflicts of interest.

Appendix A. Outage Probabilities in SSC Coding of Gaussian Sources
From ( [4], Equations 15.147-15.149), it directly follows that the the necessary and sufficient conditions for various outage events are as follows.
• E 12 (both codewords decodable): : : It is straightforward to verify that (γ 1 , γ 2 ) pairs corresponding to these events are as shown in Figure A1, where we define µ i = P i /N. The probability of the event E is given by where, for Rayleigh fading, the pdf of γ i is p i (γ i ) = 1 γ exp − γ ī γ . By evaluating the integral over each region, both Pr(E 12 |R 1 , R 2 ) and Pr(E i |R 1 , R 2 ) can be obtained in closed-form. The former has cumbursome expression (not shown here), but the latter is given by Straightforwardly, Pr(E 12 |R 1 ,

Appendix B. Proof of Lemma 1
We first state a lemma that is required to prove Lemma 1.
and R sum = R 1 + R 2 . Given a distributed VQ (for a pair of zero-mean, variance σ 2 Gaussian sources whose correlation coefficient is ρ) with rates R 1 and R 2 , the distortion pair (D 1 , D 2 ) is achievable if and only if Proof. This lemma follows from the achievable rate region given by ([8], Theorem 1).
Proof of Lemma 1: Let (d 1 , d 2 ) be all distortion pairs achievable by a distributed VQ with rates (R 1 , R 2 ). From Lemma A1, it follows that all achievable distortion pairs satisfy For a given (R 1 , R 2 ) pair, all (d 1 , d 2 ) that satisfy these constraints are above the curve shown in Figure A2 [achievable distortion region for (R 1 , R 2 )]. The minimum achievable total MSE is found by minimizing d 1 + d 2 subject to the constraints Equations (A2)-(A4) (feasibility set). It should be clear that the optimal solution occurs when δ is such that the line d 1 + d 2 = δ touches the boundary of the feasibility set. Depending on the relative values of ∆ 1 , ∆ 2 and ∆ 12 , this will occur at the point A, B, or C as follows, Figure A2a], Figure A2c], C if ∆ 12 > max{∆ 1 , ∆ 2 } and δ = 2 ∆ 12 [ Figure A2b].

Appendix C. Optimal Linear Estimators for HDA Coding
In this appendix, we determine the MSE of the optimal linear estimator in conventional HDA coding.
For optimal VQ of Gaussian sources, Equations (5)-(8) hold and the following can be verified.
Let the optimal linear estimator coefficients be q q q i = (q i1 q i2 q 13 ) T . Then, we have q q q i = K K K −1 c c c * i , i = 1, 2.

Partial outage event (E
which is a 2 × 2 matrix whose elements are Let optimal linear estimates for S i,k and S j,k , k = 1, . . . , n be q q q i = (q i1 q i2 ) T and q q q i = (q i1 q i2 ) T . Then, we have q q q i = K K K −1 i c c c * i and q q q j = 3. Total outage event (E 12 ): The optimal source estimates are given byŜ i,k = q i Y k , i = 1, 2 for k = 1, . . . , n, where q i = k −1 c i and

Appendix D. Proof of Lemma 2 and Theorem 1
We start by summarizing the proof of ( [10], Theorem IV.4). The code construction, encoding, and decoding in the JSC-VQ scheme are as follows. Let > 0 be a fixed constant and rates R 1 and R 2 be fixed. The VQ codebook C i ⊂ C n , i = 1, 2, is generated by independently drawing 2 nR i vectors of length n from the surface of the origin-centered sphere of radius r i = nσ 2 (1 − 2 −2R i ) in C n . The encoder for source i uses C i and vector quantizes the source sequence s s s i to generate a codeword u u u o i ∈ C i . The code vector is then scaled to meet the power constraint and transmitted over the GMAC without any further encoding. Crucial to the proof given in [10] is the geometric view of the VQ encoder. To this end, consider the cosine angle between any pair of non-zero vectors w w w and v v v, defined by Let the F (s s s i , C i ) be all u u u i ∈ C i for which cos(s s s i , u u u i ) is between . The VQ encoder for source i quantizes the sequence s s s i into the codeword u u u o i as follows.
where α i is given by Equation (20). Upon reception of the GMAC output y y y due to both transmitters, the receiver derives the source estimate (ŝ s s 1 ,ŝ s s 2 ) in two steps: First, the receiver obtains a guess (û u u 1 ,û u u 2 ) for the channel input codeword pair (u u u o 1 , u u u o 2 ) by finding the jointly typical codeword pair (u u u 1 , u u u 2 ) ∈ C 1 × C 2 such that α 1 u u u 1 + α 2 u u u 2 has the smallest Euclidean distance to the channel output y y y. A jointly typical pair is defined as (u u u 1 , u u u 2 ), for which |ρ − cos(u u u 1 , u u u 2 )| ≤ 7 , where > 0 andρ is given by Equation (9), which is the correlation between the transmitted VQ codewords (u u u o 1 , u u u o 2 ). Note that, guessing the channel inputs based on the output y y y in this case is akin to channel decoding in SSC coding, but the use of the correlationρ to define a jointly typical set amounts to JSC decoding. In the second step, the source estimates are improved by computing the MMSE linear estimates of the source sequences, given y y y and the already decoded VQ codewords (û u u 1 ,û u u 2 ).
Given the channel output y y y, let EÛ be the error event that there exists a jointly-typical codeword pair (û u u 1 ,û u u 2 ) = (u u u o 1 , u u u o 2 ) for which It can be shown that, for sufficiently large n, the probability of joint decoding error Pr(EÛ) → 0 as n → ∞ if the rates (R 1 , R 2 ) satisfy the constraints ( [10], Lemma D.1) Consider the decoder JSC-VQ in a system where the GMAC exhibits block fading h i for transmitted codeword α i u u u o i . The channel output is given by y y y = α 1 h 1 u u u o 1 + α 2 h 2 u u u o 2 + w w w, where u u u o i ∈ C n , h i ∈ C, i = 1, 2, and w w w ∈ C n . The set of (R 1 , R 2 ) pairs for which both VQ codewords are decodable can be obtained straightforwardly by replacing Without a loss of generality, we prove, in the following, Theorem 1 for the case i = 1 and j = 2. Suppose we wish to determine the set of all rate pairs (R 1 , R 2 ) for which only u u u o 1 can be correctly decoded for a given channel state h h h. In particular, given h h h (i) what is the largest R 1 for which the joint decoding procedure described above can guarantee that Pr[û u u 1 = u u u o 1 ] → 1 as n → ∞ regardless of R 2 ? (ii) if u u u o 1 is provided to the decoder, what is lowest R 2 above which the correct decoding ofû u u o 2 cannot be guaranteed?
The answer to the question (ii) can already be found in [10], Lemma D.5., i.e., the necessary and sufficient condition for incorrect decoding of u u u o 2 given u u u o 1 is which establishes Equation (26) (note that for uncorrelated sources, as expected, the RHS of the above inequality is the capacity of the AWGN channel for u u u o 2 obtained by canceling α 1 h 1 u u u o 1 from the GMAC output.) We next answer the question (i) posed above to establish Equation (25).
Proof. Consider the following three auxiliary events related to source sequences, encoder output sequences, and channel error sequences. The first auxiliary error event, E S , is the same as ( [10], (83)) with the exception that, in our case, (s 1 , s 2 ) ∈ C n × C n and corresponds to an atypical source output sequence. The second auxiliary event E Z is the same as ( [10], (84)) but with Z ∈ C n and corresponds to an atypical additive noise sequences. The third auxiliary event E X is given by the union of three events; Equations (85)-(87) in [10]. Now, by defining E c ν as the complement of E ν and using Pr[E ν ] to denote Pr[(S 1 , S 2 , C 1 , C 2 , Z) ∈ E ν ], we can write where Equation (A7) follows from Lemmas D.2, D.3, and D.4 in [10], whereas Equation (A8) is due to Lemma A3 proven below.
Proof. We can prove that where Equation (A10) is due to the new Lemma A4 proven below and Equation (A11) is due to the fact that E c X ∈ E c X 1 . Now, the proof of Equation (A9) can be obtained by combining Equation (A11) and Lemma D.7 in [10] with w w w = y y y h 1 α 1 . Specifically, it then follows that, for every δ > 0 and every > 0, there exists some n 4 (δ, ) such that for n > n 4 (δ, ), Pr E * where ξ 15 is a positive constant determined by P 1 , P 2 , h 1 , h 2 , and N.
Lemma A4. Let ϕ j ∈ [0, π] be the angle between y and u 1 (j) and let the set E * Û 1 be defined as where ξ and ξ 5 depend only on P 1 , P 2 , and N. Then, for every sufficiently small > 0 Proof. First we note that, for the error event E * U 1 to occur, there must exist codewords u 1 (k) ∈ C 1 \{u o 1 }, and codeword u 2 (l) ∈ C 2 (whose decodability is unknown) such that and Now consider the following series of statements related Equations (A12) and (A13).

Statement A:
For every (s 1 , s 2 , C 1 , C 2 , z) ∈ E X ∩ E Z , it holds that where ξ 13 only depends on P 1 , P 2 , h 1 , h 2 , and z.
• Partial outage event E 2 : Define the column vectorỹ y y k = (S 2,k Y k ) T whose covariance matrix is K K K 2 = k 22 k 23 k 32 k 33 and let c c c i = (c i2 c i3 ) T . The optimal linear estimator isŜ i,k = (q i2 q i3 ) Tỹ y y k whose coefficients are given by (q i2 q i3 ) T = (K K K 2 ) −1 c c c i . The MMSE of this estimator is d i (E 2 |R 1 , R 2 , α 1 , α 2 ) = σ 2 − q i2 c i2 − q i3 c i3 , i = 1, 2. (A26) • Total outage event E 12 : The optimal linear estimator isŜ i,k = q i3 Y k , where (q i3 = c i3 k 33 and the MMSE is

Appendix E.2. HDA-JSC-VQ System
The MMSE of the HDA-JSC-VQ system can be determined in the same way as in the case of JSC-VQ system by modifying the covariances to account for the difference in the channel output. For the HDA-JSC-VQ system, we have Y k = α 1 h 1S1,k + α 2 h 2S2,k + β 1 h 1 S 1,k + β 2 h 2 S 2,k + W k , k = 1, . . . , n.
Parallel to Equations (A24)-(A27), the MMSE for each outage event can be obtained as follows.