If there are M messages and each message has probability , the entropy – McqOptions

MCQOPTIONS

1.	If there are M messages and each message has probability , the entropy is
A.	0
B.	1
C.	log2 M
D.	M log2 M
Answer» D. M log2 M

Discussion

No Comment Found

Related MCQs

The Hilbert transform of cos ω1t + sin ω2t is
Efficiency of general AM signal with em = E1 cos ω1t + E2 cos ω2 tj ec = Ec cos ωct; E1 cos ω1t with modulation index m2 is __________ .
For a given data rate, the bandwidth βp of a BPSK signal and the bandwidth β0 of the OOK signal are related as
Noise with uniform power spectral density of N0ω/Hz is passed through a filter H(ω) = 2 exp (-J ω ty) followed by an ideal low pass filter of bandwidth B Hz. The output noise power in watts is
A sequence x(n) with the z transform X(z) = z4 + z2 - 2z + 2 - 3z - 4 is applied as an input to a linear, time invariant system with the impulse response h(n) = 2δ(n - 3) where The output at n = 4 is
A signal x(t) = 100 cos (24p x 103t) is ideally sampled with a sampling period of 50 μ sec and then passed through an ideal low pass filter with cut off frequency of 15 kHz Which of the following frequencies are present at the filter output?
If the variance σx2 of d(n) = x(n) - x(n - 1) is one-tenth the variance σx2 of a stationary zero mean discrete time signal x(n), then the normalized autocorrelation function Rxx(x)/σx2 at k = 1 is
In the figure , the output y(t) will be
The F.T. of {e-1 ∪(t)} is equal to . Therefore is
Consider a sampled signal y(t) = 5 x 10-6 x(t) where x(t) = 10 cos (8p x 103)t and ts = 100 μ sec. when y(t) is passed through an ideal low-pass filter with a cut off frequency of 5 kHz, the output of the filter is