If there are M messages and each message has probability p = 1/M, the

1.	If there are M messages and each message has probability p = 1/M, the entropy is
A.	0
B.	1
C.	\({\log _2}M\)
D.	\(M{\log _2}M\)
Answer» D. \(M{\log _2}M\)

Discussion

No Comment Found

Related MCQs

A radio channel has a bandwidth of 10 kHz and an S / N ratio of 15 dB. The maximum data rate that can be transmitted is:
An Ideal power limited communication channel with additive white Gaussian noise is having 4 kHz band width and Signal to Noise ratio of 255. The channel capacity is:
Consider channel capacity is 100 Mbps, mean frame length is 10000 bits and average frame arrival rate is 5000 frames / sec. Applying simple queuing theory, the mean frame delay to send a frame onto the channel is:
Discrete source S1 has 4 equiprobable symbols while discrete source S2 has 16 equiprobable symbols. When the entropy of these two sources is compared, the entropy of:
An event has two possible outcomes with probability \(P_1=\frac{1}{2}\), and \(P_2=\frac{1}{64}\) The rate of information with 16 outcomes per second is:
A communication channel is having a bandwidth of 3000 Hz. The transmitted power is such that the received Signal-to-Noise ratio is 1023. The maximum data rate that can be transmitted error-free through the channel is:
If there are M messages and each message has probability p = 1/M, the entropy is
Directions: The item consists of two statements, one labeled as the ‘Assertion (A)’ and the other as ‘Reason (R)’.You are to examine these two statements carefully and select the answers to the item using the codes given below:Assertion (A): Source produces two symbols A and B with probability 3/4 and 1/4 respectively. For error-free transmission, this source should be coded using Shannon-Fano code.Reason (R): For better transmission efficiency, source and channel must be matched.
Entropy of a discrete random variable with possible values {x1 x2, ..., xn} and probability density function P(X) is:\(H\left( X \right) = - \mathop \sum \limits_{i = 1}^n P\left( {{x_i}} \right){\log _{\rm{b}}}P\left( {{x_i}} \right)\)The value of b gives the units of entropy. The unit for b = 10 is:
A source emits bit 0 with probability 1/3 and bit 1 with probability 2/3. The emitted bits are communicated to the receiver. The receiver decides for either 0 or 1 based on the received value R. It is given that the conditional density functions of R are as\({{\rm{f}}_{\left( {{\rm{R}}/0} \right)}}\left( {\rm{x}} \right) = \left\{ {\frac{1}{4}, - 3 \le {\rm{x}} \le 1} \right.{\rm{and\;}}{{\rm{f}}_{\left( {{\rm{R}}/1} \right)}}\left( {\rm{x}} \right) = \left\{ {\frac{1}{6}, - 1 \le {\rm{x}} \le 5} \right.\) The minimum decision error probability is

If there are M messages and each message has probability p = 1/M, the entropy is

Discussion

No Comment Found

Related MCQs

Reply to Comment