Conditional mutual information.Consider a sequences of N binary random variables X1,X2,…,X
第1题
Using Venn diagrcuns(维拉图),we can see that mutual information common to three random variable X,Y and Z should be defined by I(X;Y;Z)=I(X;Y) - I(X;Y|Z) This quantity is symmetric in X,Y and Z,despite the preceding asymmetric define.Unfortunately,I(X;Y;Z)is not nesessarily nonnegative.Find X,Y,Z such that I(X;Y;Z)<0,and Prove the following two identities: I(X;Y;Z)=H(XYZ) - H(X) - H(Y) - H(Z)+I(X;Y)+I(Y;Z)+I(Z;X) I(X;Y;Z)=H(XYZ) - H(XY) - H(YZ) - H(ZX)+H(X)+H(Y)+H(Z) The first identity can be understood using the Venn diargram analogy for entropy and mutual lnlormatlon.The second identity follows easily from the first.
第2题
【C1】
A.exciting
B.disappointing
C.surprising
D.frightening
第3题
Define the conditional entropy HL/L(U)=(1/L)H(U2L…L+1|UL…U1) for a discrete stationary source of alphabet size K.
Prove that HL/L(U)is nonicreasing with L.
第4题
How did the husband and wife climb up the steps?
A.They didn" t help each other.
B.They climbed up the steps with ease.
C.They limped their way upward with each other" s support.
D.They climbed up the steps depending on a stick.
第5题
Important business will result ______ our mutual understanding and cooperation.
A.in B.from C.of D.on
第6题
A.A.entered
B.B.become
C.C.come
D.D.turned
第7题
A.It is mutual understanding that makes us build trust and promote cooperation with one another.
B.Only mutual understanding can lead to trust and cooperation with other countries.
C.Mutual understanding is the only one factor for us to build trust and promote cooperation with one another.
D.Without mutual understanding, it would be impossible for countries to build trust and promote cooperation with one another.
第8题
A.mutually
B.mutual
C.equal
D.inequally
第9题
A.action
B.activity
C.raise
D.promotion
第10题
第11题