Coordinator: Prof. Antonio Vicino
Home |  Engineering Library |  DIISM |  Santa Chiara  | Login Privacy e Cookie policy

Info

Structure



Information Theory And Statistics

 

Prof.
Mauro Barni
University of Siena - Dipartimento di Ingegneria dell'Informazione e Scienze Matematiche
Course Type
Group 2
Calendar
dal 15 al 19 Settembre
10:00-13:00
Aula 101
Room
Program
1. Information Theory in a nutshell.
Entropy as a measure of information.
Main properties of Entropy.
Conditional Entropy and mutual information.
Kullback-Leibler distance

2. The method of types
Definitions.
Main properties.
The law of large numbers.
Source coding.

3. IT and large deviation Theory
Sanov Theorem.
Conditional Limit theorem.
Examples.

4. IT and Hypothesis testing
Problem definition.
Neyman-Pearson Theorem.
Error exponents.
Stein's Lemma.
Chernoff bound.

5. Application to adversarial signal processing
The Source identification game with known sources.
Indistinguishability region.
Security Margin.
Source identification with training data.
Distributed hypothesis testing in adversarial setup.





 

Courses

PhD Students/Alumni


Dip. Ingegneria dell'Informazione e Scienze Matematiche - Via Roma, 56 53100 SIENA - Italy