Relative entropy- Kullback- Leibler divergence- Bayesian statistics- R
Özet
In recent times entropy concept has been used in many fields such as neural networks, pattern recognition, and statistics for the goodness of fit tests. Surprise attracts human attention and from marketing and advertisement to education attracting human attention is very important. In a Bayesian context, this paper tries to explain how to measure 'surprise' by using relative entropy concept and discusses the various implications of this measurement.
