This article describe about Information Bottleneck Method, which is a technique in information theory for finding the best tradeoff between accuracy and complexity. Optimal temporal structures in linear dynamic systems can be revealed in the so-called past-future information bottleneck, an application of the bottleneck method to non-Gaussian sampled data. Information Bottleneck Method is a simple optimization principle for a model-free extraction the relevant part of one random variable with respect to another. Its formulation is closely related to classical problems in information theory, such as Rate-Distortion Theory and channel coding with side-information.
Information Bottleneck Method
