Papers › ITENE: Intrinsic Transfer Entropy Neural Estimator
ITENE: Intrinsic Transfer Entropy Neural Estimator
Jingjing Zhang, Osvaldo Simeone, Zoran Cvetkovic, Eugenio Abela, Mark Richardson
Quantifying the directionality of information flow is instrumental in understanding, and possibly controlling, the operation of many complex systems, such as transportation, social, neural, or gene-regulatory networks. The standard Transfer Entropy (TE) metric follows Granger's causality principle by measuring the Mutual Information (MI) between the past states of a source signal X and the future state of a target signal Y while conditioning on past states of Y. Hence, the TE quantifies the improvement, as measured by the log-loss, in the prediction of the target sequence Y that can be accrued when, in addition to the past of Y, one also has available past samples from X. However, by conditioning on the past of Y, the TE also measures information that can be synergistically extracted by observing both the past of X and Y, and not solely the past of X. Building on a private key agreement formulation, the Intrinsic TE (ITE) aims to discount such synergistic information to quantify the degree to which X is \emph{individually} predictive of Y, independent of Y's past. In this paper, an estimator of the ITE is proposed that is inspired by the recently proposed Mutual Information Neural Estimation (MINE). The estimator is based on variational bound on the KL divergence, two-sample neural network classifiers, and the pathwise estimator of Monte Carlo gradients.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Results from the paper archive 2025-07-28
No leaderboard rows for this paper in the archive.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections