kNN estimation of the unilateral dependency measure between random variables

Document Type

Conference Proceeding

Department or Administrative Unit

Computer Science

Publication Date



The informational energy (IE) can be interpreted as a measure of average certainty. In previous work, we have introduced a non-parametric asymptotically unbiased and consistent estimator of the IE. Our method was based on the kth nearest neighbor (kNN) method, and it can be applied to both continuous and discrete spaces, meaning that we can use it both in classification and regression algorithms. Based on the IE, we have introduced a unilateral dependency measure between random variables. In the present paper, we show how to estimate this unilateral dependency measure from an available sample set of discrete or continuous variables, using the kNN and the naïve histogram estimators. We experimentally compare the two estimators. Then, in a real-world application, we apply the kNN and the histogram estimators to approximate the unilateral dependency between random variables which describe the temperatures of sensors placed in a refrigerating room.


This article was originally published in 2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM). The full-text article from the publisher can be found here.

Due to copyright restrictions, this article is not available for free download from ScholarWorks @ CWU.


2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM)


Copyright © 2014, IEEE