Fast Kendall Tau Python. If you use Pythons scipy Kendalls tau function to calculate the correlation coefficient youll get -1. The Kendall tau per query is calculated as.
I would like to calculate the pairwise kendalls tau rank correlation for a large spark dataframe. It is a measure of rank correlation. Do you know enough about the Kendall Rank Correlation.
Kendalls Tau is a correlation suitable for quantitative and ordinal variables.
Kendall Tau is a a popular method used in information retrieval tasks such as search engines and recommendation systems. Tau_b P - Q sqrt P Q T P Q U tau_c 2 P - Q n 2 m - 1 m where P is the number of concordant pairs Q the number of discordant pairs T the number of ties only in x and U the number of ties only in y. Im willing to help out with this because lack of an efficient Kendalls Tau is a major impedement to me using scipy and Ive written efficient permissively licensed implementations in. To which extent are high values on variable x are associated with either high or low values on variable y.
