The Novel Method About Correlation Calculation Based on An Inequation
Among the many methods of analysing correlation coefficient, the two classical methods are the Spearman correlation coefficient and Pearson correlation coefficient. For the Spearman method, the time complexity is larger because of the sorting data. For the Pearson method, there are also some limited conditions, such as the data are needed to linearly related and continuous, normally distributed or near-normally distributed with a single peak and independent. To avoid the disadvantages about the above correlation coefficients, we propose a novel method about correlation calculation based on an inequation, which derives from inventory model theory and risk pooling theory. Firstly, for the whole dataset, we calculate the sample mean and standard deviation of sub elements and whole datasets respectively. Then, using the inventory model theory, we calculate the total standard deviation of the whole dataset and the sum of standard deviation about sub elements of whole dataset, and obtain the novel inequality. Then, judge this inequality: when “\(=\)” is true, conclude that there is no correlation data in the entire dataset \({\rm{X}}\); when “\(>\)” is true, it is judged that the entire dataset X has relevant data, furthermore, the bigger the difference of left value subtracts right value, the stronger the correlation. The proposed algorithm owns the lower time complexity and much wider range of uses. Finally, the GDP experiment and Gini index experiment demonstrate the effectiveness of the novel method.
Authors
- Xisong Miao (ORCID: https://orcid.org/0009-0009-1808-4023)
- Fei Deng (ORCID: https://orcid.org/0000-0002-9448-5496)
- Boyang Wang (ORCID: https://orcid.org/0009-0002-5292-7724)
- Wenjie Yu
- Bowen Zheng (ORCID: https://orcid.org/0009-0003-0304-1553)
Institutions
- Kunming University (CN)
- Yunnan University (CN)
Publication Details
- Published
- 2024-09-13
- DOI
- https://doi.org/10.1145/3700906.3700911
- Citations
- 1
- Primary Topic
- Fuzzy Systems and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.71