# American Institute of Mathematical Sciences

doi: 10.3934/fods.2021002

## The rankability of weighted data from pairwise comparisons

 1 Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, USA 2 Department of Mathematics and Computer Science, Davidson College, Davidson, NC, USA 3 Mathematics Department, College of Charleston, Charleston, SC, USA

* Corresponding author: Langville

Received  August 2020 Revised  December 2020 Published  January 2021

In prior work [4], Anderson et al. introduced a new problem, the rankability problem, which refers to a dataset's inherent ability to produce a meaningful ranking of its items. Ranking is a fundamental data science task with numerous applications that include web search, data mining, cybersecurity, machine learning, and statistical learning theory. Yet little attention has been paid to the question of whether a dataset is suitable for ranking. As a result, when a ranking method is applied to a dataset with low rankability, the resulting ranking may not be reliable.

Rankability paper [4] and its methods studied unweighted data for which the dominance relations are binary, i.e., an item either dominates or is dominated by another item. In this paper, we extend rankability methods to weighted data for which an item may dominate another by any finite amount. We present combinatorial approaches to a weighted rankability measure and apply our new measure to several weighted datasets.

Citation: Paul E. Anderson, Timothy P. Chartier, Amy N. Langville, Kathryn E. Pedings-Behling. The rankability of weighted data from pairwise comparisons. Foundations of Data Science, doi: 10.3934/fods.2021002
##### References:

show all references

##### References:
Cityplot of $8 \times 8$ data matrix with original ordering and hillside reordering
Cityplots of $n = 8$ college football data matrices with the original ordering (left) and the optimal hillside reordering (right). The top row is the 2008 season, a less rankable season with hillside $\delta = 155$ and $\rho = 6$. The bottom row is the 2005 season, a more rankable season with hillside $\delta = 92$ and $\rho = 4$
Approximate fractional matrix ${\bf X}^*({\bf r}, {\bf r})$ for Example 1 obtained by the Interior Point solver of the linear programming relaxation
Spaghetti plots and summary of diversity of $P$ sets for Examples 1 and 2
Two maximally discordant optimal solutions for Examples 1 and 2
$X^*$ color-coded visualization of years 2009, 2013, and 2016 NCAA March Madness using the top performing LOP formulation
$X^*$ color-coded visualization of years 2009, 2013, and 2016 NCAA March Madness using the top performing hillside formulation
$X^*$ color-coded visualization for each year of NCAA March Madness using the top performing LOP formulation
$X^*$ color-coded visualization for each year of NCAA March Madness using the top performing hillside formulation
Sample Input/Output economic data based on Japan 2005 [22] (A) and its graphical representation in (B)
Sample of movie rating data based on MovieLens [19] (A) and graphical representation of user rating data transformed into pairwise comparisons (B)
Sample of NCAA Men's Basketball games is shown in (A) and the graphical representation of the aggregate dominance information, i.e., ${\bf D}$ is shown in (B)
5 fold cross-validation results for predicting the upset measure for NCAA Men's March Madness 2002-2018
 Dominance Method Parameters Method MAE 1 Direct+Indirect dt=0, st=1, wi=1 Hillside 3.148221 2 Direct+Indirect dt=0, st=0, wi=1 Hillside 3.148221 3 Direct+Indirect dt=1, st=0, wi=1 LOP 3.172793 4 Direct+Indirect dt=1, st=1, wi=1 LOP 3.172793 5 Direct+Indirect dt=0, st=0, wi=0.25 Hillside 3.213978 6 Direct+Indirect dt=0, st=1, wi=0.25 Hillside 3.213978 7 Direct dt=2 Hillside 3.309455 8 Direct+Indirect dt=2, st=1, wi=1 LOP 3.311588 9 Direct+Indirect dt=2, st=0, wi=1 LOP 3.311588 10 Direct+Indirect dt=2, st=2, wi=0.5 Hillside 3.331698
 Dominance Method Parameters Method MAE 1 Direct+Indirect dt=0, st=1, wi=1 Hillside 3.148221 2 Direct+Indirect dt=0, st=0, wi=1 Hillside 3.148221 3 Direct+Indirect dt=1, st=0, wi=1 LOP 3.172793 4 Direct+Indirect dt=1, st=1, wi=1 LOP 3.172793 5 Direct+Indirect dt=0, st=0, wi=0.25 Hillside 3.213978 6 Direct+Indirect dt=0, st=1, wi=0.25 Hillside 3.213978 7 Direct dt=2 Hillside 3.309455 8 Direct+Indirect dt=2, st=1, wi=1 LOP 3.311588 9 Direct+Indirect dt=2, st=0, wi=1 LOP 3.311588 10 Direct+Indirect dt=2, st=2, wi=0.5 Hillside 3.331698
 [1] Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399 [2] Braxton Osting, Jérôme Darbon, Stanley Osher. Statistical ranking using the $l^{1}$-norm on graphs. Inverse Problems & Imaging, 2013, 7 (3) : 907-926. doi: 10.3934/ipi.2013.7.907 [3] Feng Luo. A combinatorial curvature flow for compact 3-manifolds with boundary. Electronic Research Announcements, 2005, 11: 12-20. [4] Ardeshir Ahmadi, Hamed Davari-Ardakani. A multistage stochastic programming framework for cardinality constrained portfolio optimization. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 359-377. doi: 10.3934/naco.2017023 [5] Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437 [6] Guillaume Bal, Wenjia Jing. Homogenization and corrector theory for linear transport in random media. Discrete & Continuous Dynamical Systems - A, 2010, 28 (4) : 1311-1343. doi: 10.3934/dcds.2010.28.1311 [7] Nizami A. Gasilov. Solving a system of linear differential equations with interval coefficients. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2739-2747. doi: 10.3934/dcdsb.2020203 [8] Hong Seng Sim, Wah June Leong, Chuei Yee Chen, Siti Nur Iqmal Ibrahim. Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization. Numerical Algebra, Control & Optimization, 2018, 8 (3) : 377-387. doi: 10.3934/naco.2018024 [9] Abdulrazzaq T. Abed, Azzam S. Y. Aladool. Applying particle swarm optimization based on Padé approximant to solve ordinary differential equation. Numerical Algebra, Control & Optimization, 2021  doi: 10.3934/naco.2021008 [10] Mohsen Abdolhosseinzadeh, Mir Mohammad Alipour. Design of experiment for tuning parameters of an ant colony optimization method for the constrained shortest Hamiltonian path problem in the grid networks. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 321-332. doi: 10.3934/naco.2020028 [11] Reza Lotfi, Yahia Zare Mehrjerdi, Mir Saman Pishvaee, Ahmad Sadeghieh, Gerhard-Wilhelm Weber. A robust optimization model for sustainable and resilient closed-loop supply chain network design considering conditional value at risk. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 221-253. doi: 10.3934/naco.2020023 [12] Alexander A. Davydov, Massimo Giulietti, Stefano Marcugini, Fernanda Pambianco. Linear nonbinary covering codes and saturating sets in projective spaces. Advances in Mathematics of Communications, 2011, 5 (1) : 119-147. doi: 10.3934/amc.2011.5.119 [13] W. Cary Huffman. On the theory of $\mathbb{F}_q$-linear $\mathbb{F}_{q^t}$-codes. Advances in Mathematics of Communications, 2013, 7 (3) : 349-378. doi: 10.3934/amc.2013.7.349 [14] Arunima Bhattacharya, Micah Warren. $C^{2, \alpha}$ estimates for solutions to almost Linear elliptic equations. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2021024 [15] Misha Bialy, Andrey E. Mironov. Rich quasi-linear system for integrable geodesic flows on 2-torus. Discrete & Continuous Dynamical Systems - A, 2011, 29 (1) : 81-90. doi: 10.3934/dcds.2011.29.81 [16] Fumihiko Nakamura. Asymptotic behavior of non-expanding piecewise linear maps in the presence of random noise. Discrete & Continuous Dynamical Systems - B, 2018, 23 (6) : 2457-2473. doi: 10.3934/dcdsb.2018055 [17] Hirofumi Notsu, Masato Kimura. Symmetry and positive definiteness of the tensor-valued spring constant derived from P1-FEM for the equations of linear elasticity. Networks & Heterogeneous Media, 2014, 9 (4) : 617-634. doi: 10.3934/nhm.2014.9.617 [18] Jong Yoon Hyun, Yoonjin Lee, Yansheng Wu. Connection of $p$-ary $t$-weight linear codes to Ramanujan Cayley graphs with $t+1$ eigenvalues. Advances in Mathematics of Communications, 2021  doi: 10.3934/amc.2020133

Impact Factor: