# American Institute of Mathematical Sciences

March  2021, 3(1): 1-26. doi: 10.3934/fods.2021002

## The rankability of weighted data from pairwise comparisons

 1 Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, USA 2 Department of Mathematics and Computer Science, Davidson College, Davidson, NC, USA 3 Mathematics Department, College of Charleston, Charleston, SC, USA

* Corresponding author: Langville

Received  August 2020 Revised  December 2020 Published  January 2021

In prior work [4], Anderson et al. introduced a new problem, the rankability problem, which refers to a dataset's inherent ability to produce a meaningful ranking of its items. Ranking is a fundamental data science task with numerous applications that include web search, data mining, cybersecurity, machine learning, and statistical learning theory. Yet little attention has been paid to the question of whether a dataset is suitable for ranking. As a result, when a ranking method is applied to a dataset with low rankability, the resulting ranking may not be reliable.

Rankability paper [4] and its methods studied unweighted data for which the dominance relations are binary, i.e., an item either dominates or is dominated by another item. In this paper, we extend rankability methods to weighted data for which an item may dominate another by any finite amount. We present combinatorial approaches to a weighted rankability measure and apply our new measure to several weighted datasets.

Citation: Paul E. Anderson, Timothy P. Chartier, Amy N. Langville, Kathryn E. Pedings-Behling. The rankability of weighted data from pairwise comparisons. Foundations of Data Science, 2021, 3 (1) : 1-26. doi: 10.3934/fods.2021002
##### References:

show all references

##### References:
Cityplot of $8 \times 8$ data matrix with original ordering and hillside reordering
Cityplots of $n = 8$ college football data matrices with the original ordering (left) and the optimal hillside reordering (right). The top row is the 2008 season, a less rankable season with hillside $\delta = 155$ and $\rho = 6$. The bottom row is the 2005 season, a more rankable season with hillside $\delta = 92$ and $\rho = 4$
Approximate fractional matrix ${\bf X}^*({\bf r}, {\bf r})$ for Example 1 obtained by the Interior Point solver of the linear programming relaxation
Spaghetti plots and summary of diversity of $P$ sets for Examples 1 and 2
Two maximally discordant optimal solutions for Examples 1 and 2
$X^*$ color-coded visualization of years 2009, 2013, and 2016 NCAA March Madness using the top performing LOP formulation
$X^*$ color-coded visualization of years 2009, 2013, and 2016 NCAA March Madness using the top performing hillside formulation
$X^*$ color-coded visualization for each year of NCAA March Madness using the top performing LOP formulation
$X^*$ color-coded visualization for each year of NCAA March Madness using the top performing hillside formulation
Sample Input/Output economic data based on Japan 2005 [22] (A) and its graphical representation in (B)
Sample of movie rating data based on MovieLens [19] (A) and graphical representation of user rating data transformed into pairwise comparisons (B)
Sample of NCAA Men's Basketball games is shown in (A) and the graphical representation of the aggregate dominance information, i.e., ${\bf D}$ is shown in (B)
5 fold cross-validation results for predicting the upset measure for NCAA Men's March Madness 2002-2018
 Dominance Method Parameters Method MAE 1 Direct+Indirect dt=0, st=1, wi=1 Hillside 3.148221 2 Direct+Indirect dt=0, st=0, wi=1 Hillside 3.148221 3 Direct+Indirect dt=1, st=0, wi=1 LOP 3.172793 4 Direct+Indirect dt=1, st=1, wi=1 LOP 3.172793 5 Direct+Indirect dt=0, st=0, wi=0.25 Hillside 3.213978 6 Direct+Indirect dt=0, st=1, wi=0.25 Hillside 3.213978 7 Direct dt=2 Hillside 3.309455 8 Direct+Indirect dt=2, st=1, wi=1 LOP 3.311588 9 Direct+Indirect dt=2, st=0, wi=1 LOP 3.311588 10 Direct+Indirect dt=2, st=2, wi=0.5 Hillside 3.331698
 Dominance Method Parameters Method MAE 1 Direct+Indirect dt=0, st=1, wi=1 Hillside 3.148221 2 Direct+Indirect dt=0, st=0, wi=1 Hillside 3.148221 3 Direct+Indirect dt=1, st=0, wi=1 LOP 3.172793 4 Direct+Indirect dt=1, st=1, wi=1 LOP 3.172793 5 Direct+Indirect dt=0, st=0, wi=0.25 Hillside 3.213978 6 Direct+Indirect dt=0, st=1, wi=0.25 Hillside 3.213978 7 Direct dt=2 Hillside 3.309455 8 Direct+Indirect dt=2, st=1, wi=1 LOP 3.311588 9 Direct+Indirect dt=2, st=0, wi=1 LOP 3.311588 10 Direct+Indirect dt=2, st=2, wi=0.5 Hillside 3.331698
 [1] Xiantao Xiao, Jian Gu, Liwei Zhang, Shaowu Zhang. A sequential convex program method to DC program with joint chance constraints. Journal of Industrial & Management Optimization, 2012, 8 (3) : 733-747. doi: 10.3934/jimo.2012.8.733 [2] Ted Greenwood. Superstar of the Sloan Minority Ph.D. Program. Mathematical Biosciences & Engineering, 2013, 10 (5&6) : 1539-1540. doi: 10.3934/mbe.2013.10.1539 [3] Xin Zhao, Jinyan Fan. On subspace properties of the quadratically constrained quadratic program. Journal of Industrial & Management Optimization, 2017, 13 (4) : 1625-1640. doi: 10.3934/jimo.2017010 [4] James H. Elder. A new training program in data analytics & visualization. Big Data & Information Analytics, 2016, 1 (1) : i-iii. doi: 10.3934/bdia.2016.1.1i [5] Thomas R. Cameron, Sebastian Charmot, Jonad Pulaj. On the linear ordering problem and the rankability of data. Foundations of Data Science, 2021  doi: 10.3934/fods.2021010 [6] Michal Kočvara, Jiří V. Outrata. Inverse truss design as a conic mathematical program with equilibrium constraints. Discrete & Continuous Dynamical Systems - S, 2017, 10 (6) : 1329-1350. doi: 10.3934/dcdss.2017071 [7] Renato Huzak. Cyclicity of degenerate graphic $DF_{2a}$ of Dumortier-Roussarie-Rousseau program. Communications on Pure & Applied Analysis, 2018, 17 (3) : 1305-1316. doi: 10.3934/cpaa.2018063 [8] Jie Zhang, Shuang Lin, Li-Wei Zhang. A log-exponential regularization method for a mathematical program with general vertical complementarity constraints. Journal of Industrial & Management Optimization, 2013, 9 (3) : 561-577. doi: 10.3934/jimo.2013.9.561 [9] Li Chu, Bo Wang, Jie Zhang, Hong-Wei Zhang. Convergence analysis of a smoothing SAA method for a stochastic mathematical program with second-order cone complementarity constraints. Journal of Industrial & Management Optimization, 2021, 17 (4) : 1863-1886. doi: 10.3934/jimo.2020050 [10] Feng Yang, Kok Lay Teo, Ryan Loxton, Volker Rehbock, Bin Li, Changjun Yu, Leslie Jennings. VISUAL MISER: An efficient user-friendly visual program for solving optimal control problems. Journal of Industrial & Management Optimization, 2016, 12 (2) : 781-810. doi: 10.3934/jimo.2016.12.781 [11] Anatole Katok, Federico Rodriguez Hertz. Rigidity of real-analytic actions of $SL(n,\Z)$ on $\T^n$: A case of realization of Zimmer program. Discrete & Continuous Dynamical Systems, 2010, 27 (2) : 609-615. doi: 10.3934/dcds.2010.27.609 [12] Renato Bruni, Gianpiero Bianchi, Alessandra Reale. A combinatorial optimization approach to the selection of statistical units. Journal of Industrial & Management Optimization, 2016, 12 (2) : 515-527. doi: 10.3934/jimo.2016.12.515 [13] Simone Göttlich, Oliver Kolb, Sebastian Kühn. Optimization for a special class of traffic flow models: Combinatorial and continuous approaches. Networks & Heterogeneous Media, 2014, 9 (2) : 315-334. doi: 10.3934/nhm.2014.9.315 [14] Yasmine Cherfaoui, Mustapha Moulaï. Biobjective optimization over the efficient set of multiobjective integer programming problem. Journal of Industrial & Management Optimization, 2021, 17 (1) : 117-131. doi: 10.3934/jimo.2019102 [15] Yong Xia, Yu-Jun Gong, Sheng-Nan Han. A new semidefinite relaxation for $L_{1}$-constrained quadratic optimization and extensions. Numerical Algebra, Control & Optimization, 2015, 5 (2) : 185-195. doi: 10.3934/naco.2015.5.185 [16] Artyom Nahapetyan, Panos M. Pardalos. A bilinear relaxation based algorithm for concave piecewise linear network flow problems. Journal of Industrial & Management Optimization, 2007, 3 (1) : 71-85. doi: 10.3934/jimo.2007.3.71 [17] Gabrielle Demange. Collective attention and ranking methods. Journal of Dynamics & Games, 2014, 1 (1) : 17-43. doi: 10.3934/jdg.2014.1.17 [18] Mahmoud Ameri, Armin Jarrahi. An executive model for network-level pavement maintenance and rehabilitation planning based on linear integer programming. Journal of Industrial & Management Optimization, 2020, 16 (2) : 795-811. doi: 10.3934/jimo.2018179 [19] Elham Mardaneh, Ryan Loxton, Qun Lin, Phil Schmidli. A mixed-integer linear programming model for optimal vessel scheduling in offshore oil and gas operations. Journal of Industrial & Management Optimization, 2017, 13 (4) : 1601-1623. doi: 10.3934/jimo.2017009 [20] Mahdi Roozbeh, Saman Babaie–Kafaki, Zohre Aminifard. Two penalized mixed–integer nonlinear programming approaches to tackle multicollinearity and outliers effects in linear regression models. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020128

Impact Factor:

## Tools

Article outline

Figures and Tables