Does IOI rank correlate with CF rating?

Revision en3, by I_Love_Tina, 2019-03-27 14:04:58

Background

I have recently stumbled across a paper which analyzed the correlation between the IMO medal and future success in the mathematical field. So, inspired by annual predictions of IOI rankings based on CF ratings, I don't know what to do with my time decided to take a more "serious" approach.

Method

I collected the data from the last $$$7$$$ editions of IOI in order to create the graph of $$$f(x)$$$ is the maximal rating of the participant with rank $$$x$$$. For the last $$$6$$$ editions, I relied almost solely on the IOI statistics website. The $$$2012$$$ edition, however, is missing a lot of information and I collected the CF handles either from snarknews or by finding the handle on search engines.

I put the participants in the same order they were arranged in the scoreboard, so if there are multiple people on the same position, they would be assigned consecutive ranks. In case there was an unofficial participant, I assigned the mean of the ranks between which this participant was situated.

If there were participants with no competitions, I assigned the rating $$$1500$$$. This should not have big influence on the graph because there were very few such participants.

Things to consider:

  • A lot of participants from past editions don't participate in CF round anymore

  • The rating system has undergone inflation.

  • The rating system fluctuates too much.

  • The style/difficulty/originality of CF problems highly depends on the round and unlike the AtCoder case this creates disproportionality of rating distribution. So do the div 2/div 3/educational rounds.

  • Not everybody is active in CF rounds.

IOI 2012

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 25 & 0.96 & 2497 & 2573.5 \\ \hline \text{Silver} & 52 & 0.38 & 2220 & 2247.5 \\ \hline \text{Bronze} & 77 & 0.27 & 2137 & 2100.5 \\ \hline \text{No Medal} & 155 & 0.31 & 1802 & 1839.5 \\ \hline \text{Total} & 310 & 0.47 & 2135 & 2124 \\ \hline \end{array} $$$

IOI 2013

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 25 & 0.96 & 2499 & 2528.7 \\ \hline \text{Silver} & 50 & 0.50 & 2321 & 2322.8 \\ \hline \text{Bronze} & 74 & 0.38 & 2145 & 2127.9 \\ \hline \text{No Medal} & 149 & 0.40 & 1826 & 1850.9 \\ \hline \text{Total} & 298 & 0.60 & 2137 & 2130 \\ \hline \end{array} $$$

IOI 2014

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 25 & 0.875 & 2499 & 2538.8 \\ \hline \text{Silver} & 50 & 0.54 & 2270 & 2333.3 \\ \hline \text{Bronze} & 74 & 0.29 & 2127 & 2119.2 \\ \hline \text{No Medal} & 149 & 0.39 & 1919 & 1920.5 \\ \hline \text{Total} & 298 & 0.58 & 2162 & 2170.4 \\ \hline \end{array} $$$

IOI 2015

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 29 & 1.0 & 2596 & 2714.7 \\ \hline \text{Silver} & 53 & 0.53 & 2364 & 2404.2 \\ \hline \text{Bronze} & 79 & 0.34 & 2187 & 2208.7 \\ \hline \text{No Medal} & 160 & 0.53 & 1794 & 1817.7 \\ \hline \text{Total} & 321 & 0.66 & 2133 & 2162.2 \\ \hline \end{array} $$$

IOI 2016

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 26 & 1.0 & 2579 & 2643.9 \\ \hline \text{Silver} & 51 & 0.66 & 2362 & 2353.6 \\ \hline \text{Bronze} & 77 & 0.40 & 2089 & 2104.6 \\ \hline \text{No Medal} & 154 & 0.51 & 1779 & 1825.4 \\ \hline \text{Total} & 308 & 0.71 & 2103 & 2124.6 \\ \hline \end{array} $$$

IOI 2017

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 26 & 0.84 & 2609 & 2548.2 \\ \hline \text{Silver} & 50 & 0.57 & 2256 & 2293.4 \\ \hline \text{Bronze} & 76 & 0.42 & 2133 & 2129.4 \\ \hline \text{No Medal} & 152 & 0.60 & 1899 & 1889.8 \\ \hline \text{Total} & 304 & 0.73 & 2089 & 2104.1 \\ \hline \end{array} $$$

IOI 2018

$$$ \begin{array}{c|lcr} & \# & \text{Fraction of CF users} & \text{Median} & \text{Mean} \\ \hline \text{Gold} & 29 & 0.96 & 2459 & 2482.3 \\ \hline \text{Silver} & 55 & 0.57 & 2223 & 2220 \\ \hline \text{Bronze} & 83 & 0.35 & 2164 & 2132 \\ \hline \text{No Medal} & 168 & 0.49 & 1771 & 1782.1 \\ \hline \text{Total} & 335 & 0.65 & 2089 & 2063.1 \\ \hline \end{array} $$$

Conclusion

So, unsurprisingly, on average you can see that the function is decreasing by rank, however it fluctuates too much between close ranks. Therefore, on an individual level, you can't predict someone's future rating based on IOI ranking.

What do you think about this?

History

 
 
 
 
Revisions
 
 
  Rev. Lang. By When Δ Comment
en3 English I_Love_Tina 2019-03-27 14:04:58 901 (published)
en2 English I_Love_Tina 2019-03-27 02:11:49 4462 Tiny change: 'ground**\nI have r' -> 'ground**\n\nI have r'
en1 English I_Love_Tina 2019-03-26 19:46:41 306 Initial revision (saved to drafts)