socketnaut's blog

By socketnaut, history, 5 weeks ago, In English,

I'm interested in examining the feasibility of assigning a difficulty rating to individual test cases. To do so I need data from a contest with partial scoring (otherwise participants won't submit unless they expect to solve all test cases). I also need to be able to determine which test cases each participant was able to solve during the contest (either the information should be directly available or the submissions and test cases should be available so I can determine it myself). Does anyone know of a platform that satisfies those constraints?

USACO is the closest I've seen so far. But full results are not available for all contests (only top participants are published for many of them) and also judging happens after the contest so it's not quite the same as immediate partial credit.

Thanks for your help!

 
 
 
 
  • Vote: I like it  
  • +8
  • Vote: I do not like it  

»
5 weeks ago, # |
  Vote: I like it +10 Vote: I do not like it

Maybe you should try to find an OJ with public submissions and tests, so you could run the testing yourself.

Why do you need this btw.?

  • »
    »
    5 weeks ago, # ^ |
      Vote: I like it +9 Vote: I do not like it

    Right, that could also work. It seems to be available for some HackerRank contests.

    I'm interested in designing a rating system based on partial scoring and individual test case difficulty and seeing how it performs.

»
5 weeks ago, # |
  Vote: I like it +3 Vote: I do not like it

I believe oj.uz has both partial scoring and public submissions.

»
5 weeks ago, # |
  Vote: I like it +1 Vote: I do not like it

LibreOJ you probably need Google translator to use it tho..