bboy_drain's blog

USACO Contests Now Have Judge Feedback!
By bboy_drain, 9 years ago, In English

Hello everyone,

I was just notified by a friend that the USACO contests provide judge feedback on your submissions, so it is possible to know your score before they are released!

Good luck on the first contest!

  • Vote: I like it
  • +23
  • Vote: I do not like it

»
9 years ago, # |
← Rev. 4   Vote: I like it +22 Vote: I do not like it

UPD: I'm sorry, I didn't read the contest information!

If your program correctly solves the sample input case (included in the text of each problem), you will receive feedback on how it performs on each of our judging inputs. For example, you will be told if your program produced the right answer, timed out, experience a run-time error, etc. Note that although you receive this feedback, the remaining judge inputs beyond the sample case are not disclosed during the contest. Problems are intended to be challenging; it is rarely the case that a large number of competitors receive near-perfect scores!
→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it +1 Vote: I do not like it

    I think it doesn't mean that. It just means that we can't see the input and output values for test cases except the sample one.

    → Reply
    • »
      »
      »
      9 years ago, # ^ |
      ← Rev. 2   Vote: I like it +5 Vote: I do not like it

      OK, you're right. I was confused because the contest rules haven't change yet. I'm sorry for causing confusion.

      → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it +2 Vote: I do not like it

        Its OK, I was a bit confused by the wording too

        → Reply
»
9 years ago, # |
← Rev. 2   Vote: I like it 0 Vote: I do not like it

Full feedback means things like tle, mle, runtime error or ac on ALL of the test cases. Am I right?

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Indeed you are correct.

    → Reply
    • »
      »
      »
      9 years ago, # ^ |
      ← Rev. 3   Vote: I like it 0 Vote: I do not like it

      Why cant we delete comments :D

      → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        Congrats! Now I feel better when I take the gold contest :p

        → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        Please don't discuss your scores before the contest is over for everyone.

        → Reply
        • »
          »
          »
          »
          »
          9 years ago, # ^ |
            Vote: I like it 0 Vote: I do not like it

          Sorry. I didn't know it was prohibited.

          → Reply
          • »
            »
            »
            »
            »
            »
            9 years ago, # ^ |
              Vote: I like it +8 Vote: I do not like it

            No problem; been some rule changes that aren't totally spelled out on the website yet. In general we don't want people talking about the problems or their difficulty; discussing your scores can suggest difficulty.

            → Reply
»
9 years ago, # |
  Vote: I like it 0 Vote: I do not like it

Does anyone know, that if you get a 1000 on the bronze contest, whether or not you get to take the silver contest on the same day?

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    I dont think you can because official results are announced after the contest.

    → Reply
    • »
      »
      »
      9 years ago, # ^ |
        Vote: I like it +15 Vote: I do not like it

      Actually I contacted one of the contest supervisors, and he said they will be implementing this feature in this contest.

      → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        A lot is changing about USACO :D

        → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        My friend contacted Brain Dean on email for asking him to promote him from silver to gold immediately to participate in gold in same month , and Brain Dean accepted my friend's request.

        → Reply
        • »
          »
          »
          »
          »
          9 years ago, # ^ |
            Vote: I like it 0 Vote: I do not like it

          Yep that's me alright :P

          → Reply
»
9 years ago, # |
  Vote: I like it 0 Vote: I do not like it

It states that the Judge may add tests after the contest. So it might be possible that you are getting at least the feedback score in the final result but not full marks.

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Thanks for pointing this out. However, I think this would be a rare situation. At least at the IOI, this should never happen.

    → Reply
    • »
      »
      »
      9 years ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      It's not as easy as it looks to make good test sets for problems. It may be case that one corner case is not present, or that incorrect greedy solutions are accepted, or that one particular bruteforce strategy fails to get time limit.

      But I agree that it's going to be rare, I think they'll use the opportunity to change test cases only if it's really disturbing the results (lots of wrong codes get accepted).

      Upon reading the instruction page, this rule looks a lot more bizarre: "it is NOT guaranteed that all possible legal datasets will be solvable within the time limit". What?

      → Reply
      • »
        »
        »
        »
        9 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        I agree that it's often difficult to design good tests. But adding new tests after the contest is a very bad idea when full feedback is used.

        → Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    No, for this contest, these are the final tests.

    → Reply