AnonySharma's blog

By AnonySharma, history, 6 weeks ago, In English,

In short: If a problem has 4 sample test cases, and code fails at test 4 then wrong submission is counted, but if it fails at test 1, this code is not counted as wrong submission.

We often over-read the sample output and submit the code, which costs us points. I suggest, if any of the sample test cases fail, wrong submission shouldn't be counted.

MikeMirzayanov, Please look into it.

 
 
 
 
  • Vote: I like it
  • +37
  • Vote: I do not like it

»
6 weeks ago, # |
  Vote: I like it 0 Vote: I do not like it

Auto comment: topic has been updated by AnonySharma (previous revision, new revision, compare).

»
6 weeks ago, # |
  Vote: I like it 0 Vote: I do not like it

Auto comment: topic has been updated by AnonySharma (previous revision, new revision, compare).

»
6 weeks ago, # |
  Vote: I like it +27 Vote: I do not like it

I think you should be penalized if you didn't run your code against sample cases

  • »
    »
    6 weeks ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Then I guess, by this logic, failing test case 1 should be penalised as well.

    Although, I feel that, CF does this to warn them in cases where one prints output in wrong output format. But, still it was just a suggestion. :D

    • »
      »
      »
      6 weeks ago, # ^ |
        Vote: I like it +8 Vote: I do not like it

      Failing on test case 1 should be forgiven for various reasons. Misunderstanding in input/output style, Capitalization mistakes in some problems, and problem with interactive problems.

      • »
        »
        »
        »
        6 weeks ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        Yeah I agree, failing on Test case 2+ usually means you understood the problem but not necessarily, but usually lots of "accidental errors that can cause WA" like not printing an end line, or wrong input format will be caught in TC1 and I don't think it should be penalized

      • »
        »
        »
        »
        6 weeks ago, # ^ |
          Vote: I like it +54 Vote: I do not like it

        Or you just submitted the code of a different problem

»
6 weeks ago, # |
  Vote: I like it 0 Vote: I do not like it

Why don't you run your code against the samples? It costs at most 5 seconds. Even if I never read the samples closely, passing all the samples makes me more confident that my code is correct.

  • »
    »
    6 weeks ago, # ^ |
      Vote: I like it +4 Vote: I do not like it

    The output was a number of 14-15 digits and my second last digit varied, and I missed that and submitted the code. And that was due to an extra if condition in my code.

    Actually, I just wanted to discuss this topic. By the way, laziness is not the issue here, reason why I posted this, is if its still sample case and output is given and one does some silly mistake then it's definitely because the user didn't checked the output properly, and I agree that the fault lies with the user, but still this could be resolved if just the user isn't penalised for sample cases.

»
6 weeks ago, # |
  Vote: I like it 0 Vote: I do not like it

This has been discussed before, and the reason there's no penalty on test 1 is in case you submit the wrong code or file, or some other error irrelevant to the correctness of your program. If you fail sample test 4, your program is just wrong.

»
6 weeks ago, # |
  Vote: I like it +8 Vote: I do not like it

I am more wondering, how to deal with the problems where more than one output is correct? Forgiving WA #1 in these cases might be a big deal, and I believe it happenned to me a couple of times.

»
6 weeks ago, # |
  Vote: I like it 0 Vote: I do not like it

what i think is if you fail on testcase 1 it would be not only due to logical error. it can be random error like selecting wrong question, wrong language, wrong file,etc.

but for testcase 4, it clearly means there is no random but our mistake.

  • »
    »
    6 weeks ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Yes, I also think that's the reason.

  • »
    »
    6 weeks ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    But I think penalty can be reduced if your code works on more than one testcase and the person can be penalized according to the no. of testcases he has failed.

»
6 weeks ago, # |
  Vote: I like it +3 Vote: I do not like it

You should use something like cf-tool to check all samples with just one command. And the differences will be clearly marked. So you would never miss a digit or a character.