kostka's blog

Colours of results
By kostka, 15 months ago, In English

I had a very heated debate with Radewoosh about how we should colour-code some of the results.

We both agree that the "Accepted" result has to be green and "Wrong answer" has to be red. But we had slightly different opinions about "Time limit exceeded". Surprisingly we both found people that agreed with our views. I don't want to bias you in any way, so I am not going to say it here, but what colour do you see when you think "TLE"? What about "Runtime Error" / "Memory Limit Exceeded" / "Compilation Error" / "Pending Judgement"?

  • Vote: I like it
  • +15
  • Vote: I do not like it

Comments Comments (29)
| Write comment?
»
15 months ago, # |
← Rev. 2   Vote: I like it +87 Vote: I do not like it

TLE --> Yellow , RTE --> Black , MLE --> Magenta. Compile error --> same as it is

However, I feel this post is for contributions farming.

→ Reply
  • »
    »
    15 months ago, # ^ |
    ← Rev. 2   Vote: I like it +61 Vote: I do not like it

    This post is definitely for contribution farming. The simpliest way to resolve this question once and for all — is to allow everyone themselves choose the color for each verdict.

    Somewhere in account settings should be an option to make the perfect matching between verdicts and colors!

    → Reply
    • »
      »
      »
      15 months ago, # ^ |
        Vote: I like it +2 Vote: I do not like it

      Great suggestion!

      → Reply
    • »
      »
      »
      14 months ago, # ^ |
      ← Rev. 2   Vote: I like it +5 Vote: I do not like it

      Well there should be sensible defaults as well, most people are not going to bother with choosing their own colors.

      My recommendation is

      But before this codeforces should work on a native dark mode or smth lol

      → Reply
  • »
    »
    15 months ago, # ^ |
    ← Rev. 2   Vote: I like it +7 Vote: I do not like it

    oh! the runtime error will be one of the headquarters.

    → Reply
»
15 months ago, # |
← Rev. 2   Vote: I like it +15 Vote: I do not like it

Accepted — Green

Wrong answer — red

Everything else — As it is now.

→ Reply
»
15 months ago, # |
  Vote: I like it +19 Vote: I do not like it

I see both tle/mle as yellow, compilation error as black, runtime error as dark blue and pending judgment as dark gray.

→ Reply
  • »
    »
    15 months ago, # ^ |
      Vote: I like it +8 Vote: I do not like it

    That's exactly what Radewoosh said. Can you explain why?

    → Reply
    • »
      »
      »
      15 months ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      I'm not sure, but probably it's a mix of colors from judgers i was using early on (solve 3, szkopuł etc.)

      → Reply
»
15 months ago, # |
  Vote: I like it +14 Vote: I do not like it

From the best online judge:

Accepted: #009874

Partially Accepted: #EFC050

Wrong Answer: #DD4124

Memory/Time Limit Exceeded: #FA7268

Runtime Error: #0076C0

Compilation Error: #0F4C81

Pending Judgment: #A49E9E

Judging: #E67E22

→ Reply
  • »
    »
    15 months ago, # ^ |
      Vote: I like it +8 Vote: I do not like it

    Not a huge fan that WA and MLE/TLE are so similar. What judge is this?

    → Reply
    • »
      »
      »
      14 months ago, # ^ |
        Vote: I like it +8 Vote: I do not like it

      https://codeforces.com/blog/entry/112240?#comment-1000000

      NO WAY THE 1000000th COMMENT

      btw imo maybe keep judging as gray, and differentiate MLE and TLE. Codeforces doesn't have much partial so yellow could be used for TLE instead and MLE could be magenta. Additionally WA/etc on testcase 1 should have a different color as well, maybe darker or lighter versions of all the colors

      → Reply
    • »
      »
      »
      14 months ago, # ^ |
        Vote: I like it +3 Vote: I do not like it

      Baekjoon Online Judge.

      → Reply
»
15 months ago, # |
  Vote: I like it 0 Vote: I do not like it

Accepted Green. Any other verdict should be transparent.

→ Reply
»
15 months ago, # |
  Vote: I like it +278 Vote: I do not like it

Personally, I think that you just have it all wrong

→ Reply
  • »
    »
    15 months ago, # ^ |
      Vote: I like it +18 Vote: I do not like it

    acm sgu flashback!

    → Reply
  • »
    »
    15 months ago, # ^ |
      Vote: I like it +24 Vote: I do not like it

    Honestly, I think that such color coding would be a great April fool. Imagine seeing red and then being mad about getting accepted. Or seeing wrong answer on test 2 and you get hyped because you finally solved the problem.

    But on any other day of the year it's just evil.

    → Reply
  • »
    »
    15 months ago, # ^ |
      Vote: I like it +27 Vote: I do not like it

    True, the color of a verdict should be the color that it propels you towards.

    → Reply
»
15 months ago, # |
  Vote: I like it +50 Vote: I do not like it

AC: Green
Penalized rejection(WA,TLE,RE,...) : Orange
Non-penalized rejection(mainly CE), or waiting for judge(WJ) : Gray
Jury is broken : Red

→ Reply
»
15 months ago, # |
  Vote: I like it +2 Vote: I do not like it

Too many colors would be a bit confusion, maybe two or three colors atmost would be great.

Accepted

Wrong Answer on pretest 2

Running on test 11

→ Reply
»
15 months ago, # |
← Rev. 2   Vote: I like it +28 Vote: I do not like it

Accepted — Green

Wrong Answer — Red

Time Limit Exceeded — Yellow

Runtime Error — Orange

Memory Limit Exceeded — Purple

Compilation Error — Gray

Pending Judgement — Same as background

I tried to think of them as the color spectrum. TLE and RE are yellow and orange which are between red and green. TLE and RE can be swapped but TLE is the one we see the most and using the traffic light colors for the main ones makes more sense. Purple is next to red if we think of the spectrum as cyclic. CE is gray because it's usually not penalized. Pending judgment is the same as background to make it easier to notice when the judgment is done.

Edit:

I was thinking of them as background colors. If you want to change the text color, the background color won't work. In that case, you could use a lighter shade of gray.

→ Reply
»
15 months ago, # |
  Vote: I like it +73 Vote: I do not like it

All errors are red (WA, RE, CE)

All exceeds are blue (TL, ML)

Pending is gray

→ Reply
»
15 months ago, # |
  Vote: I like it +21 Vote: I do not like it

Every verdict should be rainbow colored and wrapped with ♂️ signs. Should look like this: ♂️Accepted♂️

→ Reply
»
15 months ago, # |
  Vote: I like it 0 Vote: I do not like it

i have a similar question. what do you think about painting solved problems in color of your rank?

→ Reply
»
15 months ago, # |
← Rev. 2   Vote: I like it +9 Vote: I do not like it

TLE — Blue

MLE — Yellow

CE — Gray

RTE — Purple/Gray

Pending Judgement — No extra color needed

→ Reply
»
14 months ago, # |
  Vote: I like it 0 Vote: I do not like it

In my opinion, all 3 WA TLE and RE/MLE should have the same colour. "Pending judgement" could be yellow or light grey.

→ Reply
»
14 months ago, # |
  Vote: I like it 0 Vote: I do not like it

Doesn't matter when you can't tell apart green and red.

→ Reply