Пожалуйста, подпишитесь на официальный канал Codeforces в Telegram по ссылке https://t.me/codeforces_official. ×

Блог пользователя -Ahmed_-_Elsayed-

Автор -Ahmed_-_Elsayed-, история, 16 месяцев назад, По-английски

Right now Bing AI can help me during contests by telling me directly what the problem wants me to do without the story which can make me understand the problem faster is that legal or not ? Thank you in advance :)

Теги ai
  • Проголосовать: нравится
  • +49
  • Проголосовать: не нравится

»
16 месяцев назад, # |
  Проголосовать: нравится -20 Проголосовать: не нравится

Read the contest rules. I think there should be something related to this mentioned. If not I guess we'll wait for an answer from the admins

»
16 месяцев назад, # |
Rev. 2   Проголосовать: нравится +50 Проголосовать: не нравится

There is not much difference between this question and asking if it is legal to write a codeforces contest using a topcoder tshirt or if you can participate under the effect of drugs or some other nonsense doubt. This is obviously not enforceable. What is interesting is if AI could actually help you with that as you claim, which I think it doesnt. AIs ability is not consistent and accurate enough to help you with understanding the statement I think

  • »
    »
    16 месяцев назад, # ^ |
      Проголосовать: нравится +17 Проголосовать: не нравится

    Agree. For instance, Chat GPT can't meow solving a simple div 3A isitacat XD

    so how would it assist in understanding the problem and it answers incorrectly

    • »
      »
      »
      16 месяцев назад, # ^ |
      Rev. 3   Проголосовать: нравится +23 Проголосовать: не нравится

      The problem wants you to determine whether a given string describes a cat meowing or not. A string describes a cat meowing if it follows these rules: It can only contain the letters ‘m’, ‘e’, ‘o’ and ‘w’, in either uppercase or lowercase. It must start with non-empty sequence consisting only of characters ‘m’ or ‘M’. It must be immediately followed by non-empty sequence consisting only of characters ‘e’ or ‘E’. It must be immediately followed by non-empty sequence consisting only of characters ‘o’ or ‘O’. It must be immediately followed by non-empty sequence consisting only of characters ‘w’ or ‘W’, this sequence ends the string, after it immediately comes the string end. You need to output YES if the string is a cat meowing and NO otherwise.

      that was the Bing Ai answer when I asked it to tell me what the problem wants me to do but for this problem, I think the statement is so clear it doesn't need any clearance or summary

      .............

      another example of the same contest problem E2

      The problem wants you to determine whether it is possible to transform one string into another by swapping letters at a certain distance. You are given two strings of equal length and a number k. You can swap any two letters in the first string if their positions differ by k or k+1. You need to output YES if you can transform the first string into the second string by using this operation and NO otherwise.

      I asked the same question (to briefly tell me what the problem wants me to do) and that was the answer

      .............

      I still haven't tested it enough to determine how accurate and consistent it is but till now it's not doing bad

      • »
        »
        »
        »
        16 месяцев назад, # ^ |
          Проголосовать: нравится +33 Проголосовать: не нравится

        It is harder to read your comment than the problem statement.

        • »
          »
          »
          »
          »
          16 месяцев назад, # ^ |
            Проголосовать: нравится +23 Проголосовать: не нравится

          sorry about that I tried to edit the comment so that the bold text is written by AI (copied like it is without any edits) while the italic is written by me if it is still not clear inform me

          thanks for the criticism :)

      • »
        »
        »
        »
        16 месяцев назад, # ^ |
          Проголосовать: нравится +19 Проголосовать: не нравится

        These problems are pretty concisely stated anyway, even with the story about casting (they are 1800A - Is It a Cat? and 1800E2 - Unforgivable Curse (hard version) by the way). For this to be useful, it should also be able to summarize some the infamously long kind of statements. Say this one for example.

        Another problem I foresee is the AI not being able to identify important information. Some problems have small constraints or weird conditions that are vital to solving the problem. Even human beginners disregard them.

»
16 месяцев назад, # |
  Проголосовать: нравится +12 Проголосовать: не нравится

I think it should be legal. From my experience, I think the solving strength of ChatGPT is <1100, and to use it for harder problems requires you to know what you're doing. For example, I could maybe coax it to solve a 1600 rated problem, but at that point I would have to know the main idea of the problem already. It wouldn't be very useful to me for 2000+ rated problems.

»
16 месяцев назад, # |
  Проголосовать: нравится +11 Проголосовать: не нравится

Well, the linked blog (you can find the link in the registration form, which appears each time you register to the contest) states that "The contestants are forbidden to talk about subjects, related to the problems, with anybody, including other contestants". The blog is 11 years old, so it says nothing about AIs. However, I find asking an AI pretty similar to asking a random person (even not completely random, AIs answers are in general faster, clearer and AIs are even capable of writing programs).

I don't know, how strong is the impact of an AI nowadays, but it's rather clear that AIs will develop, so that in future they will be able to solve real round problems. Thus, the optimal solution would be to forbid any AI usage during the contests (does this hold for chess in the same manner?)

Formally, now it's not forbidden in any way. However, if you want to compete fairly, I wouldn't recommend you doing it.

»
16 месяцев назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Though it is not forbidden, I do not recommend the usage of AI, it does not help you, you may be able to solve a problem by asking AI, but you will not progress that way

»
16 месяцев назад, # |
  Проголосовать: нравится -50 Проголосовать: не нравится

Definitely illegal. Sometimes understanding the problem in the right way is part of the solution. For example in networking, Bing will tell you $$$Max_{Flow} = Min_{Cut}$$$ if you don't already know.

»
16 месяцев назад, # |
  Проголосовать: нравится +75 Проголосовать: не нравится

I'm pretty appalled by the lack of reading comprehension in this comment section.

»
16 месяцев назад, # |
  Проголосовать: нравится +27 Проголосовать: не нравится

If an AI can comprehend a problem statement better than your brain, then well things do not seem too bright for you.

»
16 месяцев назад, # |
Rev. 3   Проголосовать: нравится 0 Проголосовать: не нравится

I think it's not a good idea because very often it will fall into one of the following buckets:

  1. It will basically just repeat the statement, nowadays we don't have a lot of stories anyway.
  2. It will simplify the statement in a way that makes the problem easier. It is basically impossible to draw a line between "oh this is just the statement in slightly different terms, it doesn't change anything" and "this is a reformulation of a problem which hints at the right solution (if not being the solution itself)".

So in my opinion it is both useless (at the moment) and cheating at the same time. On average it doesn't help but when it helps it's cheating.

Btw, in the future, AI will be a growing problem for competitive programming. Div 1 participants are probably [mostly] safe for a few more years but this or next year there will be easily available AIs which will be able to instantly solve most of div2 A and many div2 B-C.

  • »
    »
    16 месяцев назад, # ^ |
    Rev. 4   Проголосовать: нравится 0 Проголосовать: не нравится
    this or next year there will be easily available AIs which will be able to instantly solve most of div2 A and many div2 B-C.

    LOL. Have you tried testing even div2A problems on any of these AI models? Except it's an implementation problem. Or a well known or it has seen similar problems the solutions are straight trash.

    Even recent leetcode contests can't be solved easily by AI models. I think div2 participants are safe.

    • »
      »
      »
      16 месяцев назад, # ^ |
      Rev. 4   Проголосовать: нравится 0 Проголосовать: не нравится

      Ahem, AlphaCode was better than the average human competitor more than 1 year ago... https://www.deepmind.com/blog/competitive-programming-with-alphacode

      And it's not an especially expensive/complicated model, more like DeepMind quickly tried the most obvious thing and it kinda worked.

      Also, ChatGPT is able to solve 75% of HumanEval tasks from the first try. I think it has a similar difficulty to div2A, maybe just slightly easier.

      • »
        »
        »
        »
        16 месяцев назад, # ^ |
        Rev. 3   Проголосовать: нравится 0 Проголосовать: не нравится
        AlphaCode was better than the average human competitor more than 1 year ago

        Based on what stats?

        I think you should go through this blog. AI still has a long way to go.

        Btw, those HumanEval tasks, are direct implementation problems, and ofcourse if will perform well on those. Most Div2A's these days aren't direct implementation, you need to make some observations before you can implement an optimal solution.

        • »
          »
          »
          »
          »
          16 месяцев назад, # ^ |
            Проголосовать: нравится 0 Проголосовать: не нравится

          Based on rating? The linked blog posts say "Apparently, if these accounts would take part in real competitions, then their rating would be about 1300.".

          It is exactly what I meant, 1300 is very slightly above average.

          Even this level is somewhat problematic if it was freely available.

          Also, not everything in HumanEval is completely trivial, it has such "observation" problems too, not sure how much though, possibly <10%.

»
16 месяцев назад, # |
  Проголосовать: нравится +36 Проголосовать: не нравится

How about problem setters using AI to shorten the statements? Maybe a better direction to go with?