The July contest is officially closed. While we are calculating the results, we wanted to share some feedback and ideas for improvement for the next contest:
- We need one or two harder questions. As many of you know, it is difficult to come up with challenging problems. If anyone is interested in setting problems for future contest, get in touch with us at firstname.lastname@example.org – we will pay for any problems we use.
- The contest needs to be shorter. Next month’s contest will be one week long. We will also be including a shorter duration contest at the end of next month (a few hours to a weekend – still deciding).
- We need to figure out a better way to determine winners for the challenge. Rejudging all submissions with new test data doesn’t make sense, you can submit a bunch of variations which will perform differently for different input data. There are two approaches we are considering: either limit the number of successful submissions one can submit for a problem (to let’s say 15) and not rejudge, only rejudge the last few accepted solutions (say 5), or only allow a certain number of submissions to the challenge problem a day (let’s say 10). Your thoughts on this appreciated.
- We need to define rules better. There can be no collaboration involved between contestants. Any form of collaboration (whether it’s reviewing code, asking for output for a set of inputs, or asking for time complexity of an accepted solution) is not allowed. We will immediately ban you on suspicion. More on this in a subsequent post.
If anyone has any other suggestions on improvements for the contest format, types of problems, new competitions, etc… please let us know.