Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Users Search
Help Dashboard Sign In Sign Up
Challenges Q&A Sandbox Meta
Q&A
Posts Tags Edits
Ask Question

Post History

71%
+3 −0
Q&A Hosting fastest code challenges

If restricting everyone to the same system, then we can force every contestant to use https://tio.run and the on-site bench-marking found below "debug" -> "real time" as efficiency metric. Examp...

posted 1y ago by Lundin‭  ·  edited 3mo ago by Lundin‭

Answer
#2: Post edited by user avatar Lundin‭ · 2024-08-19T08:49:45Z (3 months ago)
  • If restricting everyone to the same system, then can force every contestant to use https://tio.run and the on-site bench-marking found below "debug" -> "real time" as efficiency metric. [Example](https://tio.run/##S9ZNT07@r5yZl5xTmpKqYFNckpKZr5dh9z8zr0QhNzEzT0GjLD8zRZOrmktBoaC0pFhDKSM1JydfoTy/KCdFUUnTmqv2//9/yWk5ienF/3X9jQE).
  • Advantages:
  • - No matter how (in)accurate, this gives everyone the same conditions and the same bench-marking system. It is fair.
  • - Multiple programming languages and compilers are possible. Competitions between solutions in the same language and/or other languages is possible.
  • - We already use TIO for most challenges.
  • Disadvantages:
  • - Heavily biased towards a specific target - I think it runs on x86_64 Linux?
  • - Execution times are rather arbitrary with poor accuracy. This is a poor benchmarking tool by professional standards, but maybe for this purpose we don't really care?
  • If restricting everyone to the same system, then we can force every contestant to use https://tio.run and the on-site bench-marking found below "debug" -> "real time" as efficiency metric. [Example](https://tio.run/##S9ZNT07@r5yZl5xTmpKqYFNckpKZr5dh9z8zr0QhNzEzT0GjLD8zRZOrmktBoaC0pFhDKSM1JydfoTy/KCdFUUnTmqv2//9/yWk5ienF/3X9jQE).
  • Advantages:
  • - No matter how (in)accurate, this gives everyone the same conditions and the same bench-marking system. It is fair.
  • - Multiple programming languages and compilers are possible. Competitions between solutions in the same language and/or other languages is possible.
  • - We already use TIO for most challenges.
  • Disadvantages:
  • - Heavily biased towards a specific target - I think it runs on x86_64 Linux?
  • - Execution times are rather arbitrary with poor accuracy. This is a poor benchmarking tool by professional standards, but maybe for this purpose we don't really care?
#1: Initial revision by user avatar Lundin‭ · 2023-06-13T15:06:11Z (over 1 year ago) 
If restricting everyone to the same system, then can force every contestant to use https://tio.run and the on-site bench-marking found below "debug" -> "real time" as efficiency metric. [Example](https://tio.run/##S9ZNT07@r5yZl5xTmpKqYFNckpKZr5dh9z8zr0QhNzEzT0GjLD8zRZOrmktBoaC0pFhDKSM1JydfoTy/KCdFUUnTmqv2//9/yWk5ienF/3X9jQE). 

Advantages:

- No matter how (in)accurate, this gives everyone the same conditions and the same bench-marking system. It is fair.
- Multiple programming languages and compilers are possible. Competitions between solutions in the same language and/or other languages is possible.
- We already use TIO for most challenges.

Disadvantages:
- Heavily biased towards a specific target - I think it runs on x86_64 Linux?
- Execution times are rather arbitrary with poor accuracy. This is a poor benchmarking tool by professional standards, but maybe for this purpose we don't really care?