Submitting to AdaptOR 2022
What’s Required
- For the purpose of result verification and to encourage reproducibility and transparency, all entries must submit a Docker container on the Synapse platform (more details in the below sections).
- Additionally, the participants must submit a half-page write up of the challenge explaining their approach.
Submission format
- The Docker container must meet the following requirements:
- For each new input image of size \(960 \times 540\) belonging to the left camera from the Intraop-Domain, the model should be able to generate an image of the same size belonging to the right camera, following the same folder structure as the given test dataset.
- The docker container should output an image for all images in the hosts input directory via the command:
$ docker run --gpus all -v "<absolute_host_input_directory>:/input" -v "<absolute_host_output_directory>:/output" adaptor_challenge
- Please refer to our AdaptOR Docker example, to get easily set up with docker for your model.
- In addition to the half-page write-up, the participants also have an option to submit an \(8\)-page LNCS paper on their methods to the DGM4MICCAI workshop in MICCAI 2022. More information can be found here.
How and where to submit
-
The submissions of the Docker container are done via the Synapse platform of our challenge. Please refer to our submission tutorial on how you can submit your container to our challenge via the Synapse platform. The challenge will be split into three phases: Training phase, Platform testing phase, Submission phase.
-
Training phase (Until 30.06.2022): The participating teams can independently validate their results using cross-validation on the training data.
-
Platform testing phase (01.07.2022-01.08.2022): During the platform testing phase, the participants are allowed to use the official submission platform to resolve potential technical issues. We will use dummy datasets for sanity checks, e.g. to ensure the submission is in the correct format.
-
Submission phase (15.07.2022-15.08.2022): During the submission phase, participants are allowed to make in total three submissions. The best result out of these three is selected as final result. The docker will run on a \(24\) GB RAM Nvidia Titan RTX. Make sure the specified batch size in your code does not exceed the \(24\) GB limit.
-
-
More details about how to submit the half-page write-up will follow soon.
Evaluation
Please refer to our evaluation page for details on how evaluation, ranking and reporting of the metrics will be performed.
Note: Teams are encouraged to provide their code open source. The URL should be added in the half-page description and in the potential LNCS submission. Participants agree that the challenge organizers are allowed to use their submitted docker containers to run further meta-analysis.