Key Updates: Local End-to-End Evaluation Script (Docker), Temporal Track Dependency Fix, and Dockerfile Optimizations

:arrows_counterclockwise: SVG Challenge 2024 Starter Kit Updates

Hey everyone! We’ve made some important updates to the starter kits to improve your development experience.

:warning: Important: Update Your Fork

Please pull the latest changes into your fork to get these improvements:


# Add the upstream remote if you haven't already

git remote add upstream git@gitlab.aicrowd.com:aicrowd/challenges/sony-sounding-video-generation-challenge-2024/svg-2024-spatial-track-starter-kit.git

# Fetch the latest changes

git fetch upstream

# Merge them into your main branch

git merge upstream/main

For Temporal track participants, use git@gitlab.aicrowd.com:aicrowd/challenges/sony-sounding-video-generation-challenge-2024/svg-2024-temporal-track-starter-kit.git as the upstream.

:whale: New Docker Testing Script

We’ve added a docker_build_run.sh script has been added to both the starter kits that lets you test your submission exactly as it would run on our evaluation servers. This script:

  • Builds the docker image locally

  • Runs the full evaluation pipeline on the sample dataset

  • Helps catch any runtime issues before you submit

:zap: Docker Build Optimization

The Dockerfile has been optimized to be more efficient:

  • No longer copies the entire repository into the image

  • Significantly reduces build time and image size

  • Makes iterating on your submissions faster

:wrench: Temporal Track Fix

For participants in the Temporal track:

How to Use the New Docker Script

Simply run:


./docker_build_run.sh

This will give you the most accurate preview of how your submission will perform on our evaluation servers. We urge you to ensure that this runs successfully before you make a submission.

Best,
AIcrowd Team