Current Competitions

Subnet 1 Apex competitions registry

1. Matrix Compression

The first competition - Matrix Compression - explores how small neural activations - both forward and backward - can be compressed while still retaining all their original information. Reducing activation size enables faster data transfer across the internet, a crucial step toward making distributed training more efficient, as it’s often constrained by network bandwidth. The top-performing algorithms from this competition will be integrated to enhance training on subnet 9 IOTA.

Evaluation

Miners aim to optimize the following:

  • Compression Ratio - How small the compressed solution is on disk versus the starting matrix.

  • Time - How fast the compression/decompression algorithm runs.

To surpass the current winner of the competition, a miner must earn a score of at least 1% higher than the current top score. If there is no current winner, then a miner must earn a score of at least 1% higher than the baseline score.

  • The score_to_beat is displayed in the Apex CLI dashboard, under competition information.

Score is calculated by:

score = np.clip((1 - compression) * (1 - task_time / (1 + 0.012)), 0.0, 1.0)
  • Where task_time includes both compression and decompression.

  • Compression is calculated by compressed_file_size / original_file_size.

For Miners

View the matrix compression baseline miner solution provided as an example.

View the matrix compression general miner solution template.

Test your solution with the provided samples in this R2 bucket: https://pub-77097c3387c340de9ff1bd5e5b443d8d.r2.dev. Files are listed in manifest.csv

  • First, download manifest.csv from the R2 bucket to access all sample file names.

  • You will then be able to access all sample files with their given file names.

Then, continue to the Apex CLI guide to submit a solution.

Last updated