Call for a new container format!

Sometimes I remember that Matroska exists and today I also remembered how it came to existence. Its author proudly admits mixing all the buzzwords of Web 2.0 era like XML, Semantic Web etc etc and coming up with that format. Since we’re in Web 3.0 era we should have something more modern.

That is why I’m calling for a modern multimedia container format to supplant the outdated formats of the old. It should encompass all the features that make the modern Web great:

  • binary JSON as the backbone of the format;
  • central repository for the downloadable descriptions of the parts of the format (but not codecs themselves! Think of it as of MXF specification if it helps);
  • blockchain (as well as clusterchain and framechain);
  • metaverse integration;
  • decentralised storage (so that the container may refer to some data in the cloud as well as on the local disk; even MOV could do something like this);
  • and of course AI!

Some of you may ask where AI can be applied in this scenario. The answer is obvious—transforming input data for better compression (let alone generating metadata or enabling better integration with other Web 3.0 products). A good model should be able to do the same savings like Matroska did by e.g. shaving off common headers bytes from each frame but without special mapping. An excellent model may generate the content by the embedded description instead of transmitting AV2 video. And of course the central repository will contain the description of models and parameters to be used (in addition to the descriptions of better representation of container parts layout). The possibilities are limitless!

Proposals should be sent to the Alliance for Open Media , I have worse things to deal with.

10 Responses to “Call for a new container format!”

  1. Peter says:

    In dreaming up the worst possible format to re, it also needs multiple encryption ciphers.

  2. Amon says:

    maybe some DVD-like menu navigation to get to the video you want to watch while at it.
    BDs and UHD BDs were better at this i think, maybe take a few pages from them too?

    bah.

  3. Kostya says:

    @Peter
    Yes, DRM goes in without saying. Maybe even with a bytecode for custom VM to dynamically introduce a new encryption scheme somewhat like BluRay (mentioned in the other comment) did.

  4. Paul says:

    Please RE APAC audio codec from rotten fruit.

  5. Kostya says:

    I see no point, honestly. I have no reason to care about it, even from a theoretical point of view.

    The only thing I heard about it is that it’s a spatial codec, so I expect it to be something convoluted like D*lby Atmos, DT$:X, IAMF, MPEG-H or whatever – more or less conventional audio “objects” coding plus some metadata to synthesise it all.

  6. Nazo says:

    someone should create a new container for 4D Gaussian Splatting 🙂

  7. Paul says:

    someone should bring back ambisonics in webm+opus to the webs.

  8. Kostya says:

    Do you mean IAMF in WebMKV? This might actually happen.

  9. Paul says:

    Nope, its about YT and 4ch encoded opus in webm, usually for 360 videos.

    Have you interest in RE codecs from MIPS, like PS2 ones? I struggle to locate decoding bits for some very old formats inside ~2Mb binary file.

  10. Kostya says:

    I have interest in such codecs, not so much experience with console format though.

    From what I heard those formats are often DCT-based so maybe locating a zigzag table and following its references is the easiest path? I can try looking at it too.

Leave a Reply