• ViatorOmnium@piefed.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 days ago

    Imagine you have dir1/dir2 with “directories” inside, each one with millions of “files”/objects. When you try to “ls” the dir1/dir2 by querying Prefix='dir1/dir2/' and Delimiter='/' S3 will still scan all the millions of objects starting with the prefix, and then filter out the ones that have a / after the prefix.

      • ViatorOmnium@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 hours ago

        There’s no benefit or drawback on it’s own. The way the keys and queries work are geared to S3’s nature as a key value object store - which requires it to support keys that wouldn’t be valid file paths or that have different delimiters.