Batch with two restrictions - requests_per_minute and batch_size

[sebawita]

Can we add an option to configure batch with requests_per_minute and batch_size?

This would be useful, when I am limited to i.e. 120 rpms, but also each object is quite big (like when working with images and videos) and the vectorization is slow (so sending 120 objects each time could result in timeouts or network issues).

One example, where I would use this is with multi2vec modules.

source = os.listdir("./source/video/")

animals = client.collections.get("Animals")

with animals.batch.rate_limit(requests_per_minute=100) as batch:
    for name in source:
        print(f"Adding {name}")
        
        path = "./source/video/" + name
    
        batch.add_object({
            "name": name,            # name of the file
            "path": path,            # path to the file to display result
            "video": toBase64(path), # image to vectorize
        })

I would like to add batch_size in there:

source = os.listdir("./source/video/")

animals = client.collections.get("Animals")
with animals.batch.rate_limit(requests_per_minute=100, batch_size=5) as batch:
...