Persistant storage solutions

[az-arteria]

Hi,

I wanted to ask a somewhat open-ended question about deploying Qdrant and using storage solutions with it.

Let's say I have a Kubernetes cluster with Qdrant containers deployed in the cloud. What would you suggest to use as the persistent storage for these Qdrant containers? Ideally I would prefer to use something like an S3 bucket to store all the data collections. Is there a way to accomplish this in such an environment?

I know that managed cloud and hybrid cloud exist, but let's assume for this question that I would like to handle these things myself without using them.

[timvisee]

Qdrant needs block level storage. It is a database/search engine and so it needs sufficient control over what is on disk.

S3 does not satisfy this and can therefore not be used. Nor does NFS work. Please see the listed storage requirements here.

Though S3 doesn't work for regular storage, we do support it for collection snapshots. Read more about this here.

You'd be correct that Qdrant cloud will arrange all of this for you.

[az-arteria]

Thanks for the info. So in this case, I'm assuming Amazon EBS is an acceptable storage choice considering that it's block storage. Do you have any examples or thoughts on using Qdrant with EBS?

[timvisee]

Yes, using EBS should be fine. I don't think we have any example for this at hand. Note that while EBS is fine, EFS is not.