[ceph-users] Is object name used by CRUSH algorithm?

Jin Mao jin at tower-research.com
Mon Oct 1 13:43:52 PDT 2018


Gregory and Paul,

Thank you for sharing the information.

Jin.

On Mon, Oct 1, 2018 at 4:08 PM Paul Emmerich <paul.emmerich at croit.io> wrote:

> You are probably thinking of Amazon's S3 where adding a random prefix
> to object names was a common performance optimization in the past, but
> I think they fixed that recently.
>
> Anyways, common prefixes are very common in Ceph and no problem. For
> example, all objects within an rbd imge have the same prefix.
>
> Paul
> Am Do., 27. Sep. 2018 um 21:09 Uhr schrieb Jin Mao <jin at tower-research.com
> >:
> >
> > I am running luminous and the objects were copied from Isilon with a
> long and similar prefix in path like /dir1/dir2/dir3/yyyy/mm/dd. The
> objects are copied to various buckets like
> bucket_YYYYMMDD/dir1/dir2/dir3/yyyy/mm/dd. This setup minimize some
> internal code change when moving from NFS to object store.
> >
> > I heard that CRUSH may NOT evenly balance OSDs if there are many common
> leading characters in the object name? However, I couldn't find any
> evidence to support this.
> >
> > Does anyone know further details about this?
> >
> > Thank you.
> >
> > Jin.
> > _______________________________________________
> > ceph-users mailing list
> > ceph-users at lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
> --
> Paul Emmerich
>
> Looking for help with your Ceph cluster? Contact us at https://croit.io
>
> croit GmbH
> Freseniusstr. 31h
> 81247 München
> www.croit.io
> Tel: +49 89 1896585 90
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20181001/b8d5c491/attachment.html>


More information about the ceph-users mailing list