[ceph-users] CephFS desync

Henrik Korkuc lists at kirneh.eu
Fri Nov 3 00:40:48 PDT 2017


On 17-11-03 09:29, Andrey Klimentyev wrote:
> Thanks for a swift response.
>
> We are using 10.2.10.
>
> They all share the same set of permissions (and one key, too). Haven't 
> found anything incriminating in logs, too.
>
> caps: [mon] allow r
> caps: [osd] allow class-read object_prefix rbd_children, allow rwx 
> pool=rbd
>
Are you sure you pasted correct user permissions? It looks like you are 
using RBD permissions for CephFS and this seems to be the problem.

> On 3 November 2017 at 00:56, Gregory Farnum <gfarnum at redhat.com 
> <mailto:gfarnum at redhat.com>> wrote:
>
>     On Thu, Nov 2, 2017 at 9:05 AM Andrey Klimentyev
>     <andrey.klimentyev at flant.com <mailto:andrey.klimentyev at flant.com>>
>     wrote:
>
>         Hi,
>
>         we've recently hit a problem in a production cluster. The gist
>         of it is that sometimes file will be changed on one machine,
>         but only the "change time" would propagate to others. The
>         checksum is different. Contents, obviously, differ as well.
>         How can I debug this?
>
>         In other words, how would I approach such problem with "stuck
>         files"? Haven't found anything on Google or troubleshooting docs.
>
>
>     What versions are you running?
>     The only way I can think of this happening is if one of the
>     clients had permission to access the CephFS namespace on the MDS,
>     but not to write to the OSDs which store the file data. Have you
>     checked that the clients all have the same caps? ("ceph auth list"
>     or one of the related more-specific commands will let you compare.)
>     -Greg
>
>
>         -- 
>         Andrey Klimentyev,
>         DevOps engineer @ JSC «Flant»
>         http://flant.com/ <http://flant.ru/>
>         _______________________________________________
>         ceph-users mailing list
>         ceph-users at lists.ceph.com <mailto:ceph-users at lists.ceph.com>
>         http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>         <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>
>
>
>
>
> -- 
> Andrey Klimentyev,
> DevOps engineer @ JSC «Flant»
> http://flant.com/
> <http://flant.ru/>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20171103/48f51c86/attachment.html>


More information about the ceph-users mailing list