[ceph-users] CephFS desync

Andrey Klimentyev andrey.klimentyev at flant.com
Fri Nov 3 00:41:57 PDT 2017


I am absolutely incorrect, my apologies.

caps: [mds] allow rw
caps: [mon] allow r
caps: [osd] allow rwx pool=cephfs_metadata, allow rwx pool=cephfs_data

On 3 November 2017 at 10:40, Henrik Korkuc <lists at kirneh.eu> wrote:

> On 17-11-03 09:29, Andrey Klimentyev wrote:
>
> Thanks for a swift response.
>
> We are using 10.2.10.
>
> They all share the same set of permissions (and one key, too). Haven't
> found anything incriminating in logs, too.
>
> caps: [mon] allow r
> caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=rbd
>
> Are you sure you pasted correct user permissions? It looks like you are
> using RBD permissions for CephFS and this seems to be the problem.
>
> On 3 November 2017 at 00:56, Gregory Farnum <gfarnum at redhat.com> wrote:
>
>> On Thu, Nov 2, 2017 at 9:05 AM Andrey Klimentyev <
>> andrey.klimentyev at flant.com> wrote:
>>
>>> Hi,
>>>
>>> we've recently hit a problem in a production cluster. The gist of it is
>>> that sometimes file will be changed on one machine, but only the "change
>>> time" would propagate to others. The checksum is different. Contents,
>>> obviously, differ as well. How can I debug this?
>>>
>>> In other words, how would I approach such problem with "stuck files"?
>>> Haven't found anything on Google or troubleshooting docs.
>>>
>>
>> What versions are you running?
>> The only way I can think of this happening is if one of the clients had
>> permission to access the CephFS namespace on the MDS, but not to write to
>> the OSDs which store the file data. Have you checked that the clients all
>> have the same caps? ("ceph auth list" or one of the related more-specific
>> commands will let you compare.)
>> -Greg
>>
>>
>>>
>>> --
>>> Andrey Klimentyev,
>>> DevOps engineer @ JSC «Flant»
>>> http://flant.com/ <http://flant.ru/>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users at lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>
>
> --
> Andrey Klimentyev,
> DevOps engineer @ JSC «Flant»
> http://flant.com/
> <http://flant.ru/>
>
>
> _______________________________________________
> ceph-users mailing listceph-users at lists.ceph.comhttp://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>


-- 
Andrey Klimentyev,
DevOps engineer @ JSC «Flant»
http://flant.com/ <http://flant.ru/>
+7 (495) 721-10-27, ext. 487
+7 (960) 180-38-98
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20171103/a6c2ae4b/attachment.html>


More information about the ceph-users mailing list