[ceph-users] Filestore to Bluestore migration question

Hayashida, Mami mami.hayashida at uky.edu
Tue Nov 6 07:48:19 PST 2018


All other OSDs that I converted (#60-69) look basically identical while the
Filestore OSDs (/var/lib/ceph/osd/ceph-70 etc.) look different obviously.
When I run "df" it does NOT list those converted osds (only the Filestore
ones).  In other words, /dev/sdh1 where osd.60 should be is not listed.
(Should it be?)  Neither does mount lists that drive.   ("df | grep sdh"
and "mount | grep sdh" both return nothing)




On Tue, Nov 6, 2018 at 10:42 AM, Hector Martin <hector at marcansoft.com>
wrote:

>
>
> On 11/7/18 12:30 AM, Hayashida, Mami wrote:
> > So, currently this is what /var/lib/ceph/osd/ceph-60 shows.  Is it not
> > correct?   I don't know what I should expect to see.
> >
> > root at osd1:~# ls -l /var/lib/ceph/osd/ceph-60
> > total 86252
> > -rw-r--r-- 1 ceph ceph         384 Nov  2 16:20 activate.monmap
> > -rw-r--r-- 1 ceph ceph 10737418240 Nov  5 16:32 block
> > lrwxrwxrwx 1 ceph ceph          14 Nov  2 16:20 block.db ->
> /dev/ssd0/db60
> > -rw-r--r-- 1 ceph ceph           2 Nov  2 16:20 bluefs
> > -rw-r--r-- 1 ceph ceph          37 Nov  2 16:20 ceph_fsid
> > -rw-r--r-- 1 ceph ceph          37 Nov  2 16:20 fsid
> > -rw------- 1 ceph ceph          57 Nov  2 16:20 keyring
> > -rw-r--r-- 1 ceph ceph           8 Nov  2 16:20 kv_backend
> > -rw-r--r-- 1 ceph ceph          21 Nov  2 16:20 magic
> > -rw-r--r-- 1 ceph ceph           4 Nov  2 16:20 mkfs_done
> > -rw-r--r-- 1 ceph ceph          41 Nov  2 16:20 osd_key
> > -rw-r--r-- 1 ceph ceph           6 Nov  2 16:20 ready
> > -rw-r--r-- 1 ceph ceph          10 Nov  2 16:20 type
> > -rw-r--r-- 1 ceph ceph           3 Nov  2 16:20 whoami
>
> Are all the other OSDs like this? What is mounted on those directories
> (i.e. what do "df" and "mount" show)?
>
> All those files are dated Nov 2, yet it should be a tmpfs and you
> rebooted after that date, so I think something's wrong here.
>
> > The disk I am using for this osd (osd.60) is a 3.7TB hdd.
> >
> > lsblk shows
> >
> > sdh              8:112  0   3.7T  0 disk
> > └─hdd60-data60 252:1    0   3.7T  0 lvm
> >
> > and "ceph osd tree" shows
> > 60   hdd    3.63689         osd.60         up  1.00000 1.00000
>
> That looks correct as far as the weight goes, but I'm really confused as
> to why you have a 10GB "block" file. That should be a symlink to the
> hdd60/data60 device as far as I know.
>
> --
> Hector Martin (hector at marcansoft.com)
> Public Key: https://mrcn.st/pub
>



-- 
*Mami Hayashida*

*Research Computing Associate*
Research Computing Infrastructure
University of Kentucky Information Technology Services
301 Rose Street | 102 James F. Hardymon Building
Lexington, KY 40506-0495
mami.hayashida at uky.edu
(859)323-7521
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20181106/b5550020/attachment.html>


More information about the ceph-users mailing list