[ceph-users] (no subject)

Oliver Freyermuth freyermuth at physik.uni-bonn.de
Sat Mar 10 15:46:33 PST 2018


Hi Nathan,

this indeed appears to be a Gentoo-specific issue. 
They install the file at:
/usr/libexec/ceph/ceph-osd-prestart.sh
instead of
/usr/lib/ceph/ceph-osd-prestart.sh

It depends on how you strongly you follow FHS ( http://refspecs.linuxfoundation.org/FHS_3.0/fhs/ch04s07.html )
which is the actual correct place to be used. It seems Gentoo packagers took FHS 3.0 seriously to decide where to install things,
but did not patch the code accordingly, so this surely warrants a Gentoo bug. 
Distro packagers should then decide whether they want to change install location (and rather follow Ceph upstream than FHS 3.0),
or patch the code to enforce FHS 3.0. 

https://bugs.gentoo.org/632028 is also related to that. 

Cheers,
	Oliver

Am 11.03.2018 um 00:34 schrieb Nathan Dehnel:
> Trying to create an OSD:
> 
> gentooserver ~ # ceph-volume lvm create --data /dev/sdb
> Running command: ceph-authtool --gen-print-key
> Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new e70500fe-0d51-48c3-a607-414957886726
> Running command: vgcreate --force --yes ceph-a736559a-92d1-483e-9289-d2c7feed510f /dev/sdb
>  stdout: Volume group "ceph-a736559a-92d1-483e-9289-d2c7feed510f" successfully created
> Running command: lvcreate --yes -l 100%FREE -n osd-block-e70500fe-0d51-48c3-a607-414957886726 ceph-a736559a-92d1-483e-9289-d2c7feed510f
>  stdout: Logical volume "osd-block-e70500fe-0d51-48c3-a607-414957886726" created.
> Running command: ceph-authtool --gen-print-key
> Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
> Running command: chown -R ceph:ceph /dev/dm-0
> Running command: ln -s /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 /var/lib/ceph/osd/ceph-0/block
> Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap
>  stderr: got monmap epoch 1
> Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg==
>  stdout: creating /var/lib/ceph/osd/ceph-0/keyring
>  stdout: added entity osd.0 auth auth(auid = 18446744073709551615 key=AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg== with 0 caps)
> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
> Running command: ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid e70500fe-0d51-48c3-a607-414957886726 --setuser ceph --setgroup ceph
> --> ceph-volume lvm prepare successful for: /dev/sdb
> Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 --path /var/lib/ceph/osd/ceph-0
> Running command: ln -snf /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 /var/lib/ceph/osd/ceph-0/block
> Running command: chown -R ceph:ceph /dev/dm-0
> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
> Running command: systemctl enable ceph-volume at lvm-0-e70500fe-0d51-48c3-a607-414957886726
>  stderr: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-volume at lvm-0-e70500fe-0d51-48c3-a607-414957886726.service → /lib/systemd/system/ceph-volume at .service.
> Running command: systemctl start ceph-osd at 0
>  stderr: Job for ceph-osd at 0.service failed because the control process exited with error code.
> See "systemctl status ceph-osd at 0.service" and "journalctl -xe" for details.
> --> Was unable to complete a new OSD, will rollback changes
> --> OSD will be fully purged from the cluster, because the ID was generated
> Running command: ceph osd purge osd.0 --yes-i-really-mean-it
>  stderr: purged osd.0
> -->  RuntimeError: command returned non-zero exit status: 1
> 
> journalctl -xe
> -- Unit ceph-osd at 0.service has begun starting up.
> Mar 10 17:14:34 gentooserver systemd[3977]: ceph-osd at 0.service: Failed to execute command: No such file or directory
> Mar 10 17:14:34 gentooserver systemd[3977]: ceph-osd at 0.service: Failed at step EXEC spawning /usr/lib/ceph/ceph-osd-prestart.sh: No such file or directory
> -- Subject: Process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed
> -- Defined-By: systemd
> -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
> -- 
> -- The process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed and failed.
> -- 
> -- The error number returned by this process is 2.
> Mar 10 17:14:34 gentooserver systemd[1]: ceph-osd at 0.service: Control process exited, code=exited status=203
> Mar 10 17:14:34 gentooserver systemd[1]: ceph-osd at 0.service: Failed with result 'exit-code'.
> Mar 10 17:14:34 gentooserver systemd[1]: Failed to start Ceph object storage daemon osd.0.
> -- Subject: Unit ceph-osd at 0.service has failed
> -- Defined-By: systemd
> -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
> -- 
> -- Unit ceph-osd at 0.service has failed.
> -- 
> -- The result is RESULT.
> 
> Why is this file missing? Should I file a bug with my distro's packager?
> 
> 
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 


-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5455 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20180311/43ac3eb9/attachment.bin>


More information about the ceph-users mailing list