[ceph-users] tcmu iscsi (failover not supported)

Brady Deetz bdeetz at gmail.com
Wed Oct 10 11:13:57 PDT 2018


Thanks for the response.
I am using gwcli for configuration. We are not using ansible.

I built the following from from git releases because centos mirrors are far
behind.
rtslib-fb v2.1.fb69 https://github.com/open-iscsi/rtslib-fb.git
targetcli-fb v2.1.fb49 https://github.com/open-iscsi/targetcli-fb.git
ceph-iscsi-config v2.6 https://github.com/ceph/ceph-iscsi-config.git
ceph-iscsi-cli v2.7 https://github.com/ceph/ceph-iscsi-cli.git
tcmu-runner v1.4.0 https://github.com/open-iscsi/tcmu-runner.git

[root at dc1srviscsi02 ~]# rpm -qa | egrep "ceph|rbd|kernel-ml"
python-rbd-13.2.2-0.el7.x86_64
ceph-mds-13.2.2-0.el7.x86_64
ceph-mgr-13.2.2-0.el7.x86_64
ceph-release-1-1.el7.noarch
ceph-common-13.2.2-0.el7.x86_64
ceph-mon-13.2.2-0.el7.x86_64
ceph-13.2.2-0.el7.x86_64
libcephfs2-13.2.2-0.el7.x86_64
ceph-base-13.2.2-0.el7.x86_64
ceph-osd-13.2.2-0.el7.x86_64
ceph-radosgw-13.2.2-0.el7.x86_64
kernel-ml-4.18.12-1.el7.elrepo.x86_64
python-cephfs-13.2.2-0.el7.x86_64
librbd1-13.2.2-0.el7.x86_64
ceph-selinux-13.2.2-0.el7.x86_64
librbd-devel-13.2.2-0.el7.x86_64

[root at dc1srviscsi02 ~]# getenforce
Disabled

[root at dc1srviscsi02 ~]# gwcli
/> ls
o- /
.........................................................................................................................
[...]
  o- clusters
........................................................................................................
[Clusters: 1]
  | o- ceph
............................................................................................................
[HEALTH_OK]
  |   o- pools
.........................................................................................................
[Pools: 12]
  |   | o- cephfs_data
................................................................. [(x3),
Commit: 0b/77.0T (0%), Used: 366.4T]
  |   | o- cephfs_metadata
............................................................... [(x3),
Commit: 0b/77.0T (0%), Used: 256M]
  |   | o- iscsi-primary
................................................................ [(x3),
Commit: 0b/77.0T (0%), Used: 11.2T]
  |   | o- iscsi-secondary
............................................................... [(x3),
Commit: 0b/77.0T (0%), Used: 7.9T]
  |   | o- it_share
....................................................................
[(9+1), Commit: 0b/26.5T (0%), Used: 84.2T]
  |   | o- nvme
...........................................................................
[(x3), Commit: 0b/5.0T (0%), Used: 1.0T]
  |   | o- one
...........................................................................
[(x3), Commit: 0b/77.0T (0%), Used: 765G]
  |   | o- rbd
.........................................................................
[(x3), Commit: 2.1T/77.0T (2%), Used: 112G]
  |   | o- vmware_rep
................................................................... [(x3),
Commit: 0b/77.0T (0%), Used: 10.3T]
  |   | o- vmware_ssd
................................................................... [(4+1),
Commit: 0b/11.1T (0%), Used: 515G]
  |   | o- vmware_ssd_2_1
................................................................ [(3+0),
Commit: 0b/12.4T (0%), Used: 19b]
  |   | o- vmware_ssd_metadata
............................................................ [(x3), Commit:
0b/77.0T (0%), Used: 36b]
  |   o- topology
..............................................................................................
[OSDs: 404,MONs: 3]
  o- disks
........................................................................................................
[2.1T, Disks: 3]
  | o- rbd.EyeTracker1_0
....................................................................................
[EyeTracker1_0 (2.0T)]
  | o- rbd.EyeTracker1_1
.....................................................................................
[EyeTracker1_1 (60G)]
  o- iscsi-target
.....................................................................................................
[Targets: 1]
    o- iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw
.....................................................................
[Gateways: 2]
      o- gateways
............................................................................................
[Up: 2/2, Portals: 2]
      | o- dc1srviscsi01
.....................................................................................
[10.124.103.109 (UP)]
      | o- dc1srviscsi02
.....................................................................................
[10.124.103.110 (UP)]
      o- host-groups
..................................................................................................
[Groups : 1]
      o- hosts
..........................................................................................................
[Hosts: 4]
        o- iqn.1991-05.com.microsoft:eyetracker1
...................................................... [Auth: None, Disks:
2(2.1T)]
        | o- lun 0
.................................................................
[rbd.EyeTracker1_0(2.0T), Owner: dc1srviscsi02]
        | o- lun 1
..................................................................
[rbd.EyeTracker1_1(60G), Owner: dc1srviscsi01]


On Wed, Oct 10, 2018 at 1:01 PM Mike Christie <mchristi at redhat.com> wrote:

> On 10/10/2018 12:40 PM, Mike Christie wrote:
> > On 10/09/2018 05:09 PM, Brady Deetz wrote:
> >> I'm trying to replace my old single point of failure iscsi gateway with
> >> the shiny new tcmu-runner implementation. I've been fighting a Windows
> >> initiator all day. I haven't tested any other initiators, as Windows is
> >> currently all we use iscsi for.
> >>
> >> One issue I've considered is our Ceph cluster is running 12.2.8 but I
> >> built my iscsi gateways against 13.2.2 since we will be moving to mimic
> >> within the next month or so.
> >>
> >> I compiled tcmu-runner with default options against 13.2.2 on a fresh
> >> fully updated version of centos 7.5.1804 with elrepo kernel 4.18.12-1.
> >>
> >> syslog:
> >> Oct  9 16:55:31 dc1srviscsi01 tcmu-runner: tcmu_get_alua_grp:225
> >> rbd/rbd.test_0: Unsupported alua_access_type: Implicit and Explicit
> >> failover not supported.
> >
> > We do not yet support explicit failover. Did you use targetcli directly
> > to set this up or did you use the ceph-iscsi tools?
> >
> > If you are using targetlci then you need to set alua_access_type to 1.
> > In the rc releases for 1.4.0 we had explicit enabled but there were too
> > many bugs and never got to fully QA it so for the final release it was
> > disabled.
> >
> > If you used the ceph-iscsi tools did you use ansible or gwcli and what
> > versions of ceph-iscsi-config and ceph-iscsi-cli or ceph-ansible?
>
> Ignore that. ceph-iscsi-config 2.6 enabled explicit alua in anticipation
> for the tcmu-runner support. We are about to release 2.7 which matches
> tcmu-runner 1.4.0.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20181010/66d7da73/attachment.html>


More information about the ceph-users mailing list