[ceph-users] Configuring Ceph using multiple networks

Kashif Mumtaz kashif.mumtaz at yahoo.com
Sat Oct 7 05:32:46 PDT 2017



I have successfully installed Luminous on Ubutnu  16.04 by one network.
 
Now I am trying to install same by using two networksthis.(on different machine)public network=   192.168.10.0/24

cluster network=  172.16.50.0/24

 Eeach node has two interfaces. One in public networkother in cluster network.  While creating the initial monitors  facing the the below error
 
“Some monitors have still notreached quorum”


 
Below is /etc/hosts file on each host172.16.50.1 mon1172.16.50.2 mon2172.16.50.3 mon3172.16.50.4 osd1172.16.50.5 osd2
 
This is ceph.conf filemon1:/home/cephadmin/my-cluster# cat ceph.conf[global]fsid = 7f0ffa2b-7528-407b-8a63-360741d80939mon_initial_members = mon1, mon2, mon3mon_host = 172.16.50.1,172.16.50.2,172.16.50.3auth_cluster_required = cephxauth_service_required = cephxauth_client_required = cephx
 
# Public and cluster networkpublic network =  192.168.10.0/24cluster network = 172.16.50.0/24# Write an object 2 timesosd pool default size = 2# 1 for a multi node cluster in a single rackosd crush chooseleaf type = 1
 

 

 
While searching on net , I found same error discussed inbelow post
 
https://www.spinics.net/lists/ceph-users/msg24603.html
 
I am observing same error in my case  that during ceph-deploy moncreate-initial  all devices name are notresolving properly.


 
Log:

[2017-10-0700:31:18,975][mon1][DEBUG ] status for monitor: mon.mon1

[2017-10-0700:31:18,976][mon1][DEBUG ] {

[2017-10-07 00:31:18,976][mon1][DEBUG]   "election_epoch": 0,

[2017-10-0700:31:18,976][mon1][DEBUG ]  "extra_probe_peers": [

[2017-10-0700:31:18,976][mon1][DEBUG ]    "172.16.50.1:6789/0",

[2017-10-0700:31:18,977][mon1][DEBUG ]    "172.16.50.2:6789/0",

[2017-10-07 00:31:18,977][mon1][DEBUG]     "172.16.50.3:6789/0

[2017-10-07 00:31:18,982][mon1][DEBUG ]         "addr":"192.168.10.31:6789/0",

[2017-10-07 00:31:18,982][mon1][DEBUG ]         "name": "mon1",

[2017-10-07 00:31:18,982][mon1][DEBUG ]         "public_addr":"192.168.10.31:6789/0",

[2017-10-07 00:31:18,982][mon1][DEBUG ]         "rank": 0

[2017-10-0700:31:18,983][mon1][DEBUG ]       },

[2017-10-0700:31:18,983][mon1][DEBUG ]       {

[2017-10-0700:31:18,983][mon1][DEBUG ]        "addr": "0.0.0.0:0/1",

[2017-10-0700:31:18,983][mon1][DEBUG ]        "name": "mon2",

[2017-10-0700:31:18,983][mon1][DEBUG ]        "public_addr": "0.0.0.0:0/1",

[2017-10-0700:31:18,983][mon1][DEBUG ]         "rank": 1

[2017-10-0700:31:18,984][mon1][DEBUG ]       },

[2017-10-0700:31:18,984][mon1][DEBUG ]       {

[2017-10-0700:31:18,984][mon1][DEBUG ]        "addr": "0.0.0.0:0/2",

[2017-10-0700:31:18,984][mon1][DEBUG ]        "name": "mon3",

[2017-10-0700:31:18,984][mon1][DEBUG ]        "public_addr": "0.0.0.0:0/2",

[2017-10-0700:31:18,985][mon1][DEBUG ]        "rank": 2


 

 

 
I configured the DNS also as suggested solution in above link, but  issue did not resolve.


 
Can some one help in this regard?


 
I am not sue in DNSlooup name should be resolve to node’s public IP orcluster IP?


 
In /etc/hosts file which IP of nodes should use cluster or public ?


 

 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20171007/a0ddb7c7/attachment.html>


More information about the ceph-users mailing list