[ceph-users] Configuring Ceph using multiple networks

Sinan Polat sinan at turka.nl
Sat Oct 7 11:45:32 PDT 2017


Why do your put your mons inside your cluster network, shouldn't they reisde within the public network?

Cluster network is only for replica data / for traffic between your osds.

> Op 7 okt. 2017 om 14:32 heeft Kashif Mumtaz <kashif.mumtaz at yahoo.com> het volgende geschreven:
> 
> 
> 
> I have successfully installed Luminous on Ubutnu  16.04 by one network.
>  
> Now I am trying to install same by using two networks this.(on different machine)
> public network =   192.168.10.0/24
> cluster network =  172.16.50.0/24
>  
> Eeach node has two interfaces. One in public network other in cluster network.
>  
>  
> While creating the initial monitors  facing the the below error
>  
> “Some monitors have still not reached quorum”
>  
> Below is /etc/hosts file on each host
> 172.16.50.1 mon1
> 172.16.50.2 mon2
> 172.16.50.3 mon3
> 172.16.50.4 osd1
> 172.16.50.5 osd2
>  
> This is ceph.conf  file
> mon1:/home/cephadmin/my-cluster# cat ceph.conf
> [global]
> fsid = 7f0ffa2b-7528-407b-8a63-360741d80939
> mon_initial_members = mon1, mon2, mon3
> mon_host = 172.16.50.1,172.16.50.2,172.16.50.3
> auth_cluster_required = cephx
> auth_service_required = cephx
> auth_client_required = cephx
>  
> # Public and cluster network
> public network =   192.168.10.0/24
> cluster network =  172.16.50.0/24
> # Write an object 2 times
> osd pool default size = 2
> # 1 for a multi node cluster in a single rack
> osd crush chooseleaf type = 1
>  
>  
>  
> While searching on net , I found same error discussed in below post
>  
> https://www.spinics.net/lists/ceph-users/msg24603.html
>  
> I am observing same error in my case  that during ceph-deploy mon create-initial  all devices name are not resolving properly.
>  
> Log:
> [2017-10-07 00:31:18,975][mon1][DEBUG ] status for monitor: mon.mon1
> [2017-10-07 00:31:18,976][mon1][DEBUG ] {
> [2017-10-07 00:31:18,976][mon1][DEBUG ]   "election_epoch": 0,
> [2017-10-07 00:31:18,976][mon1][DEBUG ]   "extra_probe_peers": [
> [2017-10-07 00:31:18,976][mon1][DEBUG ]     "172.16.50.1:6789/0",
> [2017-10-07 00:31:18,977][mon1][DEBUG ]     "172.16.50.2:6789/0",
> [2017-10-07 00:31:18,977][mon1][DEBUG ]     "172.16.50.3:6789/0
> [2017-10-07 00:31:18,982][mon1][DEBUG ]         "addr": "192.168.10.31:6789/0",
> [2017-10-07 00:31:18,982][mon1][DEBUG ]         "name": "mon1",
> [2017-10-07 00:31:18,982][mon1][DEBUG ]         "public_addr": "192.168.10.31:6789/0",
> [2017-10-07 00:31:18,982][mon1][DEBUG ]         "rank": 0
> [2017-10-07 00:31:18,983][mon1][DEBUG ]       },
> [2017-10-07 00:31:18,983][mon1][DEBUG ]       {
> [2017-10-07 00:31:18,983][mon1][DEBUG ]         "addr": "0.0.0.0:0/1",
> [2017-10-07 00:31:18,983][mon1][DEBUG ]         "name": "mon2",
> [2017-10-07 00:31:18,983][mon1][DEBUG ]         "public_addr": "0.0.0.0:0/1",
> [2017-10-07 00:31:18,983][mon1][DEBUG ]         "rank": 1
> [2017-10-07 00:31:18,984][mon1][DEBUG ]       },
> [2017-10-07 00:31:18,984][mon1][DEBUG ]       {
> [2017-10-07 00:31:18,984][mon1][DEBUG ]         "addr": "0.0.0.0:0/2",
> [2017-10-07 00:31:18,984][mon1][DEBUG ]         "name": "mon3",
> [2017-10-07 00:31:18,984][mon1][DEBUG ]         "public_addr": "0.0.0.0:0/2",
> [2017-10-07 00:31:18,985][mon1][DEBUG ]         "rank": 2
>  
>  
>  
> I configured the DNS also as suggested solution in above link, but  issue did not resolve.
>  
> Can some one help in this regard?
>  
> I am not sue in DNSlooup name should be resolve to node’s public IP or cluster IP?
>  
> In /etc/hosts file which IP of nodes should use cluster or public ?
>  
>  
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20171007/091ed343/attachment.html>


More information about the ceph-users mailing list