[ceph-users] New OSD with weight 0, rebalance still happen...

Marco Gaiarin gaio at sv.lnf.it
Thu Nov 22 03:05:12 PST 2018


Mandi! Paweł Sadowsk
  In chel di` si favelave...

> We did similar changes a many times and it always behave as expected.

Ok. Good.

> Can you show you crushmap/ceph osd tree?

Sure!

 root at blackpanther:~# ceph osd tree
 ID WEIGHT   TYPE NAME               UP/DOWN REWEIGHT PRIMARY-AFFINITY 
 -1 21.83984 root default                                              
 -2  5.45996     host capitanamerica                                   
  0  1.81999         osd.0                up  1.00000          1.00000 
  1  1.81999         osd.1                up  1.00000          1.00000 
 10  0.90999         osd.10               up  1.00000          1.00000 
 11  0.90999         osd.11               up  1.00000          1.00000 
 -3  5.45996     host vedovanera                                       
  2  1.81999         osd.2                up  1.00000          1.00000 
  3  1.81999         osd.3                up  1.00000          1.00000 
  4  0.90999         osd.4                up  1.00000          1.00000 
  5  0.90999         osd.5                up  1.00000          1.00000 
 -4  5.45996     host deadpool                                         
  6  1.81999         osd.6                up  1.00000          1.00000 
  7  1.81999         osd.7                up  1.00000          1.00000 
  8  0.90999         osd.8                up  1.00000          1.00000 
  9  0.90999         osd.9                up  1.00000          1.00000 
 -5  5.45996     host blackpanther                                     
 12  1.81999         osd.12               up  0.04999          1.00000 
 13  1.81999         osd.13               up  0.04999          1.00000 
 14  0.90999         osd.14               up  0.04999          1.00000 
 15  0.90999         osd.15               up  0.04999          1.00000 

OSD 12-15 are the new OSD; after creating it with 'noin' i've
reweighted them to '0.05' (to make a test).


Crush map attached. Thanks.

-- 
dott. Marco Gaiarin				        GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''          http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

		Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
      http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
	(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
-------------- next part --------------
# begin crush map
tunable choose_local_tries 0
tunable choose_local_fallback_tries 0
tunable choose_total_tries 50
tunable chooseleaf_descend_once 1
tunable straw_calc_version 1

# devices
device 0 osd.0
device 1 osd.1
device 2 osd.2
device 3 osd.3
device 4 osd.4
device 5 osd.5
device 6 osd.6
device 7 osd.7
device 8 osd.8
device 9 osd.9
device 10 osd.10
device 11 osd.11
device 12 osd.12
device 13 osd.13
device 14 osd.14
device 15 osd.15

# types
type 0 osd
type 1 host
type 2 chassis
type 3 rack
type 4 row
type 5 pdu
type 6 pod
type 7 room
type 8 datacenter
type 9 region
type 10 root

# buckets
host capitanamerica {
	id -2		# do not change unnecessarily
	# weight 5.460
	alg straw
	hash 0	# rjenkins1
	item osd.0 weight 1.820
	item osd.1 weight 1.820
	item osd.10 weight 0.910
	item osd.11 weight 0.910
}
host vedovanera {
	id -3		# do not change unnecessarily
	# weight 5.460
	alg straw
	hash 0	# rjenkins1
	item osd.2 weight 1.820
	item osd.3 weight 1.820
	item osd.4 weight 0.910
	item osd.5 weight 0.910
}
host deadpool {
	id -4		# do not change unnecessarily
	# weight 5.460
	alg straw
	hash 0	# rjenkins1
	item osd.6 weight 1.820
	item osd.7 weight 1.820
	item osd.8 weight 0.910
	item osd.9 weight 0.910
}
host blackpanther {
	id -5		# do not change unnecessarily
	# weight 5.460
	alg straw
	hash 0	# rjenkins1
	item osd.12 weight 1.820
	item osd.13 weight 1.820
	item osd.14 weight 0.910
	item osd.15 weight 0.910
}
root default {
	id -1		# do not change unnecessarily
	# weight 21.840
	alg straw
	hash 0	# rjenkins1
	item capitanamerica weight 5.460
	item vedovanera weight 5.460
	item deadpool weight 5.460
	item blackpanther weight 5.460
}

# rules
rule replicated_ruleset {
	ruleset 0
	type replicated
	min_size 1
	max_size 10
	step take default
	step chooseleaf firstn 0 type host
	step emit
}

# end crush map


More information about the ceph-users mailing list