[ceph-users] How to lower log verbosity

Marc Roos M.Roos at f1-outsourcing.eu
Sun Mar 17 15:04:34 PDT 2019


 
I am not sure if it is any help but this is getting you some debug 
settings

ceph daemon osd.0 config show| grep debug | grep "[0-9]/[0-9]"

And eg. with such a loop you can set them to 0/0

logarr[debug_compressor]="1/5"
logarr[debug_bluestore]="1/5"
logarr[debug_bluefs]="1/5"
logarr[debug_bdev]="1/3"
logarr[debug_kstore]="1/5"
logarr[debug_rocksdb]="4/5"
logarr[debug_leveldb]="4/5"
logarr[debug_memdb]="4/5"
logarr[debug_kinetic]="1/5"
logarr[debug_fuse]="1/5"
logarr[debug_mgr]="1/5"
logarr[debug_mgrc]="1/5"
logarr[debug_dpdk]="1/5"
logarr[debug_eventtrace]="1/5"


for k in "${!logarr[@]}"
do
  ceph tell osd.* injectargs --$k=0/0
done




-----Original Message-----
From: Alex Litvak [mailto:alexander.v.litvak at gmail.com] 
Sent: 17 March 2019 16:16
To: ceph-users at lists.ceph.com
Cc: ceph-devel at vger.kernel.org
Subject: [ceph-users] How to lower log verbosity

Hello everyone,

As I am troubleshooting an issue I see logs literally littered with 
messages such as below.  I searched documentation and couldn't find a 
specific debug nob to turn.  I see some debugging is on by default but I 
don't need to see staff below especially mgr and client repeating.  Also 
I am not sure what the difference with memory vs file debug ratios.  
Thanks in advance for any hint.


Mar 17 08:11:44 storage1n1-chi docker[13518]: audit 2019-03-17 
08:11:43.045636 mgr.storage1n2-chi mgr.394322 10.1.40.62:0/19661 3377 : 
audit [DBG] from='client.320702 10.1.40.62:0/3859627195' 
entity='client.admin' cmd=[{"width": 80, "prefix": "iostat", "poll": 
true, "target": ["mgr", ""], "print_header": false}]: dispatch
Mar 17 08:11:44 storage1n1-chi docker[13518]: audit 2019-03-17 
08:11:43.048607 mgr.storage1n2-chi mgr.394322 10.1.40.62:0/19661 3378 : 
audit [DBG] from='client.328541 10.1.40.62:0/748275798' 
entity='client.admin' cmd=[{"width": 80, "prefix": "iostat", "poll": 
true, "target": ["mgr", ""], "print_header": false}]: dispatch
Mar 17 08:11:44 storage1n1-chi docker[13518]: audit 2019-03-17 
08:11:43.921762 mgr.storage1n2-chi mgr.394322 10.1.40.62:0/19661 3379 : 
audit [DBG] from='client.341603 10.1.40.62:0/535963786' 
entity='client.admin' cmd=[{"width": 80, "prefix": "iostat", "poll": 
true, "target": ["mgr", ""], "print_header": false}]: dispatch

Mar 17 08:11:25 storage1n1-chi bf695c816174[17083]: 2019-03-17 
08:11:25.845 7fe9ddb4f700  1 mgr send_beacon standby
Mar 17 08:11:25 storage1n1-chi docker[13941]: 2019-03-17 08:11:25.845 
7fe9ddb4f700  1 mgr send_beacon standby
Mar 17 08:11:27 storage1n1-chi bf695c816174[17083]: 2019-03-17 
08:11:27.865 7fe9ddb4f700  1 mgr send_beacon standby
Mar 17 08:11:27 storage1n1-chi docker[13941]: 2019-03-17 08:11:27.865 
7fe9ddb4f700  1 mgr send_beacon standby
Mar 17 08:11:29 storage1n1-chi bf695c816174[17083]: 2019-03-17 
08:11:29.885 7fe9ddb4f700  1 mgr send_beacon standby
Mar 17 08:11:29 storage1n1-chi docker[13941]: 2019-03-17 08:11:29.885 
7fe9ddb4f700  1 mgr send_beacon standby

Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27d16700  1 mgr.server reply handle_command (0) Success 
|  299 KiB/s |  122 KiB/s |  421 KiB/s |        306 |         17 
|        324 |
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  0 log_channel(audit) log [DBG] : 
from='client.320702 10.1.40.62:0/3859627195' entity='client.admin' 
cmd=[{"width": 80, "prefix": "iostat", "poll": true, "target": ["mgr", 
""], "print_header": false}]: dispatch
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer status'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer mode'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer on'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer off'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer eval'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer eval-verbose'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer optimize'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer show'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer rm'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer reset'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer dump'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'balancer execute'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-login-credentials'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-session-expire'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard create-self-signed-cert'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-access-key'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-port'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-enable-browsable-api'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-port'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-admin-resource'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-secret-key'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-scheme'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-enable-browsable-api'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-user-id'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-admin-resource'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-access-key'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rest-requests-timeout'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-scheme'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-host'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rgw-api-user-id'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard get-rest-requests-timeout'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-host'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'dashboard set-rgw-api-secret-key'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'hello'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'influx config-set'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'influx config-show'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'influx send'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'influx self-test'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27515700  1 mgr.server handle_command pyc_prefix: 
'iostat'
Mar 17 08:13:05 storage1n2-chi ecbe67c5b2e7[36572]: 2019-03-17 
08:13:05.302 7f9c27d16700  1 mgr.server reply handle_command (0) Success 
|  299 KiB/s |  122 KiB/s |  421 KiB/s |        306 |         17 
|        324 |
^C

_______________________________________________
ceph-users mailing list
ceph-users at lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




More information about the ceph-users mailing list