[ceph-users] rwg/civetweb log verbosity level

zyn赵亚楠 zhao_yn at Ctrip.com
Tue Nov 27 22:03:20 PST 2018

Hi there,

I have a question about rgw/civetweb log settings.

Currently, rgw/civetweb prints 3 lines of logs with loglevel 1 (high priority) for each HTTP request, like following:

$ tail /var/log/ceph/ceph-client.rgw.node-1.log
2018-11-28 11:52:45.339229 7fbf2d693700  1 ====== starting new request req=0x7fbf2d68d190 =====
2018-11-28 11:52:45.341961 7fbf2d693700  1 ====== req done req=0x7fbf2d68d190 op status=0 http_status=200 ======
2018-11-28 11:52:45.341993 7fbf2d693700  1 civetweb: 0x558f04330000: - - [28/Nov/2018:11:48:10 +0800] "HEAD /swift/v1/images.xxx.com/8801234/BFAB307D-F5FE-4BC6-9449-E854944A460F_160_180.jpg HTTP/1.1" 1 0 - goswift/1.0

The above 3 lines occupies roughly 0.5KB space on average, varying a little with the lengths of bucket names and object names.

Now the problem is, when requests are intensive, it will consume a huge mount of space. For example, 4 million requests (on a single RGW node) will result to 2GB, which takes only ~6 hours to happen in our cluster node in busy period (a large part may be HEAD requests).

When trouble shooting, I usually need to turn the loglevel to 5, 10 or even bigger to check the detailed logs, but most of the log space is occupied by the above access logs (level 1), which doesn’t provide much information.

My question is, is there a way to configure Ceph skip those logs? E.g. only print logs with verbosity in a specified range (NOT support, according to my investigation).
Or, are there any suggested ways for turning on more logs for debugging?

Best Regards
Arthur Chiao

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20181128/15b8073f/attachment.html>

More information about the ceph-users mailing list