[ceph-users] Pool shard/stripe settings for file too large files?

Marc Roos M.Roos at f1-outsourcing.eu
Thu Nov 9 13:07:21 PST 2017


 
Do you know of a rados client that uses this? Maybe a simple 'mount' so 
I can cp the files on it?






-----Original Message-----
From: Christian Wuerdig [mailto:christian.wuerdig at gmail.com] 
Sent: donderdag 9 november 2017 22:01
To: Kevin Hrpcek
Cc: Marc Roos; ceph-users
Subject: Re: [ceph-users] Pool shard/stripe settings for file too large 
files?

It should be noted that the general advise is to not use such large 
objects since cluster performance will suffer, see also this thread:
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-September/021051.html

libradosstriper might be an option which will automatically break the 
object into smaller chunks

On Fri, Nov 10, 2017 at 9:08 AM, Kevin Hrpcek 
<kevin.hrpcek at ssec.wisc.edu> wrote:
> Marc,
>
> If you're running luminous you may need to increase 
osd_max_object_size.
> This snippet is from the Luminous change log.
>
> "The default maximum size for a single RADOS object has been reduced 
> from 100GB to 128MB. The 100GB limit was completely impractical in 
> practice while the 128MB limit is a bit high but not unreasonable. If 
> you have an application written directly to librados that is using 
> objects larger than 128MB you may need to adjust osd_max_object_size"
>
> Kevin
>
> On 11/09/2017 02:01 PM, Marc Roos wrote:
>
>
> I would like store objects with
>
> rados -p ec32 put test2G.img test2G.img
>
> error putting ec32/test2G.img: (27) File too large
>
> Changing the pool application from custom to rgw did not help
>
>
>
>
>
>
>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>




More information about the ceph-users mailing list