Forum: Ruby Marshal.dump/load limitations on size?

Announcement (2017-05-07): www.ruby-forum.com is now read-only since I unfortunately do not have the time to support and maintain the forum any more. Please see rubyonrails.org/community and ruby-lang.org/en/community for other Rails- und Ruby-related community platforms.
Bb4bdf2b184027bc38d4fb529770cde5?d=identicon&s=25 Wes Gamble (weyus)
on 2007-03-06 01:11
All,

Does anyone know if there are any implicit limitations to the size of an
object that Marshal.dump/load can handle?

I have a biiig object that I'm trying to dump and load and it seems to
be failing and I just want to know if I shouldn't even expect to be able
to dump/load an object bigger than X.

Thanks,
Wes
1b5341b64f7ce0244366eae17f06c801?d=identicon&s=25 unknown (Guest)
on 2007-03-06 01:16
(Received via mailing list)
On Tue, 6 Mar 2007, Wes Gamble wrote:

> Does anyone know if there are any implicit limitations to the size of an
> object that Marshal.dump/load can handle?
>
> I have a biiig object that I'm trying to dump and load and it seems to
> be failing and I just want to know if I shouldn't even expect to be able
> to dump/load an object bigger than X.

RAM.  That's your only size limitation.


Kirk Haines
Bb4bdf2b184027bc38d4fb529770cde5?d=identicon&s=25 Wes Gamble (weyus)
on 2007-03-06 07:42
> RAM.  That's your only size limitation.

Any chance that memcached (which uses Marshal) imposes any sort of size
limitation?

Wes
6076c22b65b36f5d75c30bdcfb2fda85?d=identicon&s=25 Ezra Zygmuntowicz (Guest)
on 2007-03-06 08:14
(Received via mailing list)
On Mar 5, 2007, at 10:42 PM, Wes Gamble wrote:

>> RAM.  That's your only size limitation.
>
> Any chance that memcached (which uses Marshal) imposes any sort of
> size
> limitation?
>
> Wes


  Memecahed only imposes the size limitation you set in its config
file. /etc/conf.d/memcached on gentoo is where you can set the max
memory for the memcached daemon. If you are hitting that limit then
it won't go any further until you set it to a higher threshold and
restart memcached.

Cheers-
-- Ezra Zygmuntowicz
-- Lead Rails Evangelist
-- ez@engineyard.com
-- Engine Yard, Serious Rails Hosting
-- (866) 518-YARD (9273)
Bb4bdf2b184027bc38d4fb529770cde5?d=identicon&s=25 Wes Gamble (weyus)
on 2007-03-07 17:53
One last piece of info:

memcached does impose a limit of 1MB (actually just under 1MB) on the
size of any one item that is stored.

For my project, I've modified memcache-client to handle larger objects
by breaking them into pieces and reconstituting them within the API.

Wes
This topic is locked and can not be replied to.