Re: [Boost-users] Writing large binary files with boost gzip

Subject: Re: [Boost-users] Writing large binary files with boost gzip
From: Anders Knudby (knudby_at_[hidden])
Date: 2011-04-07 20:39:07

Many thanks for the quick response. And apologies for being a total newbie,
but how do I close the stream (and how do I check that it has been closed)?
With normal iostreams I would just write "out.close();", out being the name
of the stream. But that doesn't seem to be the way to do it for
filtering_iostreams?!? And I would think it would close when it goes out of
scope, but I haven't checked. Any help appreciated. I'm pleased it worked
for you on Linux, but I'm largely stuck with Windows for the time being...

Anders

On Thu, Apr 7, 2011 at 4:28 PM, Steven Watanabe <watanabesj_at_[hidden]>wrote:

> AMDG
>
>
> On 04/07/2011 12:09 PM, Anders Knudby wrote:
>
>> Hello all, please help! I'm truly banging my head against the wall here. I
>> am trying to write a function that will allow me to write gzipped binary
>> files (~50 MB) and read them again. I have data in memory. Here's my code
>> for writing:
>>
>>     namespace io = boost::iostreams;
>>
>>     filename = "c:/test.bin.gz"; //My output file
>>     int size = 5000000; //Data size in bytes, ~5 MB
>>
>>     //Create filtering_ostream
>>     io::filtering_ostream out; //Creates a filtering_ostream called out
>>     out.push(io::gzip_compressor()); //Assigns the gzip_compressor to out
>>     out.push(io::file_sink(filename)); //Assigns a file sink to out
>>
>>     char* memblock = new char [size]; //This is my data. In reality
>> memblock
>> will have been created earlier and filled with real data
>>
>>     out.write(memblock, size); //Do the writing
>>
>>     delete[] memblock; //Clean up
>>
>>
>> As written above the resulting file, c:/test.bin.gz, is corrupt. If I try
>> to
>> decompress it, either with gzip or winrar, I get an error message.
>> However,
>> if I instead set size = 4000000 (~4 MB) (slightly smaller), the resulting
>> file works just fine. My problem therefore is that my actual size is 50
>> MB...
>>
>>
> Have you checked that the stream is closed correctly?
> I tried on Linux, and it seemed to work fine
> after a added #includes/main etc.
>
> In Christ,
> Steven Watanabe
> _______________________________________________
> Boost-users mailing list
> Boost-users_at_[hidden]
> http://lists.boost.org/mailman/listinfo.cgi/boost-users
>

-- 
Anders Knudby, PhD
e-mail: knudby_at_[hidden]
skype ID: anders.knudby
Man's mind, once stretched by a new idea, never regains its original
dimensions.
~ Oliver Wendell Holmes