I had a similar use-case, I simply used a scoped_ptr as member.