Update, there's an easier way to reproduce this as a box-segment intersection: http://stackoverflow.com/questions/32457920/boost-rtree-of-box-gives-wrong-intersection-with-segment