There does not appear to be any height limit to the search. I was at the mouth of a cave and selected some plant and my character ran all the way around the mountain to end up on top of the cave to pick the plant and I couldn’t find a way to cancel it.

So, needs some work but it’s still mostly useful. Haha