How to approach this? (Planar tracker)

[kudizg]

I'm working on a shot and I need to track brick wall so I can put text on it. All is well until tree enters the frame. I tried manually adjusting keyframes, using regular tracker, etc., and no end result was satisfactory so far.

So my question is how to approach this problem?

[Fefson]

Can you (temporarily) track the building on the right, and then offset your text to fit the brick wall?

[ShadowMaker SdR]

Or you can restart your track when the building comes out from benath the tree. The nice thing is that it almost completely covers the building, so any shifts between left and right side of the tree will not be too noticeable.

[Faust]

Have you created a garbage matte for the tree? The nice thing about this is that you can keep your tracker where it is, only adding onto the side when needed as fefson suggested

[ShadowMaker SdR]

Completely forgot about the garbage matte option.
To make it even more fun: planar track the tree first to semi-automate your garbage mask!