How damp is the area where you removed the wood? Do you see any strands that look like thin roots creeping across the surface of masonry behind where you removed the wood or anywhere else? Is there any damp ingress from any of the usual culprits ie high exterior ground level, faulty gutters/down pipes or leaking roofs?