Lewisham residents are fighting against a developer after dozens of trees and saplings were removed from a nature conservation area.