Residents are terrified a large tree could fall and flatten their homes – but the council has refused to take action.