Dr Sandra Steel lives in a home on the adjacent St Swithun Street and spoke for residents at the planning meeting.
“The spreading roots cause structural damage,” she said.
Adding that “our historic houses are particularly vulnerable”.
Some of the properties on the road date back to the 17th Century and Ms Steel said there was evidence of “cracks in garden walls”.
She added that it was increasing the insurance of the local houses.
Despite these claims the council approved the protection order and said further evidence would need to be provided to consider the felling of the tree.
On hearing that verdict, Ms Steel said: “You are waiting for our houses to fall down I guess.”
Speaking after the meeting she said they all “feel extremely angry” and called it “quite ridiculous”.
“An oak tree belongs an open area or a forest, not in gardens of historic houses,” Ms Steel added.