Prince Harry the Duke of Sussex, reportedly spoke to his uncle about the possibility of changing his family’s last name to Spencer.

Prince Harry spoke to his Uncle Charles Spencer about the possibility of taking his mother, the late Princess Diana’s, last name according to a new report by PEOPLE.

The discussion to become a Spencer took place during a rare visit to the UK where Prince Harry met with his uncle, the 9th Earl Spencer, Princess Diana’s younger brother. This would involve Prince Harry and his family abandoning their current surname, Mountbatten-Windsor.

The two “had a very amicable conversation and Spencer advised him against taking such a step,” according to The Mail on Sunday. Charles told the Duke of Sussex that if he does go through with the name change that “the legal challenges would be insurmountable.”

Mountbatten comes from the late Prince Philip’s side of the family while Windsor was adopted as a royal surname back in 1917.

Currently, Prince Harry and wife Meghan Markle share two children, Prince Archie, 6 and Princess Lilibet who turns 4 this week. Despite Markle saying in her Netflix series that their last name was Sussex, the child’s last names on their birth certificates are Mountbatten-Windsor (as of now).