Prince Andrew is continuing to live at Royal Lodge despite attempts by King Charles to encourage him to downsize.