The castle did not play a significant part in the border warfare against Scotland. In the Wars of the Roses the castle was held for the Lancastrians in 1462 and 1464. The damage done was not made good and the castle fell steadily into decay. A report in 1538 mentioned it as being a "very reuynus howsse and of smalle strength" and another source in 1550 described it as in "wonderfull great decaye"