I always wore . . . on the 29th of May
Note from the Letter Baron's Gate by John Ruskin

i.e. on the anniversary of the Restoration in 1660. The oak-apple, or acorn, recalls the preservation of Charles II after the Battle of Worcester in 1651. Pursued by parliamentary troops, he took refuge in an oak-tree in the grounds of Boscobel House.