The area where the Swansea RSL now stands was once known as Stockyard Point as it was once the place where grazier, John Boughton, held his stock.