Joseph Lyons was the state's first and only Prime Minister