Concerns over Victorian workers visiting Tasmania