PVC is very safe. I use it for breeding other fish. However, its light weight may cause a problem in the heat of courtship as it will move around a lot and would result in abrupt interruption of the process. Clay or slate are much more stable. Even then, I would see my clay caves move around if not weighted down by wood and such.