What is the difference between PVC glue and PVC cement?

You need to read the label.

PVC glue may only be an adhesive.

PVC cement tends to be a solvent-based welder. This means that it will dissolve some of the PVC of each piece intermingling it before setting the result. When done poorly it acts as an adhesive. When done well it creates a bond that requires cutting to remove.