Shut it off. If there is any grit or anything under the record when you lift it, it may scratch or score the record. Especially on a TT without a mat.
Also, I have a clamp, so I have to turn it off first, anyway.
Also, I have a clamp, so I have to turn it off first, anyway.