Use the gradients in the backprop of the Lip constant for the actual backpropagation.
Use the gradients in the backprop of the Lip constant for the actual backpropagation.