David desires a return of that joy he had experienced before his great sin.
With thy free spirit.
The words translated “with thy” are supplied. “Free spirit” is better translated, “willing spirit.” David prays to be kept in a frame of mind willing and ready to obey God and to serve Him.