Yep, I’ve had to do this when migrating repos to internal GitLab servers.
Just like Anna said, git remote set-url is your friend. No need to delete or re-clone anything. And to be extra sure, I usually run git fetch right after updating the URL to confirm it’s pulling from the new source properly.