Will the musty odor go away?

Yes. As long as the moisture source is located and resolved, the musty odors will subside.