A man made a "drunken sin" and woke up to a broken woman "with her walls all around" and "nothing in her room but an empty crib" and despite "what (his) hands and (his) body done" to her, she "...fret none".
Despite inflicting pain to her (perhaps sexual abuse, physical harm, or the sort), she remains faithful and loving. The man recognizes this and begins to see her as a symbol of redemption and hope. Death won't stop him and he doesn't need religion to save him. She is all he needs.