The "G" in Guilt doesn't stand for God
Some religions speak of guilt (and its accompanying partner, shame) as if it is the primary motivator to do God's will. That has always felt icky to me, and doesn't at all reflect the relationship with the Divine that I have known. For one thing, guilt seems very human based. It is controlling, negative, and without real purpose. In addition, it seems that Spirit's means to move us into a path of righteousness is accomplished in other ways -- in loving ways.
Guilt doesn't accomplish anything. If you have thought, said, or done something for which you now wish you hadn't, guilt (even tons of it) will not change the past. It is purposeless. Guilt can also keep you so miserable and stuck that you wallow in it rather than figure a way to go forward that might present a better scenario for all involved.
It seems far more Divinely inspired to identify what is your responsibility, make up for the consequences and not repeat the perpetrating act. How can you connect with the Divine when you feel guilt? How would a loving, caring presence transform your guilt to help you grow and make a better world? If the Divine could bathe you in its healing presence, how would your guilt transform?