It's hard to move on when you're the one who's caused all the damage

As the title says, it's really hard to move on when the person who's caused all the damage is you. Then people expect you to let it go, but how? I'm supposed to feel immense guilty for all of the things I've done wrong. I need some help with this, because there are really many things that I have trouble moving on from.