Yes, I also feel guilty a lot. Especially I am still afraid that all I do could have "cosmic" consequences, or at least will mess up the rest of my life. Also I am still afraid of demonic or other "evil" influences, even though I don't believe in God anymore and thus have no reason to believe in demons either.

I think I have been guilt ridden even before I was a Christian. It is probably one of the reasons that I became one. The idea that I am forgiven eternally, the clean slate idea etc. Only later I found out that now I have to be perfect, even in areas I have no inclination to be that and that it wasn't a help at all.

So yes, I struggle with guilt, but haven't figured out how much comes from my Christian experience and how much is older than that.