Feeling guilty, because you are suspected to be caught is not feeling guilty. That's regretting your actions, because you are about to get caught and get ****ed over. More like being scared.
Guilty is more like being ashamed of wrongdoing no matter what. Not because you are scared that you are gonna get caught.