Since G-d gave us the Torah, every time we do a mitzvah, we get connected to G-d. Even though we can't feel this connection, it doesn't stop this connection.Therefore, even one who doesn't feel the connection and sins, he still gets punished.
