How can you tell if you are really exercising?

Sweat helps, but your heart rate is a better determining factor. It should be raised, probably in the neighborhood of 110 beats per minute (depending on your age and shape).