On the settings page you can configure how much a sport is contributing to Fitness and Fatigue. Weight-training for example is by default set to not contribute to Fitness.
So depending on what your gym sessions are catalogued as, that could be the reason.