Yes and No
Yes, more than age factors in: in many cases more than age factors in. Hormone levels, fitness levels, cardio vascular factors especially genetics, e.g. Jim Fixx was in top physical condition as far as endurance, VOX levels etc,but he had hardening of the arteries based on his genetics (his father died at age 43 and had his 1st heart attack at age 32 — Jim made it to 52 and had his fatal one while running)
and No: age absolutely factors in.
I am 74 and have been fit all my life. However, no matter what I did over my life as far as exercise routines to keep me fit., my fitness level has been gradually decreasing since my mid 20's. For example my 5K times have been steadily increasing no matter what I do since then (also such measurable things such as number of push-ups, number of chin ups, dips, etc). If I pinch my skin (skin turgor) it takes longer and longer to rebound. This is all about progressive telomere shortening as the body ages and it is just a fact of life. When I pee the stream simply isn't what it was years prior. When I talked to my urologist about it he stuck his finger up my ass and said my prostate enlargement numbers were not bad but normal for someone my age.
So @polker enjoy what you can still do now, but its all transitory and face the fact that its all downhill.