don't get discouraged Phuketrichard, there is a nitch for all of us in the riding community. you just gotta find the compatible group for you to ride with. I do know what you mean though about being left behind, it's always that way in the beginning but with your getting some distance in, you will become stronger and be able to find a larger group to ride with. Everything doesn't have to be a race or fast, as we get older, we learn to pace ourselves....
I much prefer the asphalt surface for riding than the offroad single track....