Are some people just plain musically deficient?

I would love to just get carried away and lost in music that I create, but for some reason I have never had a knack for it. My siblings have always picked up instruments extremely quickly, perhaps that is why I never persued it. I am not sure if I really could.