Am I being mean? My boyfriend's brother is weird and even though we've gotten along, he will periodically ?

make a comment that I don't like. Saturday, we agreed on a lot of conversations we were having and he said maybe we should hook up. I've been dating his brother for nine years! My boyfriend says his brother was joking b/c he has a weird sense of humor. The reason I was with him Saturday was because he had a seizure while he was driving and went to the hospital. He's not supposed to drive and since I don't currently work, I'm the only one to drive him. Don't get me wrong, I sympathize when people have medical issues, but for some reason my attitude is shallow with sympathy. What's wrong with me?