Even if you have not fallen in love with a character from a story, falling for a a "real" person can be similar to what you describe here. I think we often fall for people in pieces: we may like their looks, parts of their personality makes us weak in the knees, little gestures make us swoon inside—some other things we wish we could eradicate, like the fact they don't see us that way.