Taylor Swift alleges in the lyrics that she left a red scarf at the house of a sister to a man she was dating and fans believe that she is hinting at Jake Gyllenhaal.