Exclusion of a luminous red giant as a companion star to the progenitor of supernova SN 2011fe