When Not Paying Attention Pays Off