We found that the aging brain tries to amplify degraded input from the auditory nerve and that amplified responses are associated with poorer brain structure and trouble with speech understanding.