N1 of event-related potentials (ERPs) is augmented in amplitude in ∼50–150 ms by occasional changes (deviants) in the physical features of a sound repeated at intervals of from ∼400 ms to seconds (standard). The release-from-refractoriness hypothesis links the N1 augmentation to a deviant-feature-specific neural population that is fresh to fully respond as opposed to a standard-feature-specific neural population that is unresponsive due to its post-response refractoriness. The present work explored this hypothesis in the context of ERP studies, behavioral habituation studies and studies on stimulus-specific adaptation (SSA). The idea of hundreds of milliseconds neural population-level refractoriness was observed to be founded upon negative N1 evidence (no observable effect of dishabituating stimuli on N1 to standards – the null hypothesis retained) and merely supported by positive N1 evidence (null hypotheses rejected). This idea was also found to be directly challenged by positive N1 evidence. No conclusive network- or single-neuron-level evidence was found for the refractoriness. Therefore, the validity of the release-from-refractoriness hypothesis of N1 to guide psychophysiological research needs reassessment.