Adult neurogenesis endows the hippocampus with unparalleled neural plasticity, essential for intricate cognitive functions. However, the manner in which sparse newborn neurons (NBNs) modulate neural activities and subsequently shape behavior remains enigmatic. Utilizing a newly engineered NBN-Tetanus Toxin mouse model, we non-invasively silenced NBNs and confirmed their crucial role in cognitive flexibility, as demonstrated through reversal learning in the Morris water maze and the Go/Nogo task in operant learning. Pairing task-based functional MRI (tb-fMRI) with operant learning revealed a dorsal hippocampal hyperactivation during Nogo task, implying that hippocampal hyperexcitability might underlie the observed behavioral deficits. Notably, resting-state fMRI (rs-fMRI) revealed enhanced functional connectivity between the dorsal and ventral dentate gyrus following NBN silencing. Further exploration of PV+ interneurons and mossy cells’ activities highlighted NBN’s integral part in preserving the excitation/inhibition balance within the hippocampus. Our findings emphasize how the neural plasticity driven by NBNs extensively modulates the hippocampus, sculpting cognitive flexibility.