The accurate description of redox reactions remains a challenge for first-principles calculations, but it has been shown that extended Hubbard functionals (DFT+U+V) can provide a reliable approach, mitigating self-interaction errors, in materials with strongly localized d or f electrons. Here, we first show that DFT+U+V molecular dynamics is capable to follow the adiabatic evolution of oxidation states over time, using representative Li-ion cathode materials. In turn, this allows to develop redox-aware machine-learned potentials. We show that considering atoms with different oxidation states (as accurately predicted by DFT+U+V) as distinct species in the training leads to potentials that are able to identify the correct ground state and pattern of oxidation states for redox elements present. This is achieved, e.g., trough a combinatorial search for the lowest energy configuration. This brings the advantages of machine-learned potential to key technological applications (e.g., rechargeable batteries), which require an accurate description of the evolution of redox states.