Use the Past Simple Tense instead of the infinitives in brackets:
The police (to ask) him a lot of questions and (to let) him go only in the morning.