You can reserve via Railplanner or cheaper via bahn.com or their app DB Navigator :)
DB charges 5,60€ per Journey and person so if you go further than Frankurt you can reserve the entire way for example Munich or Vienna
Railplanner charge per train/pers :)
The reservation is optional but as amsterdam is quite popular the train might be full :/
Great, thanks for the tip!! @seewulf seewulf
Would you use these same sites to reserve seat from Zurich to Paris?
I'm currently in the ICE from Amsterdam to Frankfurt and I'd definitely recommend a reservation, even 1st class is almost full.