Most often it makes more sense to map the same ports on every intermediate machine.

Host super
  IdentityFile ~/.ssh/mykey
  User myuser
  LocalForward 8001 localhost:8001
  LocalForward 8002 localhost:8002
  LocalForward 8003 localhost:8003
  LocalForward 8004 localhost:8004

This is good for interactive sessions with multiple servers. For single servers, reverse proxy tunnels are more efficient.