It really depends on what you're looking for.
If you already have an MP3/MP4 player that's decent, you may wanna skip the PSP.
I used to stand up for the NDS, but with the PSX Games and custom firmware+more homebrew for the PSP, games really ARE better on the PSP. Although most NDS games are more interactive and generally "fun".