If you've never customised your Windows icons before, you'll need to look into getting some software to help you as Windows by default won't let you customise everything.
One good app - albeit one that does cost money - is MicroAngelo OnDisplay
[link]
There are also some other apps that let you change your icons, many free. Do a little googling and you can probably find some other alternatives