In my previous job I worked on EMP tolerant designs. There are two major issues. First is the power grid. Not my area of work, but I had to be familiar with it. The problem there is that current induced in long(er) power lines will cause saturation of magnetic devices, like transformers, generators, etc. The saturation will result in very high peak currents which will cause severe damage to some of them. The issue becomes the fact that replacements can take many months, or even years to replace. Multi-megawatt transformers, switchgear and generators are not on the shelf.
As for electronics, EMP has a unique effect. It does not destroy the devices per-se, but rather it causes every semiconductor junction to conduct, or turn-on. The effect is not permanent, but diodes will conduct current in both directions, all transistors will "turn on" and solid state surge protection devices will conduct. This can cause circuits to fail due to all of the unintended conduction paths. If the electronic device is not powered, no problem. Tolerant designs use shielding (faraday) or the design is such that it can tolerate the momentary conduction of all of the solid state devices. Some solid state devices are reasonably immune to the effect. These are known as SOS, silicon-on-saphire. They are very expensive and only used in military electronics and for satellite electronics where solar flairs can cause the same problems.
Interesting is that the Soviets used vacuum tube technology in military gear (MIG 25 radar example) for a few decades after the west as tubes are minimally effected by EMP and designs with tubes are much easier to design to tolerate EMP induced currents.
Paul