Long term solution is to get rid of the food they eat, which is easily accomplished with a ground applied insect killer, as previously mentioned, but it does take a week or so.
I think getting rid of pests is generally pretty easy. Now if you want to get rid of something that you really really like, move your mother in law in for a while.