Is there any reason the wire would move intermittently? That combined with a loose connection certainly can be the reason. Other stuff, power-generation problem in the amp. Like a bad solder-point, ...

You'll need a power amp if you choose a passive speaker instead of an active one, and circumnavigating two common mistakes ...