How to stop someone from connecting to your Bluetooth soundbar

I have the Soundsticks Wireless speakers. They support bluetooth but also have a regular 3.5mm audio jack. My issue is that neighbors can pair with the speakers and play audio and I don't know how to prevent this short of turning off the speakers. Is there any way to prevent unauthorized access? Is there a model of speakers that have a security code or some other feature to limit access?