Absolutely. You don't even have to take them to a kennel!
If you've got a fairly mature bin (5-6# of worms and compost), you can leave your worms for 4-5 weeks if you feed them a lot (be sure to bury it deep) and be sure to include food that breaks down slowly (carrots, potatoes, onions, rutabaga, or fibrous things like broccoli stalks). Your worms will be fine, and you may be ready to harvest some vermicompost when you return.
If you are going to be gone for a longer period, you may lose some worms due to lack of food. You can of course have someone feed them while you are away. If someone is coming by to check on your home, they can add some food scraps (be sure they know what to add and how!). Who knows, you make introduce a friend to vermicomposting!