I certainly could not attend multiple bon voyage gatherings without planning one for our son. After all, he was leaving all of his friends behind as well.  Even at only 4 years old, he has a number of good buddies.
Instead of making it a party, we turned it into a playdate and invited his friends and playmates.  It was a traditional playdate with games, crafts and pizza.  The kids had a good time.