Gatherings and events should be enjoyable. Having epilepsy can sometimes throw a wrench into family gatherings and plans go out the window. If it is going to cause you more stress you have every right not to go. Your health is important and should always come first.