I have the same problem but I still didn't figure out how to solve it.
Friending works to me like in 1 of 10 cases.
Sometimes I see people resending their FR request to be able to invite me but I just can't accept those without turning the addon off. And if I do I'm not on the premade anymore so I don't really know what to do.

Did you figure it out by any chance?