I am also having this problem, but when I join my friends party and try to join the session in progress it just tells me that "You could not join the game." and I am still in the party. I also get the same error message when he tries to invite me to his game. We can both play WHORED mode but cannot play co-op campaign.
Bumped, for great justice!