One quest starts and ends at Isma, the other starts and ends at Ashley. Lore-wise, they both are on sides that hate each other. So if you started a quest with Ashley, it still would end with Ashley even if you exiled because you technically never started it with Isma, and vice-versa. At least...