The decent thing to do here is, divorce first then involve in another relationship, rather than clinging to your partner while having another relationship aside. In the end, everyone lose and you would feel miserable and guilty all your life. Be brave and take action properly. This story going down badly for everyone involved in it.