He secretly made his wife adopt he and his mistress son but regretted it late