So it's just the word, "marriage", that is unacceptable?
Surely anyone sharing significant parts of their lives with others eg. having children with them, sharing property ownership or other financial affairs, should ensure a proper contractual understanding/basis for this. Marriage/civil partnership is just agreeing to a standard, template, contract. It could be called "Form ZGX64" for all that matters?