That has been brought up by a number of people. The Supreme Court decision that ratified it in 1967 was Loving v Virginia: https://en.wikipedia.org/wiki/Loving_v._Virginia