Lady Gaga and Michael Polansky are keen to get married "sooner than later", according to a source.