There were a lot of things complicating it. The dare, the utterly stupid dare Paul and John gave George. The fact that Ringo's family is religious and he's straight as a ruler.
And the fact that he's actually falling for him.
Or in short, George has to get in Ringo's pants as a dare by the lovely Lennon-Mccartney pair. No love. Just lust. But second thoughts, second guesses and second kisses makes it a whole lot harder.