"Rhy certainly has the effect on people! Very handsome, very fun." Hell, Mat had started sleeping with Rhy before he'd even met Jesper. Very worth sporting with, if one got the chance.

"But I'd say it's very likely you like the lasses as much as the lads. You wouldn't be noticing'em otherwise." If there's more than one lady that has caught Bay's eye, there's a reason for it. Mat doesn't think you notice people in that particular fashion unless you're attracted to them. As she said, plenty of folks are pleasant to look at. That doesn't inherently mean attraction.

Bay certainly seems to be describing attraction.