As to you saying there's not supposed to be a buff, I remember seeing that before.
Reference below: swim speed from costume - 15% is 0.5 m/s added, so the 10% from the earring should add something along the lines of 0.2/0.3, but there is zero change.