The sizes of the files can differ if the line endings are different. For example, you might have CR/LF combinations on your Mac and just LF on the server.
The 'compare size if dates match' option is designed for use where the line endings are consistent between the server and your Mac. But in this case, they appear to differ, so you're better off un-checking that option.