People can define it to either offend terribly or be completely anodyne, and the lack of that definition is what causes the eyerolls. If skill is defined as inherent or learned, it means one thing. If it means that all other attributes (body shape/size, effort, commitment) are not applicable in the comparison, it means other things.
An offensive statement is saying, without any caveat or clarification, that an all-pro quarterback is more skilled than an all-pro linebacker. Or an all-pro running back is more skilled than an all-pro left tackle. All of those statements, as written, should be and would be pushed back against by anyone who follows football.
An inoffensive statement is saying - one sport requires many more years of practice to achieve some level of success, while another someone who has the other qualifications can step in at a reasonable level with much less (or even no) years of practice. Of course that is the case for football kickers. And someone who fits the other qualifications for various positions may do OK when joining later in life.
An offensive statement is "soccer requires more skill than football". An inoffensive statement is "soccer players rarely join later in life at the top levels, while it is more common in some other sports".
Assuming the former or the latter in all of these is the difference in mostly agreeing, or unintentionally/intentionally offending.