Having had another look at the cavalry it seems as if they rest the flat side of the swords on the shoulder, with either the edge towards their neck or away from it.
Another artistic detail is, that the horses seem to be galloping- they are usually shown like that, but what about the poor chap in the left side of the first picture, holding the parasol – he is on foot – he must be quite a sportsman

.