You get downvoted, because your answers are just not good.
I just looked at some of your other answers; https://law.stackexchange.com/a/41040/65, for example. You answer the question without actually answering it; the asker is clearly unfamiliar with the term "independent contractor", and you never bother to define it, neither in the answer, nor in the comments to it. (Is the answer actually on the external page you link? That's against the rules as well.) Someone else answers it fully correctly; instead of admitting your answer is no good, you go around complaining that their answer is wrong, when it's clearly not.
And just because your answer got accepted by the asker doesn't mean that it is, or that it should be, immune to downvoting, either. Some folks just accept the answers by mistake, because they don't know any better, or to get rid of SE nagging them to accept an answer, so, that's not much of a proof either way that the answer is or is not correct.
I presume that some of these answers are downvoted because they feel more like "comments" to other people. On StackOverflow, the main QA site, for example, it is customary to answer questions with comments if you don't want to write a fully-detailed and explanatory answer; I suggest that you might follow this approach if you want to provide one-line comments without writing a full answer, especially if you're concerned about the downvotes.