I can’t say I never downvote anyone but I get into these comment chains from time to time where really no matter what I post whoever I’m talking to downvotes every response but I generally shy away from downvoting even things I dislike. I don’t want to fall into an echo chamber where all I see are only the things I agree with.
It seems you and I are birds of a feather. Same experience here. Any divergence from the accepted norm, even if it’s just inquiry is typically met with downvotes. That is most places trend towards an echo chamber, not just here but anywhere online.