I want to add that an annoying character can act morally totally OK but still be disliked. That is because the annoyance is real and their actions and their consequences are not.

You could have a saintly character that always does the "right thing" but if they have an obnoxiously annoying way of speaking (extrem high pitch, extremely slow or fast or something) I would still dislike them.

That is because I actually get annoyed watching the character while I do not react that harshly even to a drug kingpin as the consequences of their action is fictional.

I have that kind of feeling of annoyance for skyler. I really do get annoyed at her controlling and arrogant way to handle things as it reminds me of real people. I do believe that this was intentional to make her unlikeable on first glance.

No matter how moral or "normal" her choices are the consequences are still fictional while my annoyance is real.

Edit: irl the situation is of course reversed. The consequences are real and the annoyance temporary.