I loathed the second Chalion book, and I like Bujold. So, it's not just you.

The reason I like the Vorkosigan novels is that they're complex and plotty; the characterization tends to be their weak note, for me. When that series veered into romantic comedy, it lost me instantly (and the regained me with the next complex plot).