S1 of the anime was crap. OAVs and S2 were much better and more faithful to how the manga eventually developed. (i.e. Slice of Life Harem Comedy.)

The manga didn't quite find it's proper pacing until Momo and Nana show up as regulars, IMHO. That's when the series started being a bit more character-centric instead of purely gag-driven.

TLR:D is an awesome change of pace for the series. The extra chapters (the xx.5's ones) do throwback to how the original series was done as extra fanservice. Plot progress has been kinda slow, if you think about it (especially when you take into account the extra chaps), but at least it has an actual plot now.

At the very least, the series has some pretty nice char designs.