I got into NX while it was in reruns about twelve years ago, when I was a teenager. I enjoyed it a whole lot then, but I found I liked it even more once I bought the DVDs about five years ago. It really holds up well, IMO. (Though my favorite season is the third. S1 is good, but they don't really find their groove until the last episode of it.)

I sort of get that, but I really do like Peter and his story and growth, a lot of which comes from Olivia herself.

I agree! I feel like the show and Olivia's story would both be less interesting without Peter there.