Just Oscar. Well actually Trudy can sometimes be unreasonable. Too often she has made Penny babysit the twins mostly on days there are events she wants to go to when she can just reschedule her own plans on another day or look for alternative babysitters.
He literally was never there within any aspects of London's life growing up. He missed her tenth birthday, got remarried so many times, he was too busy with work that he never got to spend any time with London, and she makes up for her sadness by shopping. The only father figure she had in her life was Mr. Moseby.