Do I have to expand my entire map to find a downline?

No.  IBO enters the name of downline into the 'Search IBO by Name' or # area to find their downline details.