The advent of low loss optical fiber has consistently led us to the ultra-broadband era, where bandwidths exceeding 1 Gb/s are commonplace. This Review reviews the early history of fiber access, pointing out some of the lasting design choices and signature features of fiber access. The progress of the various passive optical network technologies is also reviewed, and some views regarding the future trends of fiber in the access.