Aiming at enhancing the reliability of breast diffuse optical tomography, a combined time-domain diffuse fluorescence and optical tomography system is proposed based on the multi-channel time-correlated single-photon counting technique. Aligning 32 coaxial fibers around the tissue surface equally; the system scans objects in a parallel-beam mode analogous to X-ray CT so that the time-resolved projections at different incident positions can be obtained. By applying the relevant iteration reconstruction algorithm, promising images have been produced from measurements on different phantoms. The results indicate this system works reliably and is one of the ideal platforms for optical breast tumor diagnosis.