The multiple scattering effect between heterogeneous non-isothermal surfaces is described rigorously using the configuration factor in engineering thermophysics, based on which a directional thermal radiance model is built, and the numerical calculation of the model is discussed. The model is is integrated with the the gap probability model and applied to a row structure to simulate the change of Directional Brightness Temperature (DBT). The results show that the modeled DBT hold high correspondence with the observed DBT, especially in the condition that the gap probability is very low. It is also shows that the DBT is aggrandized because of the multiple scattering effects, whereas the change range of DBT is smoothed. The temperature difference, spatial distribution, emissivity of the components can all lead to the change of DBT, that is to say, the higher of the temperature difference, the craggier of the surface and the lower of the emissivity, the more exquisite DBT changes along with the viewing zenith. The model advanced in this paper can explain “hot spot effect” of thermal radiance, and it is confirmed that the existence of “hot spot” is mainly related to the spatial distribution of components’ temperature. This model can be used for the study of directional effect on emissivity, the LST retrieval over urban areas and the adjacency effect of thermal remote sensing pixels.