When the temple was founded, two main halls were constructed, facing each other in the east-west direction. However, the East Main Hall was destroyed under the cruel storm of Haibutsu Kishaku (Anti Buddhist Movement) in the early Meiji period, leaving only the ruins of its stone platform. It is considered that one each of the five-storied small pagoda was installed in the East Main Hall and in the West Main Hall respectively, composing a complete temple complex.