Guanyin Mount stands on the eastern side of the Shugang Mountain, with the Gongde Temple built atop of it, also called Guanyin Temple. The temple was burned during the fighting in the reigns of Xianfeng and Guangxu of the Qing Dynasty.
Now, the existing buildings such as the Sanshan Gate, the Hall of Emperor, the Great Buddha's Hall and the building of Buddhist Scriptures were renovated with the funds raised by the temple's monks.
Built close to mountains, it integrated mountains with temples featuring blue tile and red wall, like the zigzagging Great Wall earning a reputation of the "Small Great Wall".