The Lingering Garden features elaborate openwork windows opening onto the garden. Almost every window is distinctive, opening onto a different view.

Rocks are always necessary in Chinese gardens that replicate landscapes and mountains. The rockeries in the Lingering Garden are made of both local clay and famous yellow rock from Anhui Province, known for its rugged appearance.

Large Taihu (Taihu Lake) stones are also used - they are beautifully eroded, containing hollows and holes and they take fantastic shapes.

Guanyun Feng, or Cloud-Observing Peak, is the most imposing Taihu stone in Lingering Garden. The 6.5-meter-high-rock resembles an eagle ready to swoop down on a turtle.