Located at a distance of 6 km from Vijayawada in the Undavalli village, these rock cut caves form a popular tourist attraction in the city. The four stories caves are explored in the 4th century out of a sandstone hill overlooking Krishna River. It enshrines a huge statue of Lord Vishnu and is formed out of a single granite block. The caves depict an excellent specimen of the rock-cut architecture and sculptural splendor of the bygone period. Moreover, there are also some other caves that are dedicated to Lord Brahma, Vishnu and Shiva. One of these caves is shaped like a Buddhist monastery and shows the resemblance to the Gupta architecture.