According to the popular tradition, Bhartrihari cave is the sanctuary hallowed by the ‘yogic’ practices of the king Bhartrihari. The structural designs of the present cave are the remains of a double storied monastery of the Parmar period (10th Century AD). The interior of the cave is extremely cool, peaceful and spiritual. By fourteenth and fifteenth century, this place had grown into an important center of the Nath cult (नाथ संप्रदाय). Popular faith connects these caves with the two important preceptors of the Nath cult - Gorakhnath and Matsyendranath. Gorakhnath’s perennial fire is set aflame even today. The testimony of Shaivite and Bhairavi forms of worship is evident from the sculpture of this place. The idol of Shiva holding ‘Khatvanga’ in a dancing pose proves the contact of this seat with ‘Kapalik’ cult (कापालिक संप्रदाय) also. The eastern caves and its dedicated pillars seem to be part of an ancient temple of Lord Shiva.
Bhartrihari Caves in Ujjain are historical treasure. A narrow route inside the first cave leads to the place where Bhartrihari meditated. A stone – carved statue of Sage Bhartrihari is installed at the same site. There is a small temple in the second cave. The temple is a holy shrine of the Nath community. Ruins of an eleventh century Shiva temple are also seen here.
These caves are merely four kilometer away from railway junction in Ujjain. It is recommended to preferably visit the place during day time. The entrances to the caves are quite small and extremely narrow, making the entry a tricky task. The caves, supported by stone pillars, are home to several rooms, housing smaller shines and idols of deities.