One of the Rai's body guards allegedly desecrated a temple in the Hindu holy town of Pushkar by entering drunk and roughing up worshippers who tried to approach the actress, media reports said on Friday.
"We are contemplating action against the star as she is responsible for her guards,'' Ladoo Ram, the head of the local priests association told a newspaper.
Ram said, the priests would hold a meeting to discuss filing charges with the police.
Alcohol and meat are banned from Pushkar, a Hindu pilgrimage center surrounding a small lake in the desert of Rajasthan and home to the only temple to the Hindu god Brahma.
Rai denied her guard was drunk, the paper reported.
The Times of India quoted the police as saying that Rai's guards were only trying to keep a crush of fans and reporters away from her.
Officials in Pushkar could not immediately be reached for comment on Friday.
The priests of Pushkar are notoriously prickly, recently they filed charges against actress Katrina Kaif who raised their ire when she entered a temple in a dress that they said violated modesty norms because it revealed her legs below the knees.
Last year an Israeli couple were arrested and then fined for kissing in public after getting married in the holy town.
This is the second time in recent months that Rai, a former Miss World, has been in trouble with the law.
She was questioned after customs officials intercepted a package addressed to her with 24,000 euros ($28,800) hidden inside electronic goods. Under Indian laws, sending more than 5,000 rupees ($111, euro92) in cash through the mail is an offense.
Rai has denied any knowledge of the package.
Rai, who was accompanied by her mother, also visited the nearby shrine of a Muslim Sufi saint.
"Whatever city I visit, I go to temples or religious places for prayers,'' a news agency quoted Rai as saying.