Residents have organised protests in Bangladeshis-dominated Brick Lane to prevent filming from taking place in the area.
Mahmoud Rauf, of the Brick Lane Business Association, said: "Yes, you create a work of fiction, but you do not create fiction which offends a whole community. There were protests when the book was published in 2003 and the film will stir up the same negative feelings towards the community on the screen."
Rauf added that locals were not offended by its religious content but its negative portrayal of the people of Brick Lane. According to him, Monica Ali had undermined the Bangladeshi community.
He told The Independent: "Infidelity happens in every society, that does not mean that the whole of that society should be portrayed in such a negative way. It will have some bad effect on the community if the film is made."
Reports say that a Bangladeshi community meeting has advised filmmakers not to go ahead with the shooting of the film. However, Monica Ali, 26, who was born in Brick Lane, told the newspaper: "It's gibberish to say it is racist. It's a story dealing with adultery. This is happening to some of our girls, especially the ones who come from back home and don't like their husbands and can't go out."
Burhan Ahmad, editor of Asian Times, said the protest appeared to be strong among the business community who feared an unfavourable effect as a result of the film. He said people were insulted by the book because it could become, through its title, the definitive story of Brick Lane.
A statement from Tower Hamlets Council here said it was "not any local authority's role to censor artistic expression or freedom of speech", adding: "It's a pity that the situation can't seem to be resolved amicably between the company and the protest group - as we're keen to maintain the borough's reputation as a film-friendly area."
A spokeswoman for Ruby Productions said filming would continue, although there was uncertainty about whether it would take place on Brick Lane. Filming was due to be completed by the end of the year.
A statement read: "Throughout the production process of Brick Lane, we have maintained constant contact with members of the local community, some of whom are involved in the film as both consultants and crew. When there is a finished product to watch, we will be happy to open a dialogue with anybody who has concerns regarding the film."