Eliot on church-going

The inhabitants of Raveloe were not severely regular in their church-going, and perhaps there was hardly a person in the parish who would not have held that to go to church every Sunday in the calendar would have shown a greedy desire to stand well with Heaven, and get an undue advantage over their neighbours - a wish to be better than the 'common run', that would have implied a reflection on those who had had godfathers and godmothers as well as themselves, and had an equal right to the burying-service.

- George Eliot, Silas Marner, Chapter 10.

Is it possible to go to church too much? What are legitimate reasons for not going on a given week? If you consider yourself a church-goer, how do you decide whether or not to attend each Sunday?
Ten points for the first to correctly name this building.