This paper addresses the concern of beliefs formed arbitrarily: for example, religious, political and moral beliefs that we realize we possess because of the social environments we grew up in. The paper uses accuracy-based considerations to motivate a set of criteria for determining when the fact that our beliefs were arbitrarily formed should motivate a revision.