Lloyd E. Sponenburgh writes:

The spider can't tell,

For one, "wget" can certainly detect and ignore recursive loops.