I want to replace blown fuse (12V, 4A) that looks like resistor, but
the store only has (250V,4A) glass one, is it safe to use that?

BTW, the schematics says the line with fuse on it should use max 100mA,
so why would they put 4A fuse there?