I did replace the tank. It is new. The fuel sender had a rusty appearance to it, but I thought it was aluminium so I wiped it down and put it back in the new tank.
The old filter had some contaminants in it, but did not contain a large amount of rust particles.
Is there a chance I should...