Why does the fuel pump keep running when the key is in the run position?

Why does the fuel pump keep running when the key is in the run position?
Fuel pressure regulator. it has a hole in the seal.it is allowing fuel to by pass when it is suppose to not.