"Most of the philosophy of science is completely irrelevant to the actual conduct of science. "
Where do you think this "conduct of science" came from? And how do you think it is further refined?
Math and science are evolving analytic philosophies (much older than classical philosophy), and the "conduct of science" actually evolved over the millennia as the product of what works and what not works. The ethical conduct in science has produced science, and the unethical conduct of science fails.