The most important thing to do if you find yourself in a hole is to stop digging.
Attribution checked
Quothly found supporting evidence for this attribution.
The phrase appears in Buffett's Berkshire Hathaway annual letter discussing insurance management: "The most important thing to do when you find yourself in a hole is to stop digging."
Berkshire Hathaway Letters to Shareholders (PDF)