A limiting case is a "limiting" case.
You can say Newtonian mechanics is a limit of general relativity, you can't simply say the former is just wrong.