Yes, but legal fishing can be regulated. We can setup manageable and productive fisheries that not only can sustain populations but also continue to reproduce and be healthy. With illegal fishing, we can't do that.
There are numerous success stories about managed fisheries bringing back stocks, a good example is the Red Snapper catch share that was setup in the Gulf of Mexico;