Answer
Thanks to harrije
In 6x09 "Ab Aeterno," we learned that the entire crew of the Black Rock was dead shortly after the ship crashed on the island. Some may have perished in the original crash, but all surviving crew and human cargo, with the exception of Richard Alpert, died from a Smoke Monster attack shortly after the crash.
