My training data got corrupted right before a big demo in Austin.

Had to rebuild the model from a two-week-old backup in under an hour. Anyone else had to do a frantic, last-second rebuild like that?

3 comments

3 Comments

piper_flores691mo ago

Sounds like a pretty basic recovery plan to me...

the_ben26d ago

Amen to that! @taylorc50 nailed it - sometimes you just gotta cut everything but the bones and let the demo be ugly but working. I did that for a pitch once and the client didn't care it was bare bones, they just wanted to see it move.

taylorc501mo ago

Basic recovery plan" makes it sound easy, but when the clock is ticking nothing feels basic. I had to do that once and my only real move was to strip the model down to just the core features that had to work for the demo. I cut every extra piece out to make the rebuild faster. It meant the demo was super simple, but it actually ran. Sometimes you just have to get something, anything, back on its feet.