I was talking with a friend from the medical industry about it today. 30-50% of r&d spend in his sector is spent on safety, and for good reason. Proper trials, safety reviews and checkpoints and so on. Given the potential harm that could come from AI, we should probably be mandating something similar. Why wait to focus on safety until it’s too late.
Medical safety is generally unlikely to make the product less safe. AI "safety" is one of the most significant sources of potential harm from AI.
Because we've been told these models are too dangerous since GPT2.
At this point it's just marketing stunts.