Legally, probably not...?

Whether you may/should feel responsible depends on how the software works, I guess. Did it automatically recommend some drug, somewhat confidently, with gray text on gray background saying "AI sometimes makes mistakes"?

So I think we should behave responsibly when making software, even more now with AI