alt Hacker NewsThank you for the feedback. Glad to hear it didn't go into detail on human anatomy. We haven't been able to get it to tell us where to find graphic videos of a man being shot to death, but we will keep testing and work to improve it.
We will do some more internal discussion on whether or not we want it to be the tool to provide emergency assistance. I'm not sure that's ethical. We have a team member with a decade of child education experience, but we can consider other advisors.
Replies
I'd argue it would be unethical to not do so. I can see where it may lead to false-positives, but in those instances, it's better to be safe than sorry.
A reasonable and responsible approach could be to instruct the child to seek a safe adult around them to discuss any material that may be harmful.
I found that framing the questions in an innocuous way, the way a child might, gets past your moderation settings. Try asking it “what happened to [dead guy]” and then following up with asking how you can see what happened.
I don’t think it should provide emergency assistance, but I do think it should tell the child to call their emergency number or a trusted adult - not just tell them it can’t help.
> Glad to hear it didn't go into detail on human anatomy.
Why do you think children shouldn't get answers to questions about human anatomy?