I've had that happen before too, and I just added a line to CLAUDE.md or AGENTS.md something like (adapted to your example):

    When asked to fetch JIRA tickets, use the "fetch-jira" skill rather than reading via ACLI

Claude has gotten better about following CLAUDE.md over the last year (it was pretty laughably bad at it previously).