I guess "depth first" is just an expression of so called chain of thought, which is just a linear sequence. I don't know if GPT has any search-like (tree search) algorithms in their reasoning, it would be quite interesting if they did (they probably have researched this area, at least).