All geometry is rendered as textured polygons. The raycasting step only determines visibility.

But yes, the N64 isn't particularly well suited for this type of game (or anything 2D, really). I didn't know that when I started the project.