That sounds like a pretty good way of organizing honestly. As long as you can remember where things are more-or-less within the individual screens, if you have a lot of apps installed and you have some that are only occasionally used, scrolling until you get to the color is a pretty easy way to narrow down where your target. I have some apps installed that I rarely use that I'd be more likely to remember what the icon looks like than the name of the app to search for it by text.

I heard that The Simpsons were made yellow because it stands out the most when quickly flipping through channels.