Yeah, "grouping" is largely the way to go for the generic parts, and keeping parts together when they really do need to go together is another.
I used to just have a generic big tub with all the generic cables and wires. Some were nicely wrapped up, others often got themselves into a giant tangled mess. I could never find anything. I got a bunch of small/medium sized plastic bins with lids for all the generic stuff. An old labeler quickly made them "USB cables", "A/V Cables", "DC Power Adapters", "AC Power Cables", "Coax Cables"...now it takes me two seconds to find any particular random cable.