What I’d be most worried about is an “us vs them” mentality developing. It doesn’t break first but it can develop almost naturally. 10 -> 50 people tends to mean “team of teams” rather than “a team”.
Once this dynamic takes root, it’s much harder to stomp out. I’d be more worried about systemic issues like this than the short term pain from growth.