I think this is largely a function of when those waves of immigration happened, and how long ago it was. In another hundred years we'll see the Bangladeshi-American descendants having a fully superficial, historical curiosity type of connection to their heritage, like you describe for the Swedish-Americans. It just takes a few generations.