I have the exact issue too!!
My hardware is AMD 5600X3D CPU, RX6700XT GPU, and 32GB RAM.
I start new game, waiting for the galaxy to be generated, and when it says I'm entering world that is when the game crashes.
The game works just fine if I role it back to 2.3, but in 2.4.1 and 2.4.1 beta it crashes and there's a very slim chance of it working as intended but 95% of the time it crashes on the creating/joining world.