Most games should work actually, there will be exceptions but in general the game data is all that’s stored on the SD card, your saves and config data are stored in your user folder.

Some games get this wrong and store data in the game data folder but that’s heavily discouraged. Some games also conflate save data and config data which is annoying when jumping from different devices but that’s it.