Very hard. The AI will "grab" on anything it can and run off in very different directions each time it generates something. Keeping inter-frame or inter-image consistency is very hard. It takes a lot of effort and skill to get an AI to do exactly what you want.
"Is it tough to keep the same clothes?" Yeah, yeah it is. getting a consistent outfit either requires you to generate the same pic dozens of times with fairly specific prompts, examples that if you are using ai art you likely don't have, or training the model for a specific outfit for each character for each scene which requires thousands of times as much time/power as making individual pictures and again requires examples.