Are they going to know how to do it now if they're all just Chat GPTing it?

Clearly we need some alternative mode to demonstrate mastery of subject matter, I've seen some folks suggesting we go back to pen and paper writing but part of me wonders if the right approach is to lean in and start teaching what they should be querying and how to check the output for correctness, but honestly that still necessitates being able to check if someone's handing in something they worked on themself at all or if they just had something spit out their work for them.

My mind goes to the oral defense, have students answer questions about what they've submitted to see if they've familiarized themselves with the subject matter prior to cooking up what they submitted, but that feels too unfair to students with stage anxiety, even if you limit these kinds of papers to only once a year per class or something. Maybe something more like an interview with accomodation for socially panickable students?