My google-fu says that you should open up the repository file /etc/yum.repos.d/rpmfusion-nonfree.repo with your favourite text editor and add an exclude=nvidia* in the [rpmfusion-nonfree] section. But that seem to be older info and also relate to yum.
The official dnf command ref has an excludepkgs flag instead
https://dnf.readthedocs.io/en/latest/conf_ref.html#options-for-both-main-and-repo
I haven't tried it myself.