Hey there ​@developyourskills 
So this is absolutely doable, a bit tricky to install but here is the walkthrough:

Enter settings, recruiting attributes (https://Your-Domain.personio.de/configuration/recruiting/attributes )

Then go to “Add new attribute” top right corner.
select LIST

and then enter as many fields as you wish, here is my suggestion for the question “ How would you rate your local language?”
 

I use the ” The Common European Framework of Reference for Languages”, that way you are safe when it comes to possible discrimination and such; I gave them an explanation what the codes mean.
Hit safe.
Now navigate to one of your Jobs in which you wish to install this, like https://Your-Domain.personio.de/recruiting/position/808462

Then hit EDIT

and now navigate to “application form”, under the section 

Application form fields

you can find the Button “add fields”;

here in my example you can see that I added the question for Work VISA already.
Make sure you hit REQUIRED, so they MUST reply to this question, otherwise they can simply evade you!

we are nearly there buddy, hang in there :)
Now navigate to Automated Screening, switch it on:

In my example I selected the 2 answers, that will lead to an auto-reject, you do so too, please.

Then select the email template that has to be sent, mine is written in a way you could think I really handled the candidates:

OK, that was it, really. Any questions left? :)

Wow ​@Nick, thank you for this detailed response!

Thank you ​@Nick !!