Can I restrict some listing fields for a specific category?

Unfortunately, not. The main reason is that this type of change would require some heavy custom work.

On the other hand, thanks to the current structure of WP Job Manager, alongside other plugins, you might be able to Restrict some listing fields for a particular package via WP Job Manager — Field editor (paid).