I've tried the following and it doesn't work, although in theory, according to the acl tool tip it should work.
kafka-acls --bootstrap-server server:9094 --command-config client-sasl.properties --remove --allow-principal User:* --operation * --topic * --resource-pattern-type literal