SELECT COUNT(*) FROM "messages" WHERE NOT (3 = ANY (recipient_ids))
Você sempre pode negar
WHERE (condition) com WHERE NOT (condition) 
SELECT COUNT(*) FROM "messages" WHERE NOT (3 = ANY (recipient_ids))
WHERE (condition) com WHERE NOT (condition) 
