Is there a way to query for specific words in the chat of the assessment?

Yes, from the advanced filter option (in the right corner of the search question option) you can apply the conditions to search the specific words in the chat.