Function isPunctuation

isPunctuation(ch: string): boolean
Check if a character is a BERT punctuation character.
Parameters
- ch: string
Returns boolean
- Defined in packages/embed-code-core/src/tokenizer/pre-tokenizer.ts:71