Skip to content

CodeTokenizationContext

Context record passed to syntax tokenizers containing source text and language ID.

Overview

CodeTokenizationContext provides the input string and target language identifier needed during syntax parsing.