Tokenizer

JSON-safe Tokenizer props forwarded to Astryx.

Supported Astryx props include:

• label (string; required): Accessible label for the input.
• searchSource (SearchSource<T>; required): Data source providing search and bootstrap methods for populating the dropdown.
• value (T[]; required): Array of currently selected items.
• onChange ((items: T[], change: TokenizerChange<T>) => void; required): Called when selection changes. The change argument includes the affected item and type ('add' or 'create' or 'remove' or 'reorder').
• placeholder (string): Input placeholder text. Only shown when no tokens are selected.
• maxEntries (number): Maximum number of selections allowed. Input is hidden when the limit is reached.
• hasClear (boolean): Show a clear-all button for bulk removal of all tokens.
• renderToken ((item: T, onRemove: () => void) => ReactNode): Custom render function for selected tokens. Default renders Token with label and onRemove.
• renderItem ((item: T) => ReactNode): Custom render function for dropdown items. Default renders TypeaheadItem.
• isDisabled (boolean): Disables the input and all token interactions.
• status (InputStatus): Validation status object with type and message for error/warning/success states.
• isLabelHidden (boolean): Visually hides the label while keeping it accessible.
• description (string): Helper text displayed below the label.
• isRequired (boolean): Marks the field as required.
• isOptional (boolean): Shows an optional indicator on the label.
• labelTooltip (string): Tooltip text shown on the label.
• hasEntriesOnFocus (boolean): Show bootstrap results on focus before typing.
• maxMenuItems (number): Maximum number of dropdown items to display.
• emptySearchResultsText (string): Text shown when search returns no results.
• hasAutoFocus (boolean): Auto-focus the input on mount.
• size ('sm' or 'md' or 'lg'): Input and token size.
• debounceMs (number): Debounce delay in ms before triggering search. Set to 0 for synchronous sources.
• hasCreate (boolean): Allow users to create new tokens from free-text input. When true, a "Create" option appears in the dropdown for typed text that doesn't match existing results. The onChange change type is 'create' for these items.
• onChangeQuery ((query: string) => void): Callback fired when the search query text changes.
• endContent (ReactNode): Content to display at the end of the input row. Useful for buttons, result counts, or other controls.
• handleRef (React.Ref<TokenizerHandle>): Imperative handle for focus() and blur() control.
• xstyle (StyleXStyles): StyleX styles for layout customization (margins, positioning, sizing). Must be a stylex.create() value - not an inline style object like style={{}}.

Props typed as React nodes, render functions, event handlers, refs, or StyleX styles are documented for Astryx parity but cannot be serialized directly from Python unless the wrapper adapts them.

See Astryx component docs: https://astryx.atmeta.com/components/Tokenizer.

The wrapper stores selected ids in value rather than complete item records so notebook state remains compact and JSON-safe.