Skip to main content

CursorlessFor users For contributors

API
Contributing
Adding a new programming language
architecture
Documentation search
Contributor guidelines
Parse tree pattern matcher
Test case recorder

API
Modules
libs/cursorless-engine/tokenizer

Module: libs/cursorless-engine/tokenizer

References

IDENTIFIER_WORD_REGEXES

Re-exports IDENTIFIER_WORD_REGEXES

getMatcher

Re-exports getMatcher

tokenize

Re-exports tokenize

libs/cursorless-engine/tokenGraphemeSplitter/tokenGraphemeSplitter

libs/cursorless-engine/tokenizer/tokenizer

References