-
Notifications
You must be signed in to change notification settings - Fork 150
Open
@slavakurilyak
Description
When I run doc index on the langchain repository, I receive the following error:
⠇ Processing 494 files...Error during traversal: The text contains a special token that is not allowed: <|endoftext|> Failed to find `autodoc.config.json` file. Did you run `doc init`? Error: The text contains a special token that is not allowed: <|endoftext|> at module.exports.__wbindgen_error_new (/usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/node_modules/@dqbd/tiktoken/tiktoken_bg.cjs:398:17) at wasm://wasm/00b63e2e:wasm-function[15]:0xebb8 at wasm://wasm/00b63e2e:wasm-function[154]:0x48af5 at Tiktoken.encode (/usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/node_modules/@dqbd/tiktoken/tiktoken_bg.cjs:257:18) at processFile (file:///usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/dist/cli/commands/index/processRepository.js:24:40) at async file:///usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/dist/cli/utils/traverseFileSystem.js:42:21 at async Promise.all (index 2) at async dfs (file:///usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/dist/cli/utils/traverseFileSystem.js:38:13) at async file:///usr/local/Cellar/node/19.8.1/lib/node_modules/@context-labs/autodoc/dist/cli/utils/traverseFileSystem.js:25:21 at async Promise.all (index 0)
I believe this is an issue with autodoc, rather than the langchain repository, as I have followed the instructions in the README file and run doc init in the langchain repository before running doc index.
Here is some information about my environment:
- Operating system: macOS Monterey 12.6.3 (21G419)
- Node.js version: v19.8.1
Please let me know if there is any additional information I can provide or steps I can take to resolve this issue.
Metadata
Metadata
Assignees
Labels
No labels