3
24
Fork
You've already forked krabby
0

Resolve TOML parsing limitations #4

Open
opened 2025年12月07日 23:27:35 +01:00 by bal-e · 0 comments
Owner
Copy link

The crates.io-10k test case lists 23 failures:

Failed to check 'test-data/crates.io-10k':
 Failed to check package at 'test-data/crates.io-10k/src/bevy_rapier2d-0.31.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/bevy_rapier2d-0.31.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/bevy_rapier3d-0.31.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/bevy_rapier3d-0.31.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/eza-0.23.3/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/eza-0.23.3/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/fjall-2.11.2/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/fjall-2.11.2/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/snowflake-1.3.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/snowflake-1.3.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/ripgrep-14.1.1/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/ripgrep-14.1.1/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/cargo-deb-3.6.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/cargo-deb-3.6.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/watchexec-cli-2.3.2/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/watchexec-cli-2.3.2/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/server_fn_macro_default-0.8.5/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/server_fn_macro_default-0.8.5/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/cargo-watch-8.5.3/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/cargo-watch-8.5.3/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/oxipng-9.1.5/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/oxipng-9.1.5/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/tachys-0.2.8/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/tachys-0.2.8/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/zookeeper-client-0.11.1/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/zookeeper-client-0.11.1/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/leptos_reactive-0.6.15/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/leptos_reactive-0.6.15/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/leptos_macro-0.8.8/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/leptos_macro-0.8.8/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/leptos-0.8.9/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/leptos-0.8.9/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/serde-attributes-0.2.1/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/serde-attributes-0.2.1/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/server_fn-0.8.7/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/server_fn-0.8.7/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/rustler-0.37.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/rustler-0.37.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/server_fn_macro-0.8.7/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/server_fn_macro-0.8.7/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/statime-linux-0.4.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/statime-linux-0.4.0/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/bevy-0.16.1/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/bevy-0.16.1/Cargo.toml' could not be parsed
 Failed to check package at 'test-data/crates.io-10k/src/unidecode-0.3.0/Cargo.toml':
 Failed to load the manifest:
 The package manifest could not be loaded:
 'test-data/crates.io-10k/src/unidecode-0.3.0/Cargo.toml' could not be parsed

These are almost certainly caused by the limitations in the current TOML parser. My guess is that integers are not being parsed properly. These failure cases can be looked up without downloading the full test suite, and src/cargo/examples/parse-toml.rs can be used to investigate each failure.

The `crates.io-10k` test case lists 23 failures: ``` Failed to check 'test-data/crates.io-10k': Failed to check package at 'test-data/crates.io-10k/src/bevy_rapier2d-0.31.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/bevy_rapier2d-0.31.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/bevy_rapier3d-0.31.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/bevy_rapier3d-0.31.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/eza-0.23.3/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/eza-0.23.3/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/fjall-2.11.2/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/fjall-2.11.2/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/snowflake-1.3.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/snowflake-1.3.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/ripgrep-14.1.1/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/ripgrep-14.1.1/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/cargo-deb-3.6.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/cargo-deb-3.6.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/watchexec-cli-2.3.2/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/watchexec-cli-2.3.2/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/server_fn_macro_default-0.8.5/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/server_fn_macro_default-0.8.5/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/cargo-watch-8.5.3/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/cargo-watch-8.5.3/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/oxipng-9.1.5/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/oxipng-9.1.5/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/tachys-0.2.8/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/tachys-0.2.8/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/zookeeper-client-0.11.1/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/zookeeper-client-0.11.1/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/leptos_reactive-0.6.15/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/leptos_reactive-0.6.15/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/leptos_macro-0.8.8/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/leptos_macro-0.8.8/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/leptos-0.8.9/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/leptos-0.8.9/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/serde-attributes-0.2.1/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/serde-attributes-0.2.1/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/server_fn-0.8.7/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/server_fn-0.8.7/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/rustler-0.37.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/rustler-0.37.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/server_fn_macro-0.8.7/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/server_fn_macro-0.8.7/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/statime-linux-0.4.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/statime-linux-0.4.0/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/bevy-0.16.1/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/bevy-0.16.1/Cargo.toml' could not be parsed Failed to check package at 'test-data/crates.io-10k/src/unidecode-0.3.0/Cargo.toml': Failed to load the manifest: The package manifest could not be loaded: 'test-data/crates.io-10k/src/unidecode-0.3.0/Cargo.toml' could not be parsed ``` These are almost certainly caused by the limitations in the current TOML parser. My guess is that integers are not being parsed properly. These failure cases can be looked up without downloading the full test suite, and `src/cargo/examples/parse-toml.rs` can be used to investigate each failure.
Sign in to join this conversation.
No Branch/Tag specified
main
decl-macros
diagnostics
query
nameres
type-ir
scalar-lexer
No results found.
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
bal-e/krabby#4
Reference in a new issue
bal-e/krabby
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?