Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

BUG: make read_csv read large integers (>64bits) as python integers with C engine #62582

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mroeschke merged 6 commits into pandas-dev:main from Alvaro-Kothe:fix/read-csv-bigint
Oct 5, 2025

Conversation

Copy link
Contributor

@Alvaro-Kothe Alvaro-Kothe commented Oct 4, 2025
edited
Loading


Reading big integers as strings was tested behavior. I am not sure if this change is desired.

Implementation details

When an overflow occurs during integer parsing, instead of reading the data as a string, now reads it as PyLongObject.

@Alvaro-Kothe Alvaro-Kothe marked this pull request as ready for review October 4, 2025 22:10
@Alvaro-Kothe Alvaro-Kothe changed the title (削除) BUG: make read_csv read large integers (>64bits) as objects with C engine (削除ここまで) (追記) BUG: make read_csv read large integers (>64bits) as python strings with C engine (追記ここまで) Oct 5, 2025
@Alvaro-Kothe Alvaro-Kothe changed the title (削除) BUG: make read_csv read large integers (>64bits) as python strings with C engine (削除ここまで) (追記) BUG: make read_csv read large integers (>64bits) as python integers with C engine (追記ここまで) Oct 5, 2025
@Alvaro-Kothe Alvaro-Kothe marked this pull request as draft October 5, 2025 12:28
@Alvaro-Kothe Alvaro-Kothe marked this pull request as ready for review October 5, 2025 13:06
Copy link
Member

@mroeschke mroeschke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks I think this a net improvement in behavior

@mroeschke mroeschke added the IO CSV read_csv, to_csv label Oct 5, 2025
@mroeschke mroeschke added this to the 3.0 milestone Oct 5, 2025
@mroeschke mroeschke merged commit 21130b1 into pandas-dev:main Oct 5, 2025
46 checks passed
Copy link
Member

Thanks @Alvaro-Kothe

@Alvaro-Kothe Alvaro-Kothe deleted the fix/read-csv-bigint branch October 6, 2025 16:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mroeschke mroeschke mroeschke approved these changes

Assignees
No one assigned
Labels
IO CSV read_csv, to_csv
Projects
None yet
Milestone
3.0
Development

Successfully merging this pull request may close these issues.

AltStyle によって変換されたページ (->オリジナル) /