Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

add better storage solution#116

Draft
t0mdavid-m wants to merge 3 commits intomain from
add_caching
Draft

add better storage solution #116
t0mdavid-m wants to merge 3 commits intomain from
add_caching

Conversation

@t0mdavid-m
Copy link
Member

@t0mdavid-m t0mdavid-m commented Dec 10, 2024
edited
Loading

This PR adds a caching solution to the template. Files/Data can be stored using a simple interface (store_file/store_data). Cached data is written to disk and kept track of using a sqlite3 database. Files are stored in a central location and their path is stored as a reference. Python objects are pickled and gzipped, with the exception of dataframes, which are written to parquet.

ToDos:

  • Avoid troubles while pickling the FileManager under windows
  • Add File Manager Page
  • Complete Documentation
  • Check if the complete file manager can be moved to this solution without breaking backwards compatibility

axelwalter and Arslan-Siraj reacted with rocket emoji
Copy link
Member Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

Comments

AltStyle によって変換されたページ (->オリジナル) /