0

I'm running a remote script that collects data from the web nightly. Each morning I import the latest data to my database on my Mac using a command line import to phpMyAdmin, adding to the number of rows from the night before. I then access the data locally using a Python script. Is there a limit to the size of a table that I can have either in terms of being able to store the data or access it via a query in Python? And, if so, is there a way to check and see how close I am to the limit?

Please note that I'm not concerned with the import size since I'm just importing daily snapshots and inserting those newest rows.

asked Jan 7, 2018 at 10:45

1 Answer 1

1

MySQL has huge limits -- many terabytes.

You may run out of disk space.

Your app code may run out of RAM. But only if you foolishly fetch all the rows at once. Instead, use SQL to filter/summarize the data you fetch.

But otherwise, don't worry.

answered Jan 7, 2018 at 13:32
1
  • My mom always did tell me that I worried to much. :) Commented Jan 7, 2018 at 13:40

Your Answer

Draft saved
Draft discarded

Sign up or log in

Sign up using Google
Sign up using Email and Password

Post as a guest

Required, but never shown

Post as a guest

Required, but never shown

By clicking "Post Your Answer", you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.