Data is regularly lost #477

bochecha commented 2025年04月11日 11:22:23 +02:00

I use Medilog to keep track of water intake, and regularly, I have some data that is lost.

For example, today, I recorded a few things during the night, but after that I recorded something which appeared as the first record of the day. 😕

This happens regularly enough that I can't really rely on this app anymore, even though it has automatic save and backups, which by the way is a great thing to have.

Sorry I don't have anything more accurate and detailed than "it loses data", but if you explain to me what to look for I'd be happy to give you a more actionable bug report. 😊

I use Medilog to keep track of water intake, and regularly, I have some data that is lost. For example, today, I recorded a few things during the night, but after that I recorded something which appeared as the first record of the day. 😕 This happens regularly enough that I can't really rely on this app anymore, even though it has automatic save and backups, which by the way is a great thing to have. Sorry I don't have anything more accurate and detailed than "it loses data", but if you explain to me what to look for I'd be happy to give you a more actionable bug report. 😊

toz commented 2025年04月11日 11:34:24 +02:00

This is really bad to hear!

Given that this is the first time I hear of this so let's confirm a few details so I know into which corner I need to look into:

• What's your exact version or build of MediLog
• Are you using any other tabs, and if so, ever seen the same issue there?
• Do you you have daily summaries on or off? Is changing that setting doing anything to the situation?
• Can you check the filter settings of your tab. Anything set there which could prevent those entries to show up?
• Does a backup show those lost entries or are they missing there as well?
• If you happen to have a rough date and time of such lost entries I'd be happy to have a look at a backup of yours and check if there are any odd entries. https://cloud.zell-mbc.com/s/medilogUpload

This is really bad to hear! Given that this is the first time I hear of this so let's confirm a few details so I know into which corner I need to look into: - What's your exact version or build of MediLog - Are you using any other tabs, and if so, ever seen the same issue there? - Do you you have daily summaries on or off? Is changing that setting doing anything to the situation? - Can you check the filter settings of your tab. Anything set there which could prevent those entries to show up? - Does a backup show those lost entries or are they missing there as well? - If you happen to have a rough date and time of such lost entries I'd be happy to have a look at a backup of yours and check if there are any odd entries. https://cloud.zell-mbc.com/s/medilogUpload

bochecha commented 2025年04月11日 13:23:42 +02:00

Hi, the version I use is the latest from f-droid: 3.1.2, 5466

I use the water tab, the journal and temperature, but I almost exclusively use the water tab daily. I use it a lot 😅

Daily summaries for the PDF are on, but off for the graph, does that have an impact? 🤔

I can't find any filter setting for the "water" tab 😕

A rouge date and time would be all the entries from the night from 10 to 11th April, there are some around 4am and 7am more or less.

I'll try to have a look at the backups now 😉

Hi, the version I use is the latest from f-droid: 3.1.2, 5466 I use the water tab, the journal and temperature, but I almost exclusively use the water tab daily. I use it *a lot* 😅 Daily summaries for the PDF are on, but off for the graph, does that have an impact? 🤔 I can't find any filter setting for the "water" tab 😕 A rouge date and time would be all the entries from the night from 10 to 11th April, there are some around 4am and 7am more or less. I'll try to have a look at the backups now 😉

bochecha commented 2025年04月11日 13:38:47 +02:00

Looked at the backup, and indeed, those date/times aren't in there, so they were really completely lost. 😭

Looked at the backup, and indeed, those date/times aren't in there, so they were really completely lost. 😭

toz commented 2025年04月11日 21:21:27 +02:00

Thanks for getting back!
The filter setting would be here:
image

If the icon looks like in this screenshot the filter is off and all data should be shown.

I saw you uploaded a backup, thanks. It looks like you accidentally picked an old one though? MediLog-2023年01月21日?

Thanks for getting back! The filter setting would be here:  If the icon looks like in this screenshot the filter is off and all data should be shown. I saw you uploaded a backup, thanks. It looks like you accidentally picked an old one though? MediLog-2023年01月21日?

bochecha commented 2025年05月11日 12:20:43 +02:00

Hi, thank you for the reply, somehow I never got a notification about your comment. 😖

So, that filter indeed looks like the one on yourscreenshot, which means it is off. 🤷

Meanwhile I'm trying to get into the habit of constantly saving the data to avoid more data loss, but I regulary forget to do it as I have big memory issues ever since I caught a bad flu which attacked my brain and spinal chord 😭

I uploaded a new backup which I did just before uploading it, should be 2025年05月11日 this time, and sorry about last time.

Hi, thank you for the reply, somehow I never got a notification about your comment. 😖 So, that filter indeed looks like the one on yourscreenshot, which means it is off. 🤷 Meanwhile I'm trying to get into the habit of constantly saving the data to avoid more data loss, but I regulary forget to do it as I have big memory issues ever since I caught a bad flu which attacked my brain and spinal chord 😭 I uploaded a new backup which I did just before uploading it, should be `2025年05月11日` this time, and sorry about last time.

toz commented 2025年05月11日 14:23:28 +02:00

Time stamp looks good, but the file is password protected?

Time stamp looks good, but the file is password protected?

bochecha commented 2025年05月12日 16:28:25 +02:00

@toz wrote in #477 (comment):

Time stamp looks good, but the file is password protected?

Huh? 🤔

Ah yes, it is 😖

So sorry about that, I had ,no idea it would be protected by a pasword, it is just the backup generated by Medilog. 😕

Is that expected? 🤔

in any case, here it is again, at the same place, but this time it's MediLog-Backup-2025年05月11日 12-07-45-2.zip

@toz wrote in https://codeberg.org/toz/MediLog/issues/477#issuecomment-4438466: > Time stamp looks good, but the file is password protected? Huh? 🤔 Ah yes, it is 😖 So sorry about that, I had ,no idea it would be protected by a pasword, it is just the backup generated by Medilog. 😕 Is that expected? 🤔 in any case, here it is again, at the same place, but this time it's `MediLog-Backup-2025年05月11日 12-07-45-2.zip`

toz commented 2025年05月13日 12:26:15 +02:00

If you set a password in settings all of your automated backups will be protected with that password, so, yes, works as intended.
I was able to open the latest file and will get on top of it today.

By the way, you did you create this zip file yourself, did you? Reason for asking is that your zip file has your data in a subfolder and was tearing my hair out why the hell the import code all of a sudden seemed to be broken.
Oh well, another opportunity to add some more resilience to the restore code.

Right now I got no clue as to what happens, so I might ask you to install a debug version with some more Text notifications left and right so I can narrow down where things go wrong. We'll see...

Edit:
You truly got a lot of data, which is good as it allows for some stress testing. You might want to consider enabling a filter, let's say 3 months rolling. Because with more than 5000 records in display the ui may become really slow?

As you may have noticed from the response to your other post, there have been some significant code changes with Fluid recently, hence instead of me stabbing in the dark I would propose I compile a dedicated version for you which provides some additional notifications.

A few more que4stions which came to my mind:

• Is your database encrypted? Check in about dialog
• How do you enter your data, quick entry mode off or on?
• What does losing data look like exactly? You enter a record and later on it appears like it wasn't saved, or rather some data which you know was there before is missing all of a sudden?

If you set a password in settings all of your automated backups will be protected with that password, so, yes, works as intended. I was able to open the latest file and will get on top of it today. By the way, you did you create this zip file yourself, did you? Reason for asking is that your zip file has your data in a subfolder and was tearing my hair out why the hell the import code all of a sudden seemed to be broken. Oh well, another opportunity to add some more resilience to the restore code. Right now I got no clue as to what happens, so I might ask you to install a debug version with some more Text notifications left and right so I can narrow down where things go wrong. We'll see... Edit: You truly got a lot of data, which is good as it allows for some stress testing. You might want to consider enabling a filter, let's say 3 months rolling. Because with more than 5000 records in display the ui may become really slow? As you may have noticed from the response to your other post, there have been some significant code changes with Fluid recently, hence instead of me stabbing in the dark I would propose I compile a dedicated version for you which provides some additional notifications. A few more que4stions which came to my mind: - Is your database encrypted? Check in about dialog - How do you enter your data, quick entry mode off or on? - What does losing data look like exactly? You enter a record and later on it appears like it wasn't saved, or rather some data which you know was there before is missing all of a sudden?

bochecha commented 2025年05月13日 13:57:04 +02:00

Ah, yes, I created the zip file on my laptop, just extracted the zip from Medilog, put the contents in a folder then zipped the folder.

Sure, no problem, I can install that debug version as soon as it is ready. 😉

Ah, yes, I created the zip file on my laptop, just extracted the zip from Medilog, put the contents in a folder then zipped the folder. Sure, no problem, I can install that debug version as soon as it is ready. 😉

bochecha commented 2025年05月13日 16:49:12 +02:00

@toz wrote in #477 (comment):

Edit: You truly got a lot of data, which is good as it allows for some stress testing. You might want to consider enabling a filter, let's say 3 months rolling. Because with more than 5000 records in display the ui may become really slow?

I can do that, yes, but I didn't find anything in the UI that looks like this 😕

In any case, so far I haven't seen the UI getting any slower, but it might so I'm all for filtering things. 😉

As you may have noticed from the response to your other post, there have been some significant code changes with Fluid recently, hence instead of me stabbing in the dark I would propose I compile a dedicated version for you which provides some additional notifications.

Alright, shoot and I'll try any build you want. 😉

A few more que4stions which came to my mind:

* Is your database encrypted? Check in about dialog

It is, yes, is that a problem? 🤔

* How do you enter your data, quick entry mode off or on?

It is on, is that a problem? 🤔

* What does losing data look like exactly? You enter a record and later on it appears like it wasn't saved, or rather some data which you know was there before is missing all of a sudden?

That, I know for a fact I had entered some things in the past, but it isn't there anymore.

@toz wrote in https://codeberg.org/toz/MediLog/issues/477#issuecomment-4455186: > Edit: You truly got a lot of data, which is good as it allows for some stress testing. You might want to consider enabling a filter, let's say 3 months rolling. Because with more than 5000 records in display the ui may become really slow? I can do that, yes, but I didn't find anything in the UI that looks like this 😕 In any case, so far I haven't seen the UI getting any slower, but it might so I'm all for filtering things. 😉 > As you may have noticed from the response to your other post, there have been some significant code changes with Fluid recently, hence instead of me stabbing in the dark I would propose I compile a dedicated version for you which provides some additional notifications. Alright, shoot and I'll try any build you want. 😉 > A few more que4stions which came to my mind: > > * Is your database encrypted? Check in about dialog It is, yes, is that a problem? 🤔 > * How do you enter your data, quick entry mode off or on? It is on, is that a problem? 🤔 > * What does losing data look like exactly? You enter a record and later on it appears like it wasn't saved, or rather some data which you know was there before is missing all of a sudden? That, I know for a fact I had entered some things in the past, but it isn't there anymore.

toz commented 2025年05月13日 17:36:02 +02:00

None of these are problems, it's just for me to narrow down the moving parts. If e.g. you are using quick entry I don't need to look into "slow entry" part of the code.

<<That, I know for a fact I had entered some things in the past, but it isn't there anymore.>>
Entered yes, but maybe what you entered never got stored without you noticing. If those entries showed up in the tab they were stored in the db at least for a while. If you maybe entered some data late at night, hit save and then went on with the night, you may have not noticed that that entry got lost right away, never got stored?

The reason why I am so pedantic about this is, that not storing upon entering is a completely different thing than losing data which has been in the DB already.

<< but I didn't find anything in the UI that looks like this >>
The screen shot a bit higher up shows an arrow pointing to the filter button?

None of these are problems, it's just for me to narrow down the moving parts. If e.g. you are using quick entry I don't need to look into "slow entry" part of the code. <<That, I know for a fact I had entered some things in the past, but it isn't there anymore.>> Entered yes, but maybe what you entered never got stored without you noticing. If those entries showed up in the tab they were stored in the db at least for a while. If you maybe entered some data late at night, hit save and then went on with the night, you may have not noticed that that entry got lost right away, never got stored? The reason why I am so pedantic about this is, that not storing upon entering is a completely different thing than losing data which has been in the DB already. << but I didn't find anything in the UI that looks like this >> The screen shot a bit higher up shows an arrow pointing to the filter button?

bochecha commented 2025年05月14日 09:33:33 +02:00

@toz wrote in #477 (comment):

None of these are problems, it's just for me to narrow down the moving parts. If e.g. you are using quick entry I don't need to look into "slow entry" part of the code.

Understood, so yes I am indeed using quick entry.

<<That, I know for a fact I had entered some things in the past, but it isn't there anymore.>> Entered yes, but maybe what you entered never got stored without you noticing. If those entries showed up in the tab they were stored in the db at least for a while. If you maybe entered some data late at night, hit save and then went on with the night, you may have not noticed that that entry got lost right away, never got stored?

The reason why I am so pedantic about this is, that not storing upon entering is a completely different thing than losing data which has been in the DB already.

The thing is I have no way to know the data has been entered in the db, all I know is I entered the data in the form, whether it has been committed to the DB is another thing entirely 🤷

<< but I didn't find anything in the UI that looks like this >> The screen shot a bit higher up shows an arrow pointing to the filter button?

Ah, indeed, I assumed clicking that button would just toggle on or off, but I did try it and found how to filter things on a sliding window of 6 months 😄

@toz wrote in https://codeberg.org/toz/MediLog/issues/477#issuecomment-4468527: > None of these are problems, it's just for me to narrow down the moving parts. If e.g. you are using quick entry I don't need to look into "slow entry" part of the code. Understood, so yes I am indeed using quick entry. > <<That, I know for a fact I had entered some things in the past, but it isn't there anymore.>> Entered yes, but maybe what you entered never got stored without you noticing. If those entries showed up in the tab they were stored in the db at least for a while. If you maybe entered some data late at night, hit save and then went on with the night, you may have not noticed that that entry got lost right away, never got stored? > > The reason why I am so pedantic about this is, that not storing upon entering is a completely different thing than losing data which has been in the DB already. The thing is I have no way to know the data has been entered in the db, all I know is I entered the data in the form, whether it has been committed to the DB is another thing entirely 🤷 > << but I didn't find anything in the UI that looks like this >> The screen shot a bit higher up shows an arrow pointing to the filter button? Ah, indeed, I assumed clicking that button would just toggle on or off, but I did try it and found how to filter things on a sliding window of 6 months 😄

toz commented 2025年05月15日 16:39:42 +02:00

I have published a debug release for you here: https://cloud.zell-mbc.com/s/medilogDownload
Look for bochecha-release.apk

It's based on the latest v3.2.5 release and will show the message below with every write attempt:
image

Record count should go up, one by one.
If the record count doesn't match what I expect it will show the below:
image

I have published a debug release for you here: https://cloud.zell-mbc.com/s/medilogDownload Look for _bochecha-release.apk_ It's based on the latest v3.2.5 release and will show the message below with every write attempt:  Record count should go up, one by one. If the record count doesn't match what I expect it will show the below: 

bochecha commented 2025年05月22日 22:10:37 +02:00

Thank you for the debug release, how do I install it though? I just click on the app and it will install? Or is there something more to do? (I know how to install rpms on my laptop or even how to build them, but I know nothing about phones 😅)

Thank you for the debug release, how do I install it though? I just click on the app and it will install? Or is there something more to do? (I know how to install rpms on my laptop or even how to build them, but I know nothing about phones 😅)

toz commented 2025年05月23日 08:26:05 +02:00

That's it, click on the app and it will install. One important thing though. Two MediLog's can't coexist, hence Android will most likely ask you to remove the existing app -> Make sure your backup is current so you can import after installing the debug release.

That's it, click on the app and it will install. One important thing though. Two MediLog's can't coexist, hence Android will most likely ask you to remove the existing app -> Make sure your backup is current so you can import after installing the debug release.

bochecha commented 2025年05月23日 18:15:12 +02:00

Hmm, I can't find how to import my backup 😖

Hmm, I can't find how to import my backup 😖

toz commented 2025年05月23日 18:26:43 +02:00

Settings/Data Management/Restore ?

Settings/Data Management/Restore ?

bochecha commented 2025年05月23日 19:26:19 +02:00

Hmm, I can't see à "data management" here, would be "gestion des données" in French I guess...

Hmm, I can't see à "data management" here, would be "gestion des données" in French I guess...

bochecha commented 2025年05月23日 19:28:48 +02:00

Also no luck in English

Also no luck in English

toz commented 2025年05月23日 19:32:59 +02:00

: Menu /Data Management/Restore

image

: Menu /Data Management/Restore 

bochecha commented 2025年05月23日 20:08:50 +02:00

Aaaaah ! When you said "settings" I wrongly assumed you meant for me to actually open the settings. 🤦

The screenshots I took were from that settings dialog...

Aaaaah ! When you said "settings" I wrongly assumed you meant for me to actually open the settings. 🤦 The screenshots I took were from that settings dialog...

bochecha commented 2025年05月23日 20:41:35 +02:00

So, I am now running your debug version, hope that can give you more info about what happens to me 😉

So, I am now running your debug version, hope that can give you more info about what happens to me 😉

bochecha commented 2025年11月10日 01:10:41 +01:00

Hi, I had a problem with my phone so I had to uninstall Medilog and reinstall it, I am now back on the F-droid version and I can't find the bochecha-release.apk in that folder you linked to above 😕

Hi, I had a problem with my phone so I had to uninstall Medilog and reinstall it, I am now back on the F-droid version and I can't find the bochecha-release.apk in that folder you linked to above 😕

toz commented 2025年11月10日 20:22:22 +01:00

I didn't keep it for long I am afraid. Does the current F-Droid release still show that behaviour?

I didn't keep it for long I am afraid. Does the current F-Droid release still show that behaviour?

bochecha commented 2025年11月11日 04:43:59 +01:00

Hard to say as I got used to make a backup after every entry 😅

However, the latest fdroid release doesn't have the tags feature to track both intake and outtake, which was really nice. 🥰

Hard to say as I got used to make a backup after every entry 😅 However, the latest fdroid release doesn't have the tags feature to track both intake and outtake, which was **really** nice. 🥰

toz commented 2025年11月11日 14:07:30 +01:00

Tag support is still there, it's an experimental feature which you need to enable in Settings first.
image

I did however notice that when you change the setting, the tag icon won't show up right away. You need to navigate to e.g. About to make the changed setting to be reloaded again. That will be fixed in the next release.

Tag support is still there, it's an experimental feature which you need to enable in Settings first.  I did however notice that when you change the setting, the tag icon won't show up right away. You need to navigate to e.g. About to make the changed setting to be reloaded again. That will be fixed in the next release.

bochecha commented 2025年11月11日 18:25:03 +01:00

Ah, I see, thanks for the screenshot which showed me how to enable it 👌

Ah, I see, thanks for the screenshot which showed me how to enable it 👌

toz commented 2026年01月28日 16:14:15 +01:00

I guess I can close this one by now...

I guess I can close this one by now...