[Bug] Failed to load AppFlowy UI

[Twilightssuperb]

Bug Description

After forced PC reboot (because of blackout) I launched previous v.0.4.9 instance from disk C by accident. Got error, closed it. Then I've started main v.0.7.3 instance on disk F, but get empty UI.

How to fix it? I've tried to delete all files from AppFlowy instance form disk F and set clear instance, but nothing...

How to Reproduce

IDK

Expected Behavior

log_2024-11-10.txt (previous normal launch)
log_2024-11-12.txt

Operating System

Win 8.1 x64

AppFlowy Version(s)

0.7.3

Screenshots

Additional Context

No response

[LucasXu0]

Hi, @Twilightssuperb. The last version that supports Windows 8 is v0.4.9.

Are you using the local mode? And please try to downgrade to v0.4.9.

[Twilightssuperb]

I use local mode.

All was OK with v.0.7.3 on this PC before my mistake with accidental v.0.4.9 launch. I attached logs.

Maybe the reason is in some C:\users\[...]\AppData\Roaming\io.appflowy files, I don't know. It's not good that AppFlowy isn't completely portable and leaves traces and makes dependencies for standalone instances.

I create third standalone instance for v.0.5.1, but same error again (that for v.0.4.9) — failed to load workspace. Despite no AppFlowy instance is running.

[LucasXu0]

@Twilightssuperb Can you check if this folder is occupied by another process? In this case, the app can't read any data from the directory, which may cause this error.

C:\users\[...]\AppData\Roaming\io.appflowy

[Twilightssuperb]

Can you check if this folder is occupied by another process?

Resource Monitor says nothing:

@appflowy, please, could you check my logs? 🙏 Sorry for weekend disturbing.

[appflowy]

Hi @Twilightssuperb . No problem, I will check it. Thanks for your logs

[Twilightssuperb]

Any news? Sorry for tricky troubleshooting, IDK how it happened.

Should I better manually backup my data folder, delete it from main location and restore DB from file (https://docs.appflowy.io/docs/appflowy/product/data-storage#restore-specific-local-user-data-manually)?

[Twilightssuperb]

Well, seems data folder is damaged. I backuped it and tried to make clear AppFlowy instance, then pressed "Import data", but got error. Then I tried to edit .db-files (cache.db and flowy-database.db), but blank page at start appeared again.

@appflowy, I attached data ZIP backup there with no password etc., please, mention me after downloading, I will delete it. IDK what to do now, 'cause there are some important notes in my DB, it's hard to lost it. Sorry for incovenience.

[annieappflowy]

@Twilightssuperb , we'll take a look and reach out tomorrow

[appflowy]

Hi @Twilightssuperb I need a password to open it.

[Twilightssuperb]

@appflowy, try password 123.

[Twilightssuperb]

No reply month later... C'mon, please, help me restore my database anyway, at least as DB-file, it doesn't matter, I still have no access to some important notes from AppFlowy. I know, it's my big fault and I shouldn't launch versions >0.4.9 on Win 8.1, but... 😢

[candideu]

@Twilightssuperb are you using the Cloud sync, by any chance?

[Twilightssuperb]

@candideu, nope, only local account. My data was damaged by my ridiculous mistake.

[candideu]

That's too bad... I faced a similar issue with Windows 10 (see: #6979 (comment)) was only able to recover my data because it was backed up using the free sync account.

I've faced the same issue with another local-only app a while back (Focalboard), where the app wouldn't load my data after an upgrade. The devs did their best, but were unable to assist. Since then, I try to use local-apps with cloud sync features (or File History, if it's markdown based).

What I did manage to do with that other app was to open my db file in a SQLite editor like SQLiteStudio and DB Browser for SQLite. I was able to export the table which contained my data as a .csv, then imported it into Airtable. It was challenging, but I was able to salvage my data.

Appflowy's data structure seems to be a little more nebulous, though.... I have zero clue where my notes are stored on the computer, and which app I could use to open and recover them....

• Where is the database? #455
• [Bug] Missing pages and documents #2504 (comment)
• [FR] Bulk export all md files #3334
• https://www.reddit.com/r/AppFlowy/comments/1ewcifu/ensuring_data_integrity/
• Tried reading through this doc page, but it didn't offer much guidance: https://docs.appflowy.io/docs/appflowy/product/data-storage

Do you happen to have access to another Windows machine (like Windows 10 or 11), which you could use to (potentially) import your data, and allow you to export everything?

[khorshuheng]

@Twilightssuperb Sorry for the delay, @appflowy is on leave at the moment so I can't reach him immediately to get the current status.

Apologize again for the inconvenience, could you send us the file again? I will get some other colleague/myself to see if we can recover the database.

[Twilightssuperb]

@khorshuheng, https://dropmefiles.com/tpCS7 default password is 123

[khorshuheng]

@Twilightssuperb Thanks. I have downloaded the file, you may remove the link now.

[khorshuheng]

Based on the file, it appears that the RocksDB data is corrupted - the .sst file is missing. I will research if there are ways to repair the database.

EDITED: In the collab_db_backup there are backup with the .sst file intact. Unfortunately, they can't really be read as database since there is no manifest file. Checking if i can directly read the sst file using RockDB API.

[Twilightssuperb]

@khorshuheng, should I search on PC and attach another files? How to find this manifest file, e.g.?

P.S. Well, there is MANIFEST-000012 file inside collab_db folder.

[khorshuheng]

@Twilightssuperb While the manifest file exists inside collab_db folder, it can't be used for the data in backup. I tried that, hoping that it would work, but failed.

It's not that you forgot to attach the file, in all likelihood the file wasn't created due to some error / was removed.

In any case, I can find the historical document updates (based on the data on 10th November 2024) in the .sst files in collab_db_backup, and is able to dump the content (in binary format) using the sst_dump tools. Though I will still need to figure out how to read the data via API and reconstruct the document in JSON, if possible. Will need to consult my other colleagues on this.

[Twilightssuperb]

I can attach something from C:\users\[...]\AppData\Roaming\io.appflowy backup, but I'm not sure that it could clear.

[khorshuheng]

@Twilightssuperb I was able to recover some documents in it's raw json format, but since i don't understand the language the document is written in, i am not too sure which one is worth recovering and which one aren't. Are you able to join our official discord? I can send you what i have recovered so far, and i will continue trying to see if i can convert them into a more readable format, like markdown/csv.

[khorshuheng]

@candideu The raw data is stored on the client's machine in RocksDB. If the database is not corrupted, we can use RocksDB API to read the key and values, otherwise, we will need to use sst_dump to get the key and values (or sst reader API, if you know the C language/using a RockDB binding that supports the SST reader API).

The values are in yjs/yrs binary format, which can then be printed as json file - that is the raw format that AppFlowy is using, though it can be converted to markdown/csv/etc .

If i can recover the data for @Twilightssuperb without issue, i will provide the script that i used to recover the data.

[Twilightssuperb]

@khorshuheng, main notes language is Russian, so it must be in Unicode. Well, I don't have Discord account, so I'll think of it.

[khorshuheng]

Noted. Is there any other way that you would prefer me to send you the data, if not by discord? Since the content is now in plaintext, it's probably not a good idea to have public download link to your data in this issue.

[Twilightssuperb]

@khorshuheng, you can message @ voknubrogss4124 in Discord.