Recovery failure when the tablet server shuts down due to 'No space left on device'

[zuston]

Search before asking

• I searched in the issues and found nothing similar.

Fluss version

0.9.0 (latest release)

Please describe the bug 🐞

I found that recovery fails when the tablet server shuts down due to a 'No space left on device' error. The failure logs are as follows:

However, after dropping the corresponding partitions by fluss admin, partition recovery is still not skipped. This indicates that the behavior described in #3223 can be further improved.

In addition, we should prevent writes once the disk usage reaches a high-capacity watermark to avoid potential data loss.

Solution

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[zuston]

cc @wuchong @luoyuxia @beryllw