So the Storage Lead Developer of Scaleway reached to me saying that they had real issues with buckets with more than 1m+ objects, the databases can't handle it. He said my bucket was really stuck so he couldn't do anything.

They know I'm migrating so he's keeping a eye on it and we keep in touch while it's ongoing.

They will offer this month's bill, which is cool.

Sometimes stuff goes wrong, :shrug_yui:

Migration status:

980k objects / 1.8m
409 GB / 699 GB

Show thread

75% as of now. The majority of what's left is broken objects so it will take longer

Show thread

Stuck at 85%. About 250k objects are missing but their metadata is supposedly broken. I'll see tomorrow with the provider

Show thread

The thing is, the background jobs queue is huge now, because there is a backlog of 3.5 millions jobs. So Redis is using 5-6GB of RAM which is messing up with the server.

Since this is getting pretty bad, I decided to switch to the OVH bucket with the missing files. I would have preferred not to but it's the best option right now.

Show thread

@admin My personal opinion is that it does not matter that much if an image posted two months ago or weeks ago are missing. It would matter if it was a blog or a wiki. On a social network where more content is posted by the hour than I could read in a day.. it doesn't really matter. And I know some instances will simply drop older media content after XX days as a matter of routine.

Not being able to attach images to new posts is far more annoying. I am quite happy with that being restored.

Sign in to participate in the conversation

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!