So the Storage Lead Developer of Scaleway reached to me saying that they had real issues with buckets with more than 1m+ objects, the databases can't handle it. He said my bucket was really stuck so he couldn't do anything.
They know I'm migrating so he's keeping a eye on it and we keep in touch while it's ongoing.
They will offer this month's bill, which is cool.
Sometimes stuff goes wrong,
The thing is, the background jobs queue is huge now, because there is a backlog of 3.5 millions jobs. So Redis is using 5-6GB of RAM which is messing up with the server.
Since this is getting pretty bad, I decided to switch to the OVH bucket with the missing files. I would have preferred not to but it's the best option right now.
@admin Congratulations on the progress!
@admin I often refer to myself as an "IT guy", but I have no idea what you are doing right now
Wow, it's 2x to 6x more efficient. The backlog size is finally going down!