We got hit by the increased traffic usage spike, roughly described there: https://notes.status.im/5apzxihzQcqRN0WzpvL6SQ
One of the main reasons is that we use a single topic for all 1-to-1 communications (and group chats are bases on 1-1 communication). So, essentially all communications except public chats are using a single topic.
What is good about it and why is it done this way?
Darkness. If everyone sends messages to the same topics, it is impossible to figure out whom is talking to whom.
What is bad about it and why do we need to find an alternative?
Since each communication happens in the same topic, each client has to download all the messages for this topic, not matter who sent it. That mean, any active 1-1 chat or a group chat will increase traffic for everyone on the network. With Status audience growing, this topic will become more and more busy. Today (20181207), we got > 100Mb of messages in this topic. That leads to slowing down every client and huge traffic usage.
Hence, we need a way to somehow split this topic into multiple topics, hopefully, preserving darkness as much as possible. That might not be possible, and we might have to tradeoff darkness to less traffic usage, otherwise, very soon, we will end up with each client having to download gigabytes of data each day just because of the activity of the users he doesn’t know anything about.
I want to have a call mid-next-week to discuss it, because it needs to be addressed.
Questions that are needed to be answered:
(1) what is the best way to go multi-topics without trading off too much darkness?
(2) how much darkness can we trade off for that?
Any ideas are appreciated in the comments or on the call.
Ping me here if you want to participate.