Votes Database 80GB - Index Not Enough

in witness-category •  last year  (edited)

I have observed that some APIs take longer and longer to complete which results in timeout.

The votes DB is now more than 80GB.

image.png

Adding Indices is simply not enough.

image.png

I know the SQLite isn't a good choice here, but didn't have time to rewrite and migrate the data to MySQL or Posgres.

So, for now, I'll investigate how I can improve the Query Efficiency by possibly optimising the SQL or bringing in an extra layer of caching.

Steem Blockchain

Steem to the Moon🚀!

  • You can swap the STEEM/SBD to Tether USDT (TRC-20) via steem2usdt!
  • You can swap the STEEM/SBD to TRX (TRON) via steem2trx!
  • You can swap the STEEM/SBD to BTS (BitShares) via steem2bts!
  • Register a free STEEM account at SteemYY!
Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE BLURT!