Re: cluster takes enormous room to store data

Stewart Smith wrote:
> use ndb_size.pl (grab the version from the latest 5.1... it still gives
> you 5.0 results too... and likely more accurate ones) for an idea of
> what is using up space.

Sadly ndb_size.pl lied to us =) It analyzed our data and reported a usage of about 1.9GB. We then checked our servers using all dump 1000 and found that they were at 90% of their 4GB DataMemory. That is when I started tweaking varchar, int, and removing TEXT fields to get us back down to 2.8GB. I was able to up the DataMemory to 6GB as well. Our IndexMemory needs are quite low. We do mainly PK lookups so not many keys are needed.

I think our problem was that we had several TEXT fields that had between 255 and 500 bytes. I would kill for a varchar(1000) =). From what I understand, as soon as you go over 255, there is a 2k chunk in memory created to store the rest. If its 1 byte, it uses 2k. Correct me on that if I am wrong please.

Our 5.1 test cluster is up and running now. With all that TEXT data on disk, we are only using 208MB of DataMemory now.

-- 

Brian Moon
Senior Developer
------------------------------
http://dealnews.com/
It's good to be cheap =)

-- 
MySQL Cluster Mailing List
For list archives: 
http://lists.mysql.com/cluster
To unsubscribe:    
http://lists.mysql.com/cluster?unsub=lists@pantek.com