RE: MySql Cluster 5.0

A few comments about running MySQL Cluster in VMware:

Unless you have a really big VMware host server with fast storage, be prepared to encounter several challenges. The primary issue is that with all the "shared" resources, nodes in your MySQL Cluster may respond slowly and this can cause the cluster to think that a particular node is no longer alive. Also, if your guest OS is not 64bit, your maximum memory size is limited to under 2GB per process, which means your database will max out at 2GB or less.

If you're really determined to use MySQL Cluster in a VM environment with VMware, here are a couple of tips:

1. Optimize your VM for disk I/O, especially for the /var/lib/mysql-cluster/ndb_X_fs directory. If writing to this directory gets too slow and you have a lot of I/O waits, the node will be mistaken to be dead and your cluster will start to shutdown. These optimizations include: a) pre-allocate vm disk files and defrag or optimize this file for quick random access, b) use very fast I/O disks on the host (stripe/RAID-0, RAID-5 w/ 6+ disks, SAN, etc.), c) for each VM, use the SCSI lsilogic virtual driver, d) use a filesystem designed for high I/O such as XFS for the ndb_X_fs space, e) allocate enough memory for each VM so as to avoid swapping. Latency in disk I/O was the biggest headache in terms of getting a MySQL Cluster stable in VMware environment.
2. Optimize your VM network configuration. Do NOT use a vmnet that is completely virtual. In my experience, using bridging on a real network interface yields higher throughput and lower latency. High latency will kill your MySQL cluster. Also, use the "e1000" virtual network driver that emulates the Intel Gigabit NIC; this seems to perform much better than any of the others.
3. For the data nodes, you will do much better to allocate multiple CPUs for the ndbd processes. Of course, this means your host VM server must have enough processing capacity.

The usual fine tuning of MySQL cluster parameters in /var/lib/mysql-cluster/config.ini will still be required, and you might need to increase several of the timeout parameters to compensate for the increases in latency when running in a VM environment.

Finally, you mention using 5.0.x. In my experience, 5.0.x was very resource intensive in a VMware environment. I could still get it to work, but there were more frequent failures due to high latency (somewhere.. disk I/O, network I/O, etc). When I switched to 5.1.x, the situation was MUCH improved. So, if you don't have a commitment to 5.0.x, you might be better off using 5.1.x MySQL cluster in the VM environment.

As for general MySQL cluster setup, read the manual and get the MYSQL Cluster book. (search google/amazon)

Good luck.
-B. Masuda

> -----Original Message-----
> From: Liang Chen [mailto:clzzclzz@gmail.com]
> Sent: Tuesday, August 07, 2007 11:35 PM
> To: Sandeep Bhoyar
> Cc: cluster@lists.mysql.com
> Subject: Re: MySql Cluster 5.0
>
> Hi ,
> I'd recommend looking at this :
> http://forge.mysql.com/snippets/download.php?id=16
> MySQL Cluster in 5 Minutes
>
> On 8/6/07, Sandeep Bhoyar <sandeep.bhoyar@sumasoft.net> wrote:
> > Hi ,
> >
> > I am Sandeep
> > I am new to Mysql Cluster , This is the first time I am configuring
> > MySql Cluster 5.0
> >
> > I have Four machine using for MySql Cluster I have grouped in to two
> >
> > I am using VMWARE to manage Cluster
> >
> > 1> node 1 and node 2 on on VM Machine.
> > 2> Management server and sql node on other VM machine
> >
> > OS I am using is RHEL 4 and MYSQL 5.0
> >
> > I have configured MYSQL CLUSTER
> >
> > I dont know how it works.How thwe table get reflected in cluster.
> >
> >
> >
> > Colud you Please provide me the step by step procedure to
> establish setup and how it works.
> >
> >
> > Thanks & Regards,
> >
> > Sandeep Bhoyar
> > -----------------------------------------------------------------
> > TeamDBA
> > SumaSoft Pvt Ltd
> >
> >
> >
> > ----------------------------------------------
> > Confidentiality Note: This e
> > -mail message and any attachments to it are intended only for the
> > named reci pients and may contain legally privileged and/or
> > confidential information. I f you are not one of the intended
> > recipients, please notify the sender and d o not duplicate
> or forward
> > this e-mail message and immediately delete it fro m your computer.
> > ----------------------------------------------
> >
> >
> >
>
>
> --
> Sincerely,
> liang
>
> --
> MySQL Cluster Mailing List
> For list archives: http://lists.mysql.com/cluster
> To unsubscribe:
> http://lists.mysql.com/cluster?unsub=bond.masuda@jlbond.com
>
>

-- 
MySQL Cluster Mailing List
For list archives: 
http://lists.mysql.com/cluster
To unsubscribe:    
http://lists.mysql.com/cluster?unsub=lists@pantek.com

Do you need help?

In addition to our free technical library, Pantek provides professional IT services to companies who utilize Open Source software: Learn more about Pantek's Technical Support offerings Place an order for 24/7/365 Technical Support here Learn more about Pantek, who we are, and what we do Chat with a Live Operator Related lists.mysql.com Links announce benchmarks bugs certification cluster commits dotnet gui-tools internals java maxdb myodbc mysql mysqldoc packagers perl plusplus replication win32 Request more information about Pantek