Re: Help with large database import

On Tue, 2007-10-23 at 11:05 +0530, chandru wrote:
> Hi Mattew,
> Thanks for the reply. I have some query regarding loading of data
> 1. Is there a way to speed up the process of loading data?

Sometimes it can be faster to insert the data as a MyISAM table then convert it to ndb using ALTER TABLE.

> 2. Can i forcefully tell mysql to stop creating undo logs/files while
> importing data?

You can tell mysqld not to write binary logs but you cannot tell the ndbd (cluster) nodes not to write their redo logs.

With SUPER privilege you can 'SET SQL_LOG_BIN = 0'. This will skip binlogging for the duration of the import session. This can speed up the import quite a bit.

> 3. I have taken extended dump of the table. Is there a variable like
> 'bulk_insert_buffer_size' that can be tuned to increase the memory
> temporarily for import.

Nothing directly like this... there is however the UndoIndexBuffer, UndoDataBuffer and RedoBuffer which can be tuned to increase the performance of large insert operations. In 5.1 with disk data you will also want to configure SharedGlobalMemoryArea

Do you need help?

In addition to our free technical library, Pantek provides professional IT services to companies who utilize Open Source software: Learn more about Pantek's Technical Support offerings Place an order for 24/7/365 Technical Support here Learn more about Pantek, who we are, and what we do Chat with a Live Operator Related lists.mysql.com Links announce benchmarks bugs certification cluster commits dotnet gui-tools internals java maxdb myodbc mysql mysqldoc packagers perl plusplus replication win32 Request more information about Pantek

See:
http://dev.mysql.com/doc/refman/5.0/en/mysql-cluster-config-params-ndbd.html

-- 
Matthew Montgomery, Support Engineer
San Antonio, TX
MySQL Inc, www.mysql.com


-- 
MySQL Cluster Mailing List
For list archives: 
http://lists.mysql.com/cluster
To unsubscribe:    
http://lists.mysql.com/cluster?unsub=lists@pantek.com