If you have MySQL running from a brew install, here are some precious tips if you want to speed up imports. On this test, I managed to decrease ~30 minutes of import process. From 45 minutes to 13 minutes.
I got to those numbers running http://mysqltuner.com. Itβs basically a perl script that reads your mysql config and shows an output with some metrics to change.
First, some commands to check your currentinnodb_buffer_pool_size
:
SHOW VARIABLES LIKE 'innodb_buffer_pool_size';
vim /usr/local/Cellar/[email protected]/5.6.36_1/my.cnf
# Speed up Imports:
innodb_flush_log_at_trx_commit = 2
innodb_log_file_size = 500M
innodb_buffer_pool_size = 3G
Restarting:
cd /usr/local/Cellar/[email protected]/5.6.36_1/bin/
./mysql.server restart
<< All Posts
Previous post:
Zookeeper and Apache Kafka with Ruby
Zookeeper and Apache Kafka with Ruby