{"id":185,"date":"2013-07-02T23:17:32","date_gmt":"2013-07-03T05:17:32","guid":{"rendered":"http:\/\/goblinpeasant.no-ip.org\/blog\/?p=185"},"modified":"2013-07-02T23:17:32","modified_gmt":"2013-07-03T05:17:32","slug":"mysql-backups","status":"publish","type":"post","link":"https:\/\/goblinpeasant.com\/blog\/mysql-backups\/","title":{"rendered":"MySql Backups"},"content":{"rendered":"
\"Dolphins<\/a>
Dolphins love data managers! It is known.<\/figcaption><\/figure>\n

MySQL is a fantastic open source database management system that manages data for a huge number of incredibly popular websites. \u00a0Twitter, Google, Facebook and YouTube all use MySQL to store and recall data, and thanks to the amazing movement of open source so can we!<\/p>\n

Personally, I use MySQL for storage of a number of things; several time-clock programs, this WordPress blog, and my Cthulhu Character Creator to name a few. \u00a0However, the problem I’ve come up against was that all this data was stored in one location. \u00a0If the storage hardware or the operating system of the device storing it failed in some manner, I could lose it forever.<\/p>\n

Unacceptable!<\/p>\n

So after giving it some thought, I set up a good number of redundant backup systems, but the one that I found to be the easiest and the most comforting was this:<\/p>\n

    \n
  1. Create a script to dump the entirety MySQL system<\/li>\n
  2. Setup an hourly execution of that dumping script<\/span><\/li>\n
  3. Setup an hourly offload of that dump to a different device<\/li>\n
  4. Archive those dumps backwards with timestamps daily for 30 days previous<\/li>\n
  5. Snicker about using the word dump so many times<\/li>\n<\/ol>\n

    Dumping the File<\/strong><\/em><\/p>\n

    Creating the script to dump the entire MySQL system was pretty simple once I knew the command for it.<\/p>\n

    mysqldump -u root -p<password> –all-databases > <backupfilename.ext><\/p>\n

    This command creates a file readable by MySQL for importing, and has everything you could want from the databases you have stored.<\/p>\n

    Automation & Data Archiving<\/strong><\/em><\/p>\n

    Since my MySQL database was residing on a Linux server, the easiest way to set up an automated, recurring execution is through the crontab. Setting it up there lets the OS worry about it so that you don’t have to.<\/p>\n

    Setting up the hourly offload was also fairly simple. \u00a0Offloading the dumped database file is just a matter of s\/ftp-ing it somewhere for duplication. \u00a0For this I created an expect script and added it to the end of the dump script. \u00a0As a part of the script, the sftp command includes renaming the sql file to include the day of the month tacked on to the end for archival purposes. \u00a0Because it’s only the day of the month, it will overwrite the file monthly so that you will have a month’s worth of snapshot data. \u00a0 The script itself looks something like this:<\/p>\n

    FILENAME1=”backup.sql”
    \nTHISDATE=`date +%d`
    \nFILENAME=$FILENAME1$THISDATE
    \necho $FILENAME
    \nexpect <<EOF > logfile.txt
    \nset timeout 50
    \nspawn sftp <USER>@<SFTP HOST>
    \nexpect “assword: ”
    \nsend “<PASSWORD>\\r”
    \nexpect “sftp>”
    \nsend “put backup.sql $FILENAME\\r”
    \nexpect “sftp>”
    \nsend “exit\\r”
    \nexit
    \nEOF<\/p>\n

    Considerations<\/strong><\/em><\/p>\n

    Obviously this method has its downsides. \u00a0The two scripts require that you store the passwords to both the MySQL root user and the s\/ftp receiving passwords in text files. \u00a0If you don’t have those scripts locked down, or if the server itself is accessible widely then of course it may not work for you. \u00a0However, I have the servers pretty secured, so it hasn’t been an issue yet. \u00a0But I could see how this might not be a good fit for some people, especially if they are in an enterprise system with strict security requirements.<\/p>\n","protected":false},"excerpt":{"rendered":"

    MySQL is a fantastic open source database management system that manages data for a huge number of incredibly popular websites. \u00a0Twitter, Google, Facebook and YouTube all use MySQL to store and recall data, and thanks to the amazing movement of open source so can we! Personally, I use MySQL for storage of a number of […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[8,9,13,16],"class_list":["post-185","post","type-post","status-publish","format-standard","hentry","category-website-admin","tag-archive","tag-backup","tag-expect","tag-mysql"],"_links":{"self":[{"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/posts\/185","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/comments?post=185"}],"version-history":[{"count":0,"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/posts\/185\/revisions"}],"wp:attachment":[{"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/media?parent=185"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/categories?post=185"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/goblinpeasant.com\/blog\/wp-json\/wp\/v2\/tags?post=185"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}