Software and Tools - Backups

One of the most important things you can do after you secure your device is to make regular backups and just as important is to test your backups.

Why backup?

• Hard drives fail.  It doesn't matter how new the drive is or even if it is a SSD they will fail sooner or later;
• You lose your device or it is stolen;
• You drop your device and now it does not work;
• When you patch or update your operating system it fails.  It doesn't matter the O/S you are using, I have had failed Linux updates and it required me to rebuild the machine;
• You migrate to a new device and want all the files on the old machine moved to the new machine;
• You finger slips and you accidentally delete an important file/directory; 
• There is a disaster (ie. fire or flood);
• Your device(s) infected with a virus or a trojan.  Again, it doesn't matter the O/S you are using, there are nasty programs out there that works in Windows, Linux and OS/X.

If one or more of the above happens you will need a backup so that your important documents are available to you when you rebuild the device or copy to a new device.  I have had people come to me with dead and dying devices asking if I can pull off their data and they have not made any backups.  Too often I cannot recover all of their files and important documents, images, videos are lost and they don't have any backups.

Things to think about

How often do you backup? 

• That all depends on your personal preferences and how many documents you are adding to your device;
• If you don't create very many then it may be safe to backup infrequently (monthly); 
• If you create a lot of files (like scanning family photos), then frequent backups (daily) may be a good thing;
• Once you set a schedule stick to it.  I put up a recurring reminder in Google calendar to remind me of when backups should be run.  Also you can set up a recurring task in Windows and Linux (cron) to run your backup scripts on a set schedule.

How many copies do you want to keep?  

• Again this is a personal preference, but, multiple full backups is a good thing just in case one fails for some reason; 
• An option here is a monthly full backup and then weekly backups of new/changed (differential backups) files;
• Another reason as backups may fail and if you have only one copy then you have nothing to go back to.  I know this happens as decades ago when at work we were doing a DRP (Disaster Recovery Plan) exercise at work and one of the corporate backup tapes failed.  It wasn't a major problem as we did keep multiple backups and restored from an older image;

Off-site location for your backups?  

• It doesn't matter if you have a good set of backups if you cannot get access to your site;
• How secure is the off-site.  If you have sensitive information you don't want anyone getting access to the backup;
• You should also figure out who should have access to your backups and let them know where it is and how they can get access to the backups if required;

Media for backups.  

• Decades ago floppies were the media, then CDs followed by USB drives;
• When you backup make sure that the tools, hardware and software is there to allow you to read the backups.  An example of this is some time ago I had to pull off backups from my father-in-law 3.5" floppy drives as he didn't have a floppy drive in his machine.  We were lucky in that I have an external 3.5" USB floppy drive for this and it was set up in Linux.  I also have an external CD drive and a blu-ray drive (call me paranoid) so I can pull files from backups in that format;
• To the cloud.  Don't depend on that as your main backup as it may not be there when you need it.  I like Google drive for a secondary backup myself and the bonus is that the files I put there are available anywhere I have a web browser (and the firewall allows access).  With the various sites getting hacked I also don't keep files there that are sensitive and when I do put up a file of that nature I use encryption on the file/directory.  I also have a small script using GRIVE in Linux to pull a backup from GOOGLE drive to my machine.

Software and file format for backups.  

• Over time operating systems do change and the software that did the original backup may not run on your new device and the new devices may not even be able to read your backups;
• I tend to work with the lowest common denominator for backups that does work across platforms.  I prefer to use "ZIP" files as I know Windows and Linux both can work with that file format.  I assume OS/X will be able to read them too, but, I don't use that operating system so I am not 100% sure;
• On my Linux machine I am partial to KBACKUP.  It is fairly easy to set up and use and it stores the files in a format that I can open in an Linux distro and Windows;
• On my Windows box I use a simple XCOPY routine.  It isn't pretty, but, it works and the files are in a format that my Linux machines can read;
• For my Android devices they get backed up to Google drive;
• Several times a year I take one of my backups and plug it into a different machine to see if it is readable and I can pull one or more files off the backup.  Make sure what is backed up can be restored!  It is also a quick and easy test to see if your restore steps work and if there is anything else you should be doing when restoring from a backup;

When you restore.

• If the restore is due to a virus or a trojan I strongly recommend that you don't ever use your backups until you have a clean and patched machine.  If the machine is still infected and the media you are using can be written to you don't want those backup files corrupted;
• Make a checklist of what you need to do the restore and the steps performed when doing a restore.  This includes steps on how to verify that the restore worked;

My KBACKUP routine

Here are screen shots of my starting KBACKUP, running the backup and when it finishes.

Shortcut in my toolbox

Loading my backup profile

Directory & file list for backup

Backup running

Backup done with filename

Some setting tweaks if your mouse appears to be dead

Starting with Windows 7 I noticed at times my mouse would stop working for a while.  I either had to unplug and plug the mouse back in, or, wait a few minutes for it to come back to life.  Windows 8 and it appears Windows 10 has the same issue.  It seems that by default Microsoft by default has 'Allow the computer to turn off this device' in power management turned on by default.


If you go to device manager, USB controllers and click on each hub.  If there is a power management setting click on that and turn off the check mark on the 'off'.

 

Blue tooth also has a similar setting and you may want to turn that off too.

So far it has been almost a day and the blue tooth mouse has been running without a problem.

Father-in-law computer. Next project isn't going to be easy

I was asked to back up all of the files my father-in-law has accumulated over the decades and put them on to USB memory sticks.  Think it is real easy right?  Not really.  Here is what I will be working with:

• Pentium class computer, old slow processor (well under 1 Ghz).
• Windows 95.
• No USB ports.
• No network card.
• Almost 100 3.5" floppy drives.
• A good number of ZIP disk drives.  He has a parallel port model.
• About 100 CDs and DVDs.

The last item was real easy, I popped that into my new laptop DVD drive, oh crap, it doesn't have a DVD.  Not a problem there as I am lucky to have an external CD/DVD drive that works in Windows 8.1.  I found a good number of CDs that I didn't create and quickly backed them up to a new folder on the machine.

The rest of it will take a bit of slogging.  He has not used the machine in over a year so I am really hoping it will boot up.  My father-in-law tended to store his documents, spreadsheets and pictures on external drives as he didn't want to fill up the hard drive.  Here is the order of what I will be doing:

• Copy all documents that are on the hard drive to a CD.
• Copy all docunments that are on the ZIP disks to a CD.  If the machine doesn't boot I am going to have to attach the ZIP drive to one of my older Linux laptops and pray.
• Buy an External USB 3.5" drive (Canada Computers has them, YAY!) 
• Check out a newer USB DVD drive as the current one is the size of several bricks and just as heavy (and slow).
• Read every floppy on my new Laptop using the external USB drive and backup to the new directory.
• Copy all documents from the CDs and then start making copies of the files for my sister-in-law.

After all of that is done I will also make a backup copy to my 1 TB external drive as multiple backups is a good idea.  Keep in mind that what technology you are using today may be obsolete in a few years and if your files are important then migrating them to a new medium is something you will need to do. Another thing to remember, if you buy a new laptop without a DVD drive you may want to invest in an external USB version.


Update 2015/07/02:

Finished the job.  Canada Computers did have that floppy drive and it worked very well.  I didn't have to install any software as Windows detected the drive.  It took almost two days, but, 81 folders, 3,722 files and a total size of 1.2 Gigs all the data was transferred.  This also includes my converting various graphic files to JPG format. All of the files were backed up to a USB flash drive.

The ZIP disks were transferred, but, the machine he had failed to boot.  It looks like the hard drive failed there.  That wasn't a major problem as I had an old Windows 98 machine with a parallel port and the ZIP drive ran from there.  The only 'fun' was installing the driver as the install floppy had errors. I will have to pull apart the machine and see if I can use the USB adapter for IDE drives and see if there is anything there I can salvage.

Sister-in-law is happy as a lot of images and documents created over the decades have been saved and available to all of the family.


Next mini-project 

Now to start scanning the various photo albums that we picked up.  I know a number of them I did scan many years ago and I will have to see what pictures I didn't scan and digitize them.  I reorganized my office layout so that the scanner is just a short reach away and I moved the printer to where the scanner was.  This isn't a major change, but, having the scanner a few inches away rather than several feet will make this an easier project.  The old layout worked as I didn't scan very often.

Cutting Cable and going web for TV

We have cut our cable TV as the prices our cable provider charges keep going up and the quality of what is available in my not-so-humble opinion is going down.  Our cable provider told us they are moving a number of channels to digital and if we want to get them we must rent a digital converter.  The problem is that most of the shows are repeats and in a 30 minute show there is about 10+ minutes of commercials.

I am now in the process of building and testing a Linux box that will replace what cable TV offered us.  I am finding a number of sites that offer streaming movies for free and they are legal!  When I was searching for sites I found a lot of them offering movies, but, seeing the titles I know that they were pirated and I will not support those sites.  I want to find sites that offer legit movies for preferably free (or if they are in Canada a minimal charge).  The sites I did find even offer children show shows so our grandkids will have educational shows when they visit us.

The money I am saving will be used to buy DVDs to build up our movie library.  The bonus is that we pick the day and time of movies and can pause them if we need to restock on munchies or take a break.

The only thing I have had to buy is a wireless network card ( a DLINK USB card).  On my first test using PCLINUX it detected the card, found our network and prompted me to enter our key in to allow access to the network. 

The next test is to move the machine down into the living room, hook it up and run the machine.  I haven't decided if we will be using Firefox or Chrome for the browser stuff, but, I am not picky there as they both worked well in the test.

Linux on a USB stick

For the last couple of months I have been playing with a variety of Linux distros, but, they are running on a USB memory stick.  I found a nice program UNETBOOTIN that allows me to download and then install on the memory stick a number of Linux distros. You have the option of having the progam download the ISO itself or you can point it to the ISO image on your machine.  The program does everything else for you and at the end you have a bootable Linux.

I find this tool to be extremely useful as I can quickly test out a new distro and not waste CDs if the distro does not meet my needs.  I have two sticks right now with Linux.  The first stick for now is SABAYON and the 2nd will be for a security and recovery distro.  I need the second stick as friends and neighbors have problems with viruses, trojans and spyware getting on their machines and I figure a secure Linux distro that can help me clean this up will be very useful.

Updating my machine

For the last couple of months I have been looking at the various distros that are out there and how they work on my machine here.  The one I really wanted updated was PCLINUXOS so that all of the machines at home run with the same distro.  The 2009.2 version still won't boot on my machine so I had to look elsewhere.  My current distro was Mint 5.

Mandriva just came out with their latest and I downloaded and burned the ISO and gave it a shot.  It looks very nice visually and it detected most of my hardware without a problem.  The only two things were my palm pilot and the TV card which it didn't detect (like every other distro so far).  I then downloaded Mint 7 KDE and gave it a shot.  It was as visually appealing to me as Mandriva and had the same issues with the palm pilot and TV card.  The area it was ahead was that Java was installed automatically (I have to install that on Mandriva) and the ATI card driver was there for me.  I opted to keep with Mint so far and I upgraded to version 7.

One of the bonuses of this is now I have two more CDs that I can then pass out to friends and family when they have more problems with windows. 

It will take a bit of time to get used to KDE 4, but, so far it has not caused me any problems.  Firefox with Java still plays Runescape in HD mode without a problem.  Digikam works fine along with Thunderbird and XSANE.

When I get some time I will try to dig and see if I can get the palm pilot to work.  I thought I saw something about 'VISOR'.  If that doesn't work I really want to get my TV card to work.  I have a lot of home videos I would like to hook up to the input and make into MPG files and have them transferred to DVD for the family.

Update 2009/11/08:

I have moved off of Mint over to Mandriva.  I have been using Mint for a day and I have noticed a few things that make it a bit less usable for me.

1. Runescape log in flickers wildy and it cannot be stopped unless I take HD mode off.
2. The shutdown function at times (about 50%) does not work and the system locks.
3. I cannot access system services to manually define what I want to run.  This is a critical one for me as I want complete control over what is running.  Mandriva allows me to do this.

The first two items may be something that I did when I configured the system, but, so far Mandriva is not doing those things and I will use that for now.

In Mandriva it didn't auto-detect my printer (SAMSUNG ML-2010), but, after going to WWW.SAMSUNG.COM I found the driver, downloaded it and installed.  It wasn't as smooth as Mint, but, it worked and I now have a printer.

It is mostly Plug and Play

I have been doing a lot of playing around with my new Canon digital camera. I bought a new toy to go with it. It takes the SD card and makes it into a USB memory stick. I took out the photos from the wedding and plugged it into my Linux box. Within several seconds it recognized the new hardware and I had a window open in DigiKam and transferring over 800 megs of photos. I like the new hardware as it allows me to show people the photos without plugging in the camera to their machine (I normally don't bring the USB cable when taking pictures). The other nice thing is that I don't have to use the camera and wear out the batteries while viewing the photos.

DigiKam is a nice package and I have been using it for about a month. I have been moving my pictures into it and making suitable backups. Burning CDs is a simple option and it simplifies my task rather than using several programs for the tasks.