Archive for September, 2011

My Hard Drive Is Bigger Than Yours

Over the last (almost) decade of working at the same company I have been amazed by the ever growing need for storage solutions. We have moved over time from a mixed Windows 95/98/ME environment to a homogeneous Windows 7 installation base. Where we were long ago running Office 97 we are now running Office 2010. During this time the file sizes produced by these software packages has increased dramatically. We are storing images of entire hard drive installations now where we used to rebuild from disc (cd-rom and floppies). Throw in redundant copies of critical information, along with the fact that no one ever deletes anything, and our storage requirements were growing at an alarming rate. Eventually I needed to make a change.

When I decided that it was time to take action I didn’t have any single device that could hold all of our short and long term storage needs. I also didn’t have any portable devices that could move this data around without breaking it up into small pieces first. This was becoming quite a problem. I needed to find a solid network storage device that was robust, redundant, easy to implement and relatively affordable.

One of the barriers to working in a smaller shop is always budget. There was a long list of storage devices that we simply couldn’t afford. Since I had already been using two of the original Drobo (Data Robotics) devices I decided to see what higher end options were available. I was initially impressed by the DroboElite. This device offered many of the features that we were looking for in a storage device. It was compatible with our virtual servers as well as offering a great deal of network storage. With the dual NIC (network interface card) configuration I could easily dual purpose the unit. I decided to pull the trigger. Once the new device arrived I quickly took it out of the box and started working with it. I made a few bad assumptions during the initial setup due to my previous experience with the original Drobo devices. The DroboElite is almost nothing like its predecessors. Here are a few key lessons learned:

  • You have to connect the DroboElite directly to your computer using the USB cable for the initial setup.
  • Once you have the desired volumes set up you can then access it via the Drobo Dashboard over the local area network.
  • You cannot format the volumes while locally connected. You have to format the volumes over the network after the initial setup is complete.
  • This device doesn’t work in Linux. Period full stop. I lost a day and half trying to get it to work. You have been warned.
  • The only really good way to set up these larger volumes is to format them in NTFS. EXT3/4 won’t work. You have been warned (again).
  • Only ONE computer on your network can access each volume at one time. This one took me some time to work out.
  • You really should enable a CHAP password on any volume exposed to your local area network. One computer can lock out the volume so that no one else can access it. You might not know which computer that is. You might spend days trying to figure out how to regain access to your data before you finally think to enable a CHAP password. You have been warned (one last time).
Now that we have the ground work laid out let’s take a look at the setup:

All drives are recognized and working!

At this point I have initialized the Drobo, installed all eight hard drives (2 TB, 7200 RPM) and moved it to the local area network (LAN). The primary network interface card (NIC) has been configured with a static IP address and is accessible from all the devices on my network.

Now we need to set up the individual volumes:

Volume Setup Screen

We are sharing this storage device between our regular LAN and a virtual storage network. Before this device arrived I was running virtual machines locally on their physical hosts. This was risky since a hardware failure could potentially take down multiple virtual servers. With the arrival of the new Drobo I will finally be able to run the virtual machines on the storage device. If a physical host goes down I can quickly recover by moving the virtual machine to another physical host and starting it up again. The public facing recovery time shrinks from hours to minutes.

In the example above I have set up an 8 GB NTFS volume. This will be shared on the LAN for storage. The 2 GB volumes will be used on a separate storage network as shared storage for the physical virtual servers. All of the virtual machines will be migrated to the storage network ranked by importance.

Now that the volumes are set up it’s time to start copying data over to the Drobo!

Time to start copying files over!

One of the major differences between the original Drobo and the DroboElite is that only one computer can access a volume at a time. To work around this limitation I mounted the volume on our file server and used the domain permissions to control access.

Setting Up The Storage Network For Virtual Machines

To segment the virtual machine traffic from our normal LAN traffic I set up a second switch to manage the storage network. All of the physical host servers have at least dual NICs. One NIC from each server goes to the storage switch. The storage network runs over iSCSI instead of the standard TCP/IP protocol. This service is disabled by default in the physical host. To enable iSCSI click on Configuration – Storage Adapters.

Enable iSCSI Detection In VMWare

Once iSCSI has been enabled you can scan the network for your iSCSI device.

VMWare Can Now See Your iSCSI Volumes

Click on the Storage link to format the volumes with vmfs3.

All volumes are formatted and ready to go!

Click on the Networking link to set up the network. In the following example we are running one physical network attached to our LAN and a second attached to our storage network.

I am surprised at how many virtual machines can be run over the single gigabit ethernet connection without any apparent loss of speed. I haven’t hit a limit yet where performance is materially impacted. All in all this device is very impressive. You can really push the capabilities of this storage device on a rather tight budget. Kudos to Data Robotics for producing such a robust (and affordable) network storage device! Very impressive!

Texting Rots Your Brain

I recently read a very interesting article in Newsweek magazine. The author, Niall Ferguson, posits that too many people are spending their time texting and not reading. The statistics he cites are fascinating:

According to a survey carried out last year by Nielsen, Americans between the ages of 13 and 17 send and receive an average of 3,339 texts per month. Teenage girls send and receive more than 4,000.

Half of today’s teenagers don’t read books—except when they’re made to. According to the most recent survey by the National Endowment for the Arts, the proportion of Americans between the ages of 18 and 24 who read a book not required at school or at work is now 50.7 percent, the lowest for any adult age group younger than 75, and down from 59 percent 20 years ago.

Back in 2004, when the NEA last looked at younger readers’ habits, it was already the case that fewer than one in three 13-year-olds read for pleasure every day. Especially terrifying to me as a professor is the fact that two thirds of college freshmen read for pleasure for less than an hour per week. A third of seniors don’t read for pleasure at all.

What happens when people stop reading books? Why is this important? Why should we care?

For two reasons. First, we are falling behind more-literate societies. According to the results of the Organization for Economic Cooperation and Development’s most recent Program for International Student Assessment, the gap in reading ability between the 15-year-olds in the Shanghai district of China and those in the United States is now as big as the gap between the U.S. and Serbia or Chile.

But the more important reason is that children who don’t read are cut off from the civilization of their ancestors.

Being an avid reader myself I try to encourage my own children to read (well, the one that can so far) as much as possible. I am addicted to reading personally. I try to read the Kindle edition of my local newspaper every day, Newsweek and Time magazine every week, technical and news websites during the day and as many books as I can fit in any other time. I also spend a significant amount of time monitoring my social network feeds and my extensive Google Reader habit.

The hook that caught my attention was the challenge at the end of this article:

So take a look at your bookshelves. Do you have all—better make that any—of the books on the Columbia University undergraduate core curriculum? It’s not perfect, but it’s as good a list of the canon of Western civilization as I know of. Let’s take the 11 books on the syllabus for the spring 2012 semester: (1) Virgil’s Aeneid; (2) Ovid’s Metamorphoses; (3) Saint Augustine’s Confessions; (4) Dante’s The Divine Comedy; (5) Montaigne’s Essays; (6) Shakespeare’s King Lear; (7) Cervantes’s Don Quixote; (8) Goethe’s Faust; (9) Austen’s Pride and Prejudice; (10) Dostoevsky’s Crime and Punishment; (11) Woolf’s To the Lighthouse.

Order the ones you haven’t got today. (And get War and Peace, Great Expectations, and Moby-Dick while you’re at it.)

After looking at the list I saw several that I had read long ago, a few I tried and put down and a few I hadn’t had the pleasure of exploring. I’ve officially decided to take up the challenge. It may take me years to complete but I’m going to read every book listed above. I was able to download all of these classics to my Kindle in less than 20 minutes and for less than $10. That is a staggering statistic by itself. We have such quick, easy and cheap access to the great works of the Western world and instead we choose to play Angry Birds and send text messages. Man, I feel old just writing that sentence. :)

I’m taking the plunge. Why don’t you join me?

So It’s Been Awhile…

That seems like an awfully long time...

I really haven’t been updating this blog as much as I should. I promise I’ll work on it. I was working with some files on a server at work this week and ran into this rather odd time estimate. I didn’t really want to wait for almost 1500 days so I let it run overnight. :) It reminded me of how long it’s been since I have updated this blog. It’s time to start posting here again. I have several subjects in mind so keep an eye out for some rather diverse posts soon (hopefully)!

Follow

Get every new post delivered to your Inbox.

Join 498 other followers