Jump to content


Photo

File Servers & NAS


  • Please log in to reply
125 replies to this topic

#41 p0is0n

p0is0n

    Champion

  • Atomican
  • 5,461 posts

Posted 09 November 2012 - 04:52 PM

Probably right about different spots on the disk now, it's a lot more full. ZFS is apparently very careful about how it lays out data which may account for the improved performance. I've started filling it quite a bit. I had a few reasons for wanting to switch to 2 smaller vdevs, it should theoretically improve performance a little, but I'm not 100% on this.. it will be easier to increase capacity if I run out, in that I will only have to replace 3 drives instead of 5 to grow. I'm not sure if it is worth the effort though... The other choice which probably offers higher MTTDL would be 6 disk raidz2, same number of data and parity disks, but safer data, slightly lower performance perhaps. Given it's only connected by gigabit anything above 100MB/s should be sufficient I suppose. I also just like to tinker and try new things. Will probably just end up leaving it for now.. if it isn't broke and all.. :)
i7 2600k | Z68A-GD80 | 8GB RAM | CF 7970 | 120GB SSD | 1kW PSU | Butchered Case | Water Cooling | U2713H HP N40L | 16GB RAM | 7x WD 2TB | Ubuntu | ZFS

#42 Devilsmurf

Devilsmurf

    Primarch

  • Atomican
  • 1,937 posts

Posted 09 November 2012 - 05:28 PM

Have you tried network performance testing to see what speeds your network is getting ? Since everything I have is frankenstein, I also popped a router I had into service for the bedroom and all the devices so I wasn't running 4 cat5 cables across the hall. After some head scratching over low network speeds I realised that the the router is only 100Mbs. Dammit ! So another thing to add to my list of needed hardware, since only the Xbox 360 is 100mbs limited.

#43 p0is0n

p0is0n

    Champion

  • Atomican
  • 5,461 posts

Posted 10 November 2012 - 03:42 AM

Have you tried network performance testing to see what speeds your network is getting ?


I only have a simple $30 gigabit switch, but just briefly copying a few dvd image (1.5GB to 3.0GB) files to and from the server I am consistently getting transfer speeds of around 85MB/s to 90MB/s which is about full speed for gigabit or close to it.
I then copied a bunch of smaller files of <1M to ~5MB totalling about 2GB and was getting speeds between 30MB/s and 50MB/s so the smaller files are a bit slower, but it's to be expected, one long file is much easier to handle.

Not sure if there are any utilities I can use to measure this more accurately but I'm happy with the result. In my use over the last 2 months I haven't encountered any real issues with performance, it's been working very well.
i7 2600k | Z68A-GD80 | 8GB RAM | CF 7970 | 120GB SSD | 1kW PSU | Butchered Case | Water Cooling | U2713H HP N40L | 16GB RAM | 7x WD 2TB | Ubuntu | ZFS

#44 Devilsmurf

Devilsmurf

    Primarch

  • Atomican
  • 1,937 posts

Posted 10 November 2012 - 07:22 AM

So as you said, anything over 100mb/s is good for disk transfer speeds. Unless you are moving files around frequently that is.

#45 Opy

Opy

    Primarch

  • Atomican
  • 1,633 posts

Posted 10 November 2012 - 01:27 PM

A mate of mine has a simple 4 disk RAIDed NAS using the same WD drives used in the OP.
10 days after purchase, he discovered 1 drive wasn't working, then discovered a burn mark in the case and then discovered a pretty little brown mark on the drive

Posted Image

The store swapped it out no problems.
I am not saying the model of drive is bad, this could happen to any drive, any component at all really. Just unlucky. Lucky it was RAIDed so nothing lost.

When he installed the replacement drive, he went to work while it was doing the process of rebuilding the array and when he got home it said it was incomplete. It said all 4 drives were offline. His 2 year old daughter had ejected all 4 hard disks while it was rebuilding. haha.

Reality is just an illusion brought on by a lack of alcohol.

WoT quote: "DishD (5:45:44 PM) ur a bad man Opy, funny as fuk but very Bad!"

QUOTE (Mac Dude @ May 15 2014, 06:47 PM) * I'm in. I'm so serious about this that I've already had 2 practice losses!


#46 p0is0n

p0is0n

    Champion

  • Atomican
  • 5,461 posts

Posted 10 November 2012 - 02:59 PM

A mate of mine has a simple 4 disk RAIDed NAS using the same WD drives used in the OP.
10 days after purchase, he discovered 1 drive wasn't working, then discovered a burn mark in the case and then discovered a pretty little brown mark on the drive

The store swapped it out no problems.
I am not saying the model of drive is bad, this could happen to any drive, any component at all really. Just unlucky. Lucky it was RAIDed so nothing lost.

When he installed the replacement drive, he went to work while it was doing the process of rebuilding the array and when he got home it said it was incomplete. It said all 4 drives were offline. His 2 year old daughter had ejected all 4 hard disks while it was rebuilding. haha.


Ouch.. hope it completed the rebuild when he put them back in.. :( I'm glad the N40L has a lock on the drive bays not that there are ever kids in my house.
i7 2600k | Z68A-GD80 | 8GB RAM | CF 7970 | 120GB SSD | 1kW PSU | Butchered Case | Water Cooling | U2713H HP N40L | 16GB RAM | 7x WD 2TB | Ubuntu | ZFS

#47 Devilsmurf

Devilsmurf

    Primarch

  • Atomican
  • 1,937 posts

Posted 10 November 2012 - 06:23 PM

Poor bastard. I've been fruitlessly doing battle with a Seagate 7200.2 Barracuda. The infamouse BSY bug. Fuck. My. Life. I've had enough. I'm listing it and it's brother drive (which I tried to do a PCB swap, and I've since lost the screws). I'm off to Trademart now, they've pissed me off no end.

#48 Dasa

Dasa

    Guru

  • Super Hero
  • 14,924 posts

Posted 20 November 2012 - 11:31 PM

so can non hp file servers pop in? just purchased a celeron g550 samsung 830 64g wd gree 3tb stuck them in with some spare parts p67-ud4 2x2g 1600mhz 8-8-8 1.35v in a rusty old p2 case have two 2tb samsungs that i will probably set in raid1 for more important data and currently my seasonic x1000w which is about to go back for rma due to it buzzing not starting most the time without flicking its power switch like a mad man while my main rig is running on a corsair tx750 v2 which is a rma replacement for a v1 using gtx480 to set it up but will pull it when done with the gtx480 it idles at 75w without any gpu\igp it idles ~45w before i do any tweaking but thats only with the ssd without the 1kw psu power use id guess the pc is using ~30w be nice if they made good quality 150w psu with 80+ gold or platinum but since they dont maybe i can settle for a 300w gold i was hoping to give linux another go for the first time in ~10 years but i want to run a automation program made for xp that wont work on our vista pc due to it blocking the com port somehow and im not sure if it will work reliably if at all but i guess its worth a go any suggestions for what type of linux i should try? thanks

Silverstone TJ08-EW 6700k@4.7 1.375v - Z170-GENE - 2x8g 3866 16-16-16 - 1070@ 2100\9600MHz  -Samsung 830 64G, Sandisk Ultra II 960G, WD Green 3tb - Seasonic XP1050 - Dell U2713 - Pioneer Todoroki 5.1 Apogee Drive II - EK VGA-HF Supreme  - Phobia 200mm Rad - Silverstone AP181 Project Darkling
3770k vs 6700k RAM Scaling, HT vs RAM, Arma III CPU vs RAM, Thief CPU vs RAM
Parts Guide


#49 mudg3

mudg3

    Guru

  • Atomican
  • 9,053 posts
  • Location:Brisbane QLD

Posted 21 November 2012 - 10:07 AM

Give ubuntu a go Dasa. Anything file server and Nas related can be posted in here. I'm still wanting to do a write up of my 22tb NAS but i'm not finding myself with that kind of time right now.
3930K ||Corsair H110 || ASUS Rampage IV ||16GB Corsair Vengence DDR3@1877mhz||ATI 7970||250gb Samsung 840||2x4tb||DELL2711||Corsair 650D|| ASUS Essence STX ||Audio Engine A2's||Aiaiai:TMA-1||Enermax 1050w|| Atomics resident filth

#50 Dasa

Dasa

    Guru

  • Super Hero
  • 14,924 posts

Posted 23 November 2012 - 10:21 AM

decided to order fsp aurum 400w $88 deliverd from skycomp as it looks to have very good low load efficency and seasonic 300w gold tfx are not avalible in au
http://translate.goo.....hreadid=31516

edit took quick snap in its current stage of development which is just testing really
Posted Image

Edited by Dasa, 23 November 2012 - 05:40 PM.

Silverstone TJ08-EW 6700k@4.7 1.375v - Z170-GENE - 2x8g 3866 16-16-16 - 1070@ 2100\9600MHz  -Samsung 830 64G, Sandisk Ultra II 960G, WD Green 3tb - Seasonic XP1050 - Dell U2713 - Pioneer Todoroki 5.1 Apogee Drive II - EK VGA-HF Supreme  - Phobia 200mm Rad - Silverstone AP181 Project Darkling
3770k vs 6700k RAM Scaling, HT vs RAM, Arma III CPU vs RAM, Thief CPU vs RAM
Parts Guide


#51 Mac Dude

Mac Dude

    Immortal

  • Super Hero
  • 36,561 posts
  • Location:Melbourne

Posted 23 November 2012 - 05:32 PM

I'll run and hide after this post, but I trashed my ubuntu server and installed Windows Server 2012 Essentials...
Karl Kruszelnicki - No, I’m fully prepared to believe in the “Church of God the Utterly Indifferent who sets the universe going and says you’re on your own kids.

#52 Devilsmurf

Devilsmurf

    Primarch

  • Atomican
  • 1,937 posts

Posted 23 November 2012 - 09:25 PM

Any particular reason why Mac Dude ? DASA, install WINE and see if that automation program plays nice with it.

#53 Mac Dude

Mac Dude

    Immortal

  • Super Hero
  • 36,561 posts
  • Location:Melbourne

Posted 24 November 2012 - 11:02 AM

Any particular reason why Mac Dude ?

DASA, install WINE and see if that automation program plays nice with it.


It's horses for courses :)

I played around with it for a month and took a bit of dicking around with samba, users & permissions to get it working. What I often found was that a 'simple' solution was never that simple - install package X to get functionality Y, but you find out along the way that X requires Z which requires....

You get the idea.

Also when things don't work I find it very easy to get around windows error messages and logfiles.

I think in the long term ubuntu would be ultimately more configurable, but as a media server and centralised backup system, I want it to be as hands off as possible.

Also given that the majority of client devices are Windows PCs, the integration is better with a Windows server.
Karl Kruszelnicki - No, I’m fully prepared to believe in the “Church of God the Utterly Indifferent who sets the universe going and says you’re on your own kids.

#54 Devilsmurf

Devilsmurf

    Primarch

  • Atomican
  • 1,937 posts

Posted 24 November 2012 - 12:17 PM

Yeah I can definetely see that. As you say, when it's easier for you to fix Windows you stick with Windows. When you find Linux easier to fix you stick with Linux.

#55 mudg3

mudg3

    Guru

  • Atomican
  • 9,053 posts
  • Location:Brisbane QLD

Posted 24 November 2012 - 01:09 PM

The point is at least you gave it a go. You may find that you go back :)
3930K ||Corsair H110 || ASUS Rampage IV ||16GB Corsair Vengence DDR3@1877mhz||ATI 7970||250gb Samsung 840||2x4tb||DELL2711||Corsair 650D|| ASUS Essence STX ||Audio Engine A2's||Aiaiai:TMA-1||Enermax 1050w|| Atomics resident filth

#56 The Tick

The Tick

    Hero

  • Super Hero
  • 11,710 posts

Posted 24 November 2012 - 02:35 PM

This has been such an informative read.

I have the previous gen Microserver and have been meaning to move over to it for a while.

Many moons ago, I posted in the Apple section building a NAS with time machine support. That project didn't exactly die but rather, went through some bursts of evolution.

Based on this thread, I decided to rebuild with ZFS.

I went with CentOS a while back, mainly because I was more used to RedHat and have stuck with it which is where the massive amount of scripts I wrote got moved to.

I went down the path of adding the REPO and installing zfs-fuse but it was slow and horrible. Thanks to your posts earlier, I had a way of checking and comparing. Looking at what you did, I realised I created the pool without the ashift=12 option. When I detroyed the pool and tried to create it with that option, I was getting an error stating that the option wasn't available.

I found a how to regarding building it from source and just finished that. The speed difference is astounding.

time dd if=/dev/zero of=/vol1/ddtest bs=1024000 count=20000
20000+0 records in
20000+0 records out
20480000000 bytes (20 GB) copied, 133.345 s, 154 MB/s

real	2m13.350s
user	0m0.111s
sys	0m33.435s

----------------------------
time dd if=/vol1/ddtest of=/dev/null bs=1024000
20000+0 records in
20000+0 records out
20480000000 bytes (20 GB) copied, 57.3812 s, 357 MB/s

real	0m57.384s
user	0m0.065s
sys	0m22.765s

Rsync transfers have lifted too. Writes were typically around the 20MB/s mark - now up around 60MB/s

My hat off to you sir - you have provided me a massive leg up with this.

Edited by The Tick, 25 November 2012 - 10:40 PM.

Disclaimer: this post may have been made via a mobile device. All formatting, grammar and the possible hilarious substitution of key words should be attributed to the autocorrect features of the mobile device and likely has nothing to do with the idiot driving it.

 

te0p:"Your a Unreal."


#57 ian_hard

ian_hard

    Apprentice

  • Quark
  • 97 posts

Posted 25 November 2012 - 12:18 AM

i have been saving up to build a file server. in a norco 4u 20 or 24bay rack case. as i already have a rack and a couple of dell servers. i was going to use freenas 8 but have decided to use ubuntu and set everything up i need and strip everything i dont. im also going to build a low power draw server for a router. so when i start this build i will post it up on here
Intel i7 920 @ 4.0ghz | Custom Water Cooling | Giga-Byte GA-X58A-UD3R | PowerColor PCS+ 5870 | 3 x 2 GB G-Skills Ripjaws F3-12800CL8T | 2 x 2TB HDD, 2 x 1TB HDD | ThermalTake Q-Fan 850 | ThermalTake Armor+ | Lite-on iHAS120 | Logitech G15 & G9 | ACER G24

#58 The Tick

The Tick

    Hero

  • Super Hero
  • 11,710 posts

Posted 26 November 2012 - 10:26 AM

For any peeps using ZFS - how do you currently handle email alerts based on fault conditions? Linux RAID is a one liner that works pretty well. There doesn't seem to be the same thing with ZFS.

Disclaimer: this post may have been made via a mobile device. All formatting, grammar and the possible hilarious substitution of key words should be attributed to the autocorrect features of the mobile device and likely has nothing to do with the idiot driving it.

 

te0p:"Your a Unreal."


#59 p0is0n

p0is0n

    Champion

  • Atomican
  • 5,461 posts

Posted 27 November 2012 - 01:44 PM

Good to see some activity in this thread :)

Tick, I noticed in the post above you mentioned ZFS Fuse, is this what you installed, or did you go with ZFS-on-Linux? They are 2 separate implementations and so far I have heard that ZFS fuse is somewhat inferior to the native ZFS on Linux. Just curious which one you're using.

I admit I didn't bother setting up email alerts yet... but I have this saved for when I get around to it.

#!/usr/local/bin/bash
zfsstat=`zpool status -x | awk '{print $4}'`

if [ $zfsstat != 'healthy' ]; then
/bin/date > /tmp/zfs.stat
echo >> /tmp/zfs.stat
/bin/hostname >> /tmp/zfs.stat
echo >> /tmp/zfs.stat
/sbin/zpool status -x >> /tmp/zfs.stat
cat /tmp/zfs.stat | /bin/mail -s "Disk failure in server : `hostname`" user@email.com
fi

just need to make it executable (chmod +x <name>.sh) and set it as a cron job to run as often as you want.
here is a link to the site I ninja'd this useful script from, full credit to the original author.

Edited by p0is0n, 27 November 2012 - 01:49 PM.

i7 2600k | Z68A-GD80 | 8GB RAM | CF 7970 | 120GB SSD | 1kW PSU | Butchered Case | Water Cooling | U2713H HP N40L | 16GB RAM | 7x WD 2TB | Ubuntu | ZFS

#60 The Tick

The Tick

    Hero

  • Super Hero
  • 11,710 posts

Posted 27 November 2012 - 07:58 PM

Ended up with ZFS on linux. Thanks for posting the script.

Disclaimer: this post may have been made via a mobile device. All formatting, grammar and the possible hilarious substitution of key words should be attributed to the autocorrect features of the mobile device and likely has nothing to do with the idiot driving it.

 

te0p:"Your a Unreal."





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users