We are still actively working on the spam issue.

Difference between revisions of "Home server Original"

From InstallGentoo Wiki
Jump to: navigation, search
(Added hardware, more information on operating systems and RAID. Migrating information from /hsg/)
(Adding more detail to storage through file systems and raid.)
Line 3: Line 3:
  
 
==Hardware==
 
==Hardware==
Depends on your use case. A simple file server can be run on an SBC with a couple hard drives attached. If you want to do more fancy things like virtualisation, streaming 4K movies, etc you are going to want better hardware. If you plan on using ZFS or Btrfs, server grade hardware and ECC ram are recommended but not required.
+
Depends on your use case. A simple file server can be run on an SBC with a couple hard drives attached. If you want to do more fancy things like virtualisation, streaming 4K movies, etc you are going to want better hardware. If you plan on using [[ZFS]] or Btrfs, server grade hardware and ECC ram are recommended but not required.
 +
 
 +
 
  
 
== Operating systems ==
 
== Operating systems ==
 +
OMV is good enough if all you are storing is rarely accessed (pirated) media. Even standard Linux like Ubuntu supports software raid and filesystems like OpenZFS. TrueNAS core (formerly FreeNas) is BSD based and fairly simple to install and use but server grade hardware and ECC memory are recommended.
 
===Linux===
 
===Linux===
 
You should run [[Debian]], RHEL or CentOS if you want [[GNU/Linux]].
 
You should run [[Debian]], RHEL or CentOS if you want [[GNU/Linux]].
Line 35: Line 38:
 
[https://forum.openmediavault.org/index.php?thread/23005-installation-and-setup-videos-beginning-intermediate-and-advanced/ Installation guide].
 
[https://forum.openmediavault.org/index.php?thread/23005-installation-and-setup-videos-beginning-intermediate-and-advanced/ Installation guide].
  
===RaspPi===
+
===Proxmox===
 +
A Linux based Virtualization Environment that has built in ZFS support, Linux container support, and more.
 +
 
 +
Your CPU must support Virtualization in order to run [https://www.proxmox.com/en/Proxmox]. (VT-x on Intel, AMD-V for AMD).
 +
 
 +
ECC Ram is recommended as per usual with [https://pve.proxmox.com/wiki/ZFS_on_Linux ZFS].
 +
 
 +
===Raspberry Pi===
 
If you have a raspberry pi that you want to be put to use, ArkOS is a stable, Arch based distro for running a home server on a raspberry pi with a Web based GUI. [https://arkos.io ArkOS main website]
 
If you have a raspberry pi that you want to be put to use, ArkOS is a stable, Arch based distro for running a home server on a raspberry pi with a Web based GUI. [https://arkos.io ArkOS main website]
  
 +
==File Systems and RAID==
 +
You may want to consider a [[RAID]] array for long-term file storage. RAID is not a backup. Not even RAID 1. RAID doesn't protect against accidental deletion or total failure of an array. We STRONGLY recommend a 3-2-1 backup strategy. 3 Copies, 2 on site, 1 remote. If you cannot afford that, backing up to external drives or the cloud is better than nothing.
 +
 +
Rebuilding a raid array is an intensive process and it's not uncommon for a second disk to fail during the process. Raid 5 and equivalents only offer 1 disk redundancy, so if a disk fails during your rebuild you're fucked. Try to aim for at least two disk redundancy, or do a raid 10 instead.
 +
===Software v Hardware===
 +
Software raid typically has a number of features that are more beneficial than just standard RAID. Best in class at this moment is ZFS which has automatic file self healing and file system level checksums to combat bitrot. Btrfs is also good if you want an alternative to ZFS, but is still in development so be careful. Unraid is more noob friendly (but you pay for it). Snapraid+merger FS is a viable (free) alternative to Unraid if you don't feel like spending money on your OS.
 +
===ZFS===
 +
A long standing, reliable file system and software raid solution that works on BSD and Linux.
 +
 +
Supports up to 3 disk redundancy (RaidZ3) and has checksums and self healing to prevent data corruption.
 +
 +
Has some limitations, one major one being expansion is cumbersome.
  
==Centralized storage==
+
If you plan on using RaidZ make sure you know what your array is going to be beforehand, you won't be able to add to it later.
One option is to set it up with NFS (Linux-centric, can be used on windows but it's shit) or samba, so you can watch your chinese cartoons on any device and keep your documents/whatever synchronized.  
 
  
You may want to consider a [[RAID]] array for long-term file storage. RAID is not backup, but will protect your files in case of drive failureNAS4Free allows you to easily set up RAID arrays using UFS or ZFS. Use Mdadm + LVM, ZFS on Linux (ZoL), or Snapraid + mergerFS for Raid
+
Server hardware and at least 8gb ECC memory recommended. Using old hardware or consumer hardware is not recommended.   
  
 
==Remote access==
 
==Remote access==
Line 50: Line 71:
 
===Wake on LAN===
 
===Wake on LAN===
 
Turn on a PC on your LAN [https://wiki.archlinux.org/index.php/Wake-on-LAN Arch Wiki guide]
 
Turn on a PC on your LAN [https://wiki.archlinux.org/index.php/Wake-on-LAN Arch Wiki guide]
 
 
===Web hosting===
 
===Web hosting===
 
Host webpages, use nginx or apache [https://library.linode.com/web-servers/nginx/installation/debian-6-squeeze debian nginx guide]
 
Host webpages, use nginx or apache [https://library.linode.com/web-servers/nginx/installation/debian-6-squeeze debian nginx guide]

Revision as of 01:44, 20 December 2020

Imbox move.png
Imbox move.png
MOVE CANDIDATE
This page is being proposed to be moved to somewhere else. Relevant discussion may be found on the talk page. Reason: Merge with Setting up a Server

Please note: If you are going to run ANY services that can be accessed from the external internet, beyond the confines of your home, please secure your system per Setting up a Server.

Hardware

Depends on your use case. A simple file server can be run on an SBC with a couple hard drives attached. If you want to do more fancy things like virtualisation, streaming 4K movies, etc you are going to want better hardware. If you plan on using ZFS or Btrfs, server grade hardware and ECC ram are recommended but not required.


Operating systems

OMV is good enough if all you are storing is rarely accessed (pirated) media. Even standard Linux like Ubuntu supports software raid and filesystems like OpenZFS. TrueNAS core (formerly FreeNas) is BSD based and fairly simple to install and use but server grade hardware and ECC memory are recommended.

Linux

You should run Debian, RHEL or CentOS if you want GNU/Linux.

Debian based distros like Ubuntu are easy to work with and have plenty of documentation.

CentOS is a free alternative to RedHat and is also fairly popular.

Ubuntu usually does retarded things with their packages and versions (lib*-ubuntu1.l2), and pulls unstable software from Debian Sid.

Rolling release distros (Arch, Fedora) are not really good for a server, because it's supposed to stay working, and it shouldn't break/change it's behaviour on updates.

Gentoo is usually too much trouble to be worth it, but it's ok.

TrueNAS

You should also consider a NAS-centric operating system for a home server - FreeBSD-based TrueNAS, the successor and replacement for FreeNas. A FreeBSD based OS that utilizes ZFS. Has many available plugins for things like PLEX, bitorrent, and more.

Free software and has simple GUIs to set up your services. Keep in mind it will install to the ENTIRE DRIVE and you won't be able to use the install drive for anything else. Server grade hardware is recommended.

TrueNAS Documentation.

Open Media Vault

Good for storing infrequently changed files like media files.

Website doesn't have much to show for. Check the forums for guides.

Supports Snapraid as a plugin. Can be used with mergerFS to pool drives together. Needed for mergerFS.

Installation guide.

Proxmox

A Linux based Virtualization Environment that has built in ZFS support, Linux container support, and more.

Your CPU must support Virtualization in order to run [1]. (VT-x on Intel, AMD-V for AMD).

ECC Ram is recommended as per usual with ZFS.

Raspberry Pi

If you have a raspberry pi that you want to be put to use, ArkOS is a stable, Arch based distro for running a home server on a raspberry pi with a Web based GUI. ArkOS main website

File Systems and RAID

You may want to consider a RAID array for long-term file storage. RAID is not a backup. Not even RAID 1. RAID doesn't protect against accidental deletion or total failure of an array. We STRONGLY recommend a 3-2-1 backup strategy. 3 Copies, 2 on site, 1 remote. If you cannot afford that, backing up to external drives or the cloud is better than nothing.

Rebuilding a raid array is an intensive process and it's not uncommon for a second disk to fail during the process. Raid 5 and equivalents only offer 1 disk redundancy, so if a disk fails during your rebuild you're fucked. Try to aim for at least two disk redundancy, or do a raid 10 instead.

Software v Hardware

Software raid typically has a number of features that are more beneficial than just standard RAID. Best in class at this moment is ZFS which has automatic file self healing and file system level checksums to combat bitrot. Btrfs is also good if you want an alternative to ZFS, but is still in development so be careful. Unraid is more noob friendly (but you pay for it). Snapraid+merger FS is a viable (free) alternative to Unraid if you don't feel like spending money on your OS.

ZFS

A long standing, reliable file system and software raid solution that works on BSD and Linux.

Supports up to 3 disk redundancy (RaidZ3) and has checksums and self healing to prevent data corruption.

Has some limitations, one major one being expansion is cumbersome.

If you plan on using RaidZ make sure you know what your array is going to be beforehand, you won't be able to add to it later.

Server hardware and at least 8gb ECC memory recommended. Using old hardware or consumer hardware is not recommended.

Remote access

Setting up SSH access enables you to:

Tunneling

Create a tunnel and use it as a proxy for environments that block certain DNS requests or pages and to encrypt your data

Wake on LAN

Turn on a PC on your LAN Arch Wiki guide

Web hosting

Host webpages, use nginx or apache debian nginx guide

Proxy

You can use a proxy guide

Compression

Ziproxy (Opera style web compression, including images)

Media automation

Torrenting

Use a daemon like transmission or deluge

TV Series

You can use a daemon like Sickbeard

Movies

You can use a daemon like Couchpotato

Music

You can use a daemon like Headphones

VoIP

You can use mumble-server (free), ventrilo or teamspeak (non-free)

Setting Up an SSH Server

On Windows

  • Download Cygwin
  • Choose "Install From Internet"
  • Choose a mirror to download from
  • When you get to the "Select Packages" screen, search SSH
  • Choose to install the "Bin" version of the "openssh" package
  • Download all dependencies and wait for setup to complete
  • Open Cygwin and wait for the initial setup to complete
  • Type "ssh-host-config" without the quotes
  • Say yes when you get asked about privilege separation
  • Say yes when asked to create a local user named sshd
  • Say yes when asked to install sshd as a service
  • When you see "CYGWIN=", type "ntsec tty" without the quotes (this guideexplains why)
  • You should be done now setting up the SSH server. To start it, type "net start sshd" without the quotes.

If you see:

The CYGWIN sshd service is starting. 
The CYGWIN sshd service was started successfully.

Then everything went correctly. If not, you should Google the error.

On OS X

Simply go into sharing permissions and enable fucking everything.

GNU or BSD based systems

1. You usually enable the ssh server during the installation. Do this if possible, it is the simplest way.

2. If you did not setup sshd to auto start you can type:

  • /etc/rc.d sshd start, if you use System V init.
  • systemctl enable sshd.service && systemctl start sshd, if you use systemd.

3. If that does not work, you need to install sshd with your package manager.

Post-setup