r/homelab•
Forroden

April 2018, WIYH?

Megapost

#Acceptable top-level responses to this post:

  • What are you currently running? (software and/or hardware.)
  • What are you planning to deploy in the near future? (software and/or hardware.)
  • Why are you running said hardware/software?
  • Any new hardware you want to show.

#Previous WIYH:


#View all previous megaposts here!


Some Canuck wanker.

Posted Apr 18, 2018, 8:53 AM UTC

1561
Team503ESX, 56TB, 20 Cores, 384gb RAM - Plex!•

#TexPlex Media Network

  • 20 Cores, 384gb of RAM, 2TB usable SSD and 56TB usable Platter Storage
  • Serving more than 50 people in the TexPlex community

##Notes

  • Unless otherwise stated, all *nix applications are running in Docker-CE containers

##DFWpESX01 - Dell T710

  • ESX 6.5, VMUG License
  • Dual Xeon hexacore x5670s @2.93 GHz with 288GB ECC RAM
  • 4x1GB onboard NIC
  • 2x1GB PCI NIC

Storage

  • 1x32gb USB key on internal port, running ESX 6.5
  • 4x960GB SSDs in RAID 10 on H700i for Guest hosting
  • 8x4TB in RAID5 on Dell H700 for Media array (28TB usable, 2TB free currently)
  • nothing on h800 - Expansion for next array
  • 1x3TB 7200rpm on T710 onboard SATA controller; scratch disk for NZBget
  • nVidia Quadro NVS1000 with quad mini-DisplayPort out, unused

Production VMs

  • DFWpPLEX01 - Ubuntu LTS 16.04, 8CPU, 8GB, Primary Plex server, all content except adult, plus PlexPy
  • DFWpPLEX02 - Ubuntu LTS 16.04, 2CPU, 2GB, Secondary Plex server, adult content only, plus PlexPy
  • DFWpPROXY01 - Ubuntu LTS 16.04, 1CPU, 1GB, NGINX, Reverse proxy
  • DFWpDC01 - Windows Server 2012R2, 1CPU, 4GB, Primary forest root domain controller, DNS
  • DFWpDC01a - Windows Server 2016, 1CPU, 4GB, Primary tree domain controller, DNS, DHCP
  • DFWpDC05 - Windows Server 2016, 1CPU, 4GB, Primary tree domain controller, Volume Activation Server
  • DFWpGUAC01 - Ubuntu LTS 16.04, 1CPU, 4GB, Guacamole for remote access (NOT docker)
  • DFWpFS01 - Windows Server 2012R2, 2CPU, 4GB, File server that shares 28TB array, NTFS
  • DFWpJUMP01 - Windows 10 Pro N, 2CPU, 32GB, Jump box for Guacamole
  • DFWpSEED01 - Ubuntu LTS 16.04, 2CPU, 8GB, Seed box for primary Plex environment, OpenVPN not containerized, dockers of Radarr, Sonarr, Ombi, Headphones, NZBHydra, and Jackett
  • DFWpNZB01 - Ubuntu LTS 16.04, 1CPU, 1GB, Docker of NZBGet
  • DFWpMB01 - Ubuntu LTS 16.04, 1CPU, 2GB, MusicBrainz (IMDB for music, local mirror for lookups)
  • VMware vCenter Server Appliance - 4CPU, 16GB
  • DFWpBACKUP01 - Windows Server 2012R2, 2CPU, 4GB, Windows Veeam Host
  • DFWpCOLLAB01 - Ubuntu LTS 16.04, 2CPU, 4GB, NextCloud server that allows external access to my Windows file shares with LDAP authentication through a pretty web interface
  • DFWpINFLUXDB01 - Ubuntu LTS 16.04, 2CPU, 8GB, InfluxDB server for Grafana
  • DFWpGRAFANA01 - Ubuntu LTS 16.04, 2CPU, 4GB, Grafana server for dashboard
  • DFWpBOOKSTACK01 - Ubuntu LTS 16.04, 2CPU, 2GB, Bookstack serer for internal wiki
  • DFWpTELEGRAF01 - Ubuntu LTS 16.04, 1CPU, 1GB, Telegraf test client
  • DFWpCA01 - Windows Server 2012R2, 2CPU, 4GB, Subordinate Certificate Authority for tree domain
  • DFWpRCA01 - Windows Server 2012R2, 2CPU, 4GB, Root Certificate Authority for forest root domain

Powered Off

  • None

Build in process

  • None

##DFWpESX02 - Dell T610

  • ESX 6.5 VMUG License
  • Dual Xeon quadcore E5220 @2.27GHz with 96GB RAM
  • 2x1GB onboard NIC, 4x1GB to come eventually, or whatever I scrounge

Storage

  • 1x3TB 7200rpm on T610 onboard SATA controller; scratch disk for Deluge
  • 1x DVD-ROM
  • PERC6i with nothing on it
  • 8x4TB in RAID5 on H700

Production VMs

  • DFWpDC02A - Windows Server 2016, 1CPU, 4GB, Secondary tree domain controller, DNS, DHCP
  • DFWpDC04 - Windows Server 2012R2, 1CPU, 4GB, Secondary tree domain controller, DNS
  • DFWpFS02 - Windows Server 2012R2, 2CPU, 4GB, File server that shares 28TB array, NTFS
  • Dell OpenManage Enterprise - 2CPU, 8GB, *nix Appliance

Powered Off

  • None

Build in process

  • None

######Currently In Process Projects

  • Migrate to EdgeRouterX and WAP and offload GigaPower 802.1x traffic to AT&T residential gateway
  • Update firmware
  • Deploy Bookshelf
  • Deploy Dell OMSE
  • Deploy Grafana
  • Redeploy seedbox into separate machines to determine load issues
  • Build new domain

#####Task List

  • Tidy up SSL code in NGINX confs
  • Reboot proxy server
  • Configure Dell OMSE appliance and hosts
  • Install Telegraf client on all boxes
  • Configure Grafana dashboards
  • Configure Grafana alerting to SMS
  • Upgrade firmware in each host
  • Install H700/i in T610, upgrade firmware, move data array, remove H700
  • Build new domain (no parent-child relationship) - see subsection
  • Decomm parent domain
  • Build need seedboxes - split to individual boxes for better load tracking, update NGINX CONFs
  • Decomm old seedbox

######Recently Completed

  • Deleted PhotonOS box (unused)
  • Deleted WSUS box and Veeam server in anticipation of rebuilds on new domain
  • Deleted old Torrent host
  • Deleted old RDS environment - it never worked properly and domain is being replaced
  • Stand up Nextcloud with LDAP authentication and access via SMB to Windows file shares

######Pending External Change

  • Upgrade firmware on both hosts
  • Configure EdgeRouterX 192.168.20.x - Ready to test
  • Re-IP network - Waiting Router
  • Move DHCP to Windows servers - Waiting Re-IP AND new domain
  • Rebuild DNS architecture - Waiting new domain
  • Deploy Veeam and configure backups of VM images to external disk - Need external disk
  • Build and deploy new NAS with storage-side dedupe

######New Domain

  • Build new domain DCs, one for each host
  • Enable AD volume activation for Server 2016, SQL 2016, Win10, and Office 2016 in new domain
  • Recreate GPOs for not launching Server Manager, forcing all icons in System Tray
  • Create service accounts and permissions to match KeePass list
  • Migrate file servers to new domain
  • Verify all media Ubuntu boxes have correct creds for new domain
  • Update Nextcloud LDAP auth for new domain
  • Deploy WSUS
  • Configure WSUS policies and apply by OU
  • Deploy WDS server with MDT2013 and configure base Win10 image for deployment
  • Slipstream in Dell and HP drivers for in-house hardware in Win10 image
  • Deploy SCOM/SCCM
  • Deploy an MS IPAM server
  • Configure SSO for VMware and the domain
  • Publish OMSA client as RemoteApp in RDS
  • Configure Lets Encrypt certificate with RDS and auto-renew
  • Convert all domain service accounts to Managed Service Accounts
  • Configure DHCP scopes on both DCs
  • Configure DNS to only lookup to PiHoles

######Up Next

  • Investigate patch management for Ubuntu boxes
  • Investigate LDAP auth to AD for Ubuntu boxes
  • Deploy XKPassWD (complex password generator)
  • Build OpenVPN appliance and routing/subnetting as needed
  • Build deployable Ubuntu and Windows templates in VMware
  • Stand up MuxiMux and stand down Organizr (??)
  • Configure pfSense with Squid, Squidguard
  • Configure automated backups of vSphere via Veeam
  • Deploy Mattermost
  • Deploy Ubooquity - Web-based eBook and Comic reader
  • Deploy SubSonic (or alternative)
  • Deploy Cheverto
  • Deploy Minecraft server
  • Deploy Space Engineers server
  • Deploy GoldenEye server
  • Set up monitoring of UPS and electricity usage collection
  • Deploy VMware Update Manager
  • Deploy vRealize Ops and tune vCPU and RAM allocation
  • Deploy vRealize Log Insights
  • Configure Storage Policies in vSphere
  • Deploy Chef/Puppet/Ansible/Foreman
  • Upgrade ESX to u1
  • Write PowerShell for Windows Server deployment
  • NUT server - Turns USB monitored UPSes into network monitored UPSes so WUG/SCOM can alert on power
  • Redeploy all Linux boxes without LVM for performance

#####Stuff I've Already Finished

  • Upgrade OMBI to v3
  • Design new IP schema
  • Disable Wifi on router
  • Server 2016 migration and domain functional level upgrade
  • Stand up replacement 2016 DCs
  • Demote and decomm 2012 DCs
  • Configure WSUS on WSUS01
  • Finish standing up WSUS01, joining to domain
  • Finish installing SQL for Veeam including instance, db, permissions, and AD Activation key
  • Deployed Dell OpenManage Enterprise
  • Create static entries in DNS for all Nix boxes
  • Configure new NZBGet install with new 3TB disk
  • Reconfigure DFWpSEED01: Remove Deluge and Sonarr dockers and their data, remove old 2TB scratch disk
  • Stand up a 2016 DC and install Active Directory Activation for Office and Server 2016
  • Stand up PiHole VM, configure Windows DNS servers to point to it
  • Move all TV to FS01 and all movies to FS02, update paths in Sonarr and Radarr to match
  • Configure Dell OMSA on both boxes
  • Build DFWpTOR01 on DFWpESX01
  • Build DFWpNZB01 on DFWpESX02
  • Install new hotswap bays and 3TB scratch disk in each server to onboard SATA controller
  • Replace RAID batteries for three of three H700
  • Migrate Plex from Windows-based to *nix deployment
  • Move datastore hosting media from Plex Windows server to dedicated file server VM
  • Build RDS farm
  • Build new forest root and tree domains
  • Build MuxiMux servers - Dockered onto Seedboxes
  • Build new MusicBrainz server with Docker
  • Set up new proxy server with Let's Encrypt certs with auto-renewal
  • Stand up Organizr docker
  • Stand down Muximux
  • Troubleshoot why Radarr isn't adding all my movies

#####Things I toss around as a maybe

  • Deploy book server - eBooks and Comics, hosted readers?
  • PXE options for Linux servers? Template a better choice?
  • Ubiquity wifi with mesh APs to reach roof
  • Snort server - IPS setup for *nix
  • McAfee ePO server with SIEM - ePolicy Orchestrator allows you to manage McAfee enterprise deployments. SIEM is a security information and event manager
  • Wordpress server - for blogging I guess
  • Investigate Infinit and the possiblity of linking the community's storage through a shared virtual backbone

#####Tech Projects - Not Server Side

  • SteamOS box because duh and running RetroARCH for retro console emulation through a pretty display
  • Set up Munki box when we get some replacement Apple gear in the house
11
CollateralFortuneMore CPU/RAM/Storage than sense•

Currently trying to build a DAS out of a DVD duplicator tower.

Needless to say, it's been a disaster each step of the way. Currently waiting on a few more parts.

The Seasonic that's industrial velcroed to the back of the case should tell you how this project has been going. More

10
ForrodenOP•

If you aren't doing something that against "best practices" can you even say you're really homelabbing?

6
CollateralFortuneMore CPU/RAM/Storage than sense•

Ha. I thought this was going to be an easy process. It’s absolutely killing me

1
troutbcomplete noob•

I just got a duplicator tower from work too! Should be a fun (read: disaster) project

2
CollateralFortuneMore CPU/RAM/Storage than sense•

I'm hoping by Monday to actually fully assemble it. Some of the stuff that has gone wrong:

  • Not big enough PSU for the number of drives, which while I expected this, I wasn't expecting the PSU to be SOO small. Like 12amps on the 12v rail. Some people mentioned the BestDuplicator cases have 500w+ PSUs. The one I got came with a 300w.
  • when another PSU is in there, you can't load up the bottom bays, hence the velcroed PSU.
  • The first SAS expander I was shipped had an SMT capacitor just floating around in the bag with it (that fell off the card).
  • My third set of drive bays got lost for a few weeks (coming Monday again hopefully)
  • The case doesn't have a way to actually mount anything PCIe. Basically just something like this (and I'd have to drill the holes)
  • Trying to find a spot to actually put the SAS expander. The damned thing is huge and there is no room in there.
1
mwarps•

I'd grab a good quality modular supply and modify a SATA cable from it. EVGA makes short supplies that pack a punch.

1
CollateralFortuneMore CPU/RAM/Storage than sense•

Pretty sure it wouldn't work with this case. The stock PSU is REALLY short already. There's just not a lot of room in it

1
chiisana•

Bought an Asus server from u/Forroden in March:

  • 2U RS926-E7/RS8
  • 4x E5-4640 (will eventually replace with v2's if budget allows)
  • 4x16GB DDR3 ECC

This weekend, going to head down to states side to pick up 3 or 4 more 8TB EasyStore to shuck, and shuck my existing 8TB EasyStore.

Platform side:

  • Most likely MDADM based RAID6
  • Most likely Proxmox (since ESXi cannot RAID)
  • Rancher 1.6 (2.0 if I can figure out automatic storage/volume management for 'custom' aka local node) for Docker/Kubernetes

Software side:

  • [Docker] HomeBridge for HomeKit automation
  • [Docker] HomeAssistant for scriptable automation
  • [VM] Blue Iris for Camera aggregation
  • [Docker] PiHole for DNS level ad blocking
  • [Docker] Plex
  • [Docker] Mosquitto for custom location tracking
  • [Docker] Huginn for custom automation
  • [Docker] Some kind of wiki or note-taking platform for taking notes

After these base stuff that I know I will have, going to try to learn about K8s and see where that takes me, maybe also dabble with bazel and tensorflow if I can find GPUs to stick in this box.

6
ForrodenOP•

Speaking of things that are in my homelab, that isn't anymore.

Hope it works out, and good luck with CBSA... Remember you don't know me and we never met.

6
hawkiee552(Nismo) - Black Mesa North•

+1 for Blue Iris, it's a great software although expensive.

1
Irravian•

Current Setup:

HP 1810-48G

  • Currently just a dumb switch as complicated networking makes my head hurt. Does it's job.

R610

  • 2x X5570

  • 12GB RAM

  • Still waiting for me to have to time to pick back up on my MCSA. Will become a clustered Hyper-V server.

R610

  • 2x 5570

  • 12GB RAM

  • The other clustered Hyper-V host for MCSA.

R410

  • 1x E5630

  • 8GB RAM

  • 4x 146GB 10k

  • Currently unused, will get a small boot drive and become Storage for the clustered Hyper-V.

R610

  • 2x X5650

  • 96GB RAM

  • 146GB 10k boot, 1x 500GB SSD VM Storage, 1x1TB HD Temp space

  • "Production" Hyper-V hosting PFSense, AD, Couch/SickRage/Deluge/Transmission, Plex/PlexPy/Organizr, NextCloud, MediaWiki(s), Grafana, Ombi, GitLab, NGinx reverse proxy, and game servers. Recently moved my "media acquisition" stack over to a docker setup with Portainer, and moved the temp storage to a local drive rather than a NAS one.

R710

  • 2x E5520

  • 2x8TB WD EMAZ, 4x3TB HGST

  • 24GB RAM

  • "Production" NAS running StableBit on Windows Server 2016. This was the replacement for my 24-bay whitebox, which unfortunately was just too loud to keep running. I've started slowly replacing the drives with 8TB WD EasyStore shucks as necessary.

R610

  • 2x x5550

  • 96GB RAM

  • 6x 146GB 10k

  • Being set up with Windows Server 2016 to host VM's with IIS and MySql for a side project I'm working on. Trying to close the deal on 13 Used Crucial 500gb Mx300 for a very nice price. If that works, it'll be 6x SSD in RAID5, otherwise I'll stick with the 10k drives. It's likely to get a processor upgrade as well.

Retired/Unknown

Whitebox

  • 24x 3.5" Bay case of unknown manufacture (craigslist)

  • i3 7100

  • 32GB RAM

  • Random remaining assortment of 3.5" SATA drives. 3x 250GB (one of which is bad but haven't determined which yet), 3x 1TB, 4x3TB

  • My previous NAS box. The power supplies are incredibly loud, and that, in addition to other minor gripes (the power/reset/alarm buttons are tiny and on the back, no IPMI, weird issues with the MB networking and Server 2016) ultimately led to it being migrated/downgraded to my r710. I'm debating leaving it with a FreeNAS install but have no idea what to do with the space or I could gut it and replace the rackspace with something more worthwhile like PDU's.

Planned Tasks:

  • Get WSUS up

  • Finally get time to jump back into my MCSA

  • Learn headless Windows Admin

  • Decide what to do with my 24 bay machine.

  • Spin up a TFS instance for edumacation

  • Properly set up StableBit cloud drive for backup

5
dsmiles•

How is StableBit? I've been planning on building a FreeNAS box to use as my NAS, but after setting up my ADDC I've been considering using something Windows Server based to get more enterprise-like experience.

1
Irravian•

In my opinion, if FreeNAS applies to your usecase (you have all the drives, they're the same size, etc) and your comfortable with the software, then FreeNAS is a much better NAS experience than anything on Windows server. I've always been less than impressed with the plugin and VM architecture on it but that's straight up not what I use my NAS for so I don't consider it a negative.

With that said, I really like StableBit. DrivePool does exactly what it says, the replication works great, and I've had no trouble sharing the pooled drive. Performance could be better, but as you're only really ever using one drive in the pool per file its understandable. StableBit scanner seems to work well, but I haven't had drive issues. CloudDrive has always been my favorite software for what it does.

1
dsmiles•

Well, unfortunately I don't have all the drives. I'm planning on most likely working with 8tb drives (cheap, large, and I'm storing media), and I was hoping to start with 4 drives in RAIDZ2. Unfortunately, I know RAIDZ1 can take a very long time repairing/expanding with larger drives.

Thoughts?

1
Irravian•

That's the exact situation I'm in. FreeNAS won't let you use the capacity of the larger drives until the whole array is using larger drives, which really kills it for me. You can certainly do your usecase well with Stablebit. Keep in mind that StableBit is not "true raid", its redundancy is to literally write your files completely duplicated on 1 or 2 other drives, so it doesn't have the bitrot/error correction that ZFS does with true parity.

1
dario_x•

HW: 1x Intel NUC Canyon Skull with 1.25 TB NVMe SSD and 32 GB RAM running Esxi 6.5 1x HP 1320ez With 250 GB SSD and 2 TB HDD and 12 GB RAM (currently being expanded) running Esxi 6.5 1x TP Link TL-SG108e 1x Cisco ME 3400 Metro Access 1x Fingbox 1x Ubiquiti Unifi AC HD 1x 6 TB USB Storage

VMs: 1x pfsense 2x Ubuntu 16.04 1x WIN Server 2016

SW: -Plex -Influxdb (Docker) -Grafana (Docker) -Home Assistant -Mosquitto -Apache (Docker) -Unifi Controller (Docker) -NTOPNG -Telegraf -NGINX (Docker)

Coming up: -MYSQL (Docker) -Elasticsearch (Docker) -Plex (Docker)

Let me know what's missing ;)

3
Chippawah•

Hell yeah for the NUC!

1
DJChasma•

how do you like the fingbox? I'm considering one since I use the Fing app so much.

1
dario_x•

It's really cool and even not that expensive. In my opinion it's worth it.

2
derekwww.shnosh.co•

New here, just subbed.

Network

  • Edge: Cisco ASA5505 with IPS module
  • Core: Cisco C3750G-24PS
  • Access: Ubiquiti SW-8
  • Wireless: Ubiquiti AC-Pro-Gen2
  • Ubiquiti Cloudkey for UBNT device management

ESXi - Dell T5500

  • ESXi/VCSA 6.5 6.7
  • (2) Xeon X5650
  • 72 GB RAM
  • LSI SAS9211-8I (JBOD)
    • SSD: Samsung EVO 1TB
    • SSD: Samsung EVO 500GB
    • HDD: Seagate Barracuda 750GB 7200 RPM
    • HDD: Seagate Barracuda 250GB 7200 RPM

Storage - Synology DS718+

  • 16 GB RAM
  • (2) HGST Deskstar NAS 4TB 7200 RPM

Media/Misc

VMs

  • Ubuntu/Emby VM with tuner configured for LiveTV and Synology shares for media and DVR storage.
  • Exchange server for my domain.
  • VIRL for labbing.

Future Plans

Going to spin up a reverse proxy server so I can stop the port-dance for hosted HTTPS services, likely move my low-traffic wordpress blog to my host at home so I can drop Godaddy.

3
aliasxneoHobbyist•

Ditch VIRL and put the images on eve-ng. You'll save massive amounts of compute resources and get 100+ nodes without paying a dime.

2
derekwww.shnosh.co•

Thanks, I'll look into it... VIRL is a fkn nightmare to maintain, I've learned to hold my breath for extended periods of time when I go anywhere near it.

1
mwarps•

Current i3-7300 / 8gb/ 2TB running FreeNAS -- Plex, DNS, DHCP, Grafana/Influx/Telegraf in jails

New Hotness (In Progress) Dual e5-2630L, 64GB, 4TB, ESXI -- FreeNAS -- Docker Host -- Grafana -- Ansible -- Minecraft -- IoT gateway -- Plex -- and more

2
Fett2•

I've moved somewhere where I can't have my entire rack, so I'm down to one server and a router. Currently running the following:

4U Whitebox (Rosewill LSV-4500) w/

  • Supermicro x9dri-f motherboard

  • 2x E5-2643 (Really would like to replace these with E5-2680v2's), though I'm barely using the current CPUs as is.

  • 64GB of RAM.

  • Boot/VM storage drive: 2x Sun Flash accelerators F40s in one RAID 0 (I like to life dangerously)

  • Storage/Media/VM Backups: 2x 8TB 12Gb/s SAS drives in a mirror.

This machine is running proxmox with 7 linux containers and 1 Windows Server 2016 VM.

 

OEM Rebadged Dell R210 ii running pfsense.

2
SaltySolomon•

Hi, how much space is left in the rosewill after putting in the Motherboard, I am currently considering getting the X9DR3-LN4F+ and I am looking for a case that fits this monster of a board.

1
Fett2•

It fits my X9dri-f fine, but my motherboard is EATX, yours is a EE-ATX and I don't think that fits in a Rosewill.

1
SaltySolomon•

So, I now got this board on the way, would it fit that case?

X9DRD-7LN4F?

1
Fett2•

According to Supermicro's website that is a E-ATX board, so it should fit fine.

1
EnigmaticNimrod•

Not much has changed since last time.

My Rancher server has been fully fleshed out and I've added a third docker host. Unfortunately, the actual use of these hosts isn't really feasible for me until I get my NAS rebuilt to use for shared storage, so currently my Docker infra is kinda just... sitting there.

My desire to run HA pfSense has been re-ignited by the realization that using a crappy consumer router as the "frontend" to supply the static IPs would not really be the end of the world for me - the only traffic that goes over that link is traffic destined for the Internet, and I certainly don't have gigabit speeds (yet). As such I've been scouring eBay for Intel NICs that don't suck - surprisingly difficult to find. Or perhaps I'm just thinking too much.

Also had the idea of building my NAS and storage backend to support 10G, and have thus been investigating fiber 10G switches with 8-ish ports. Not as prohibitively expensive as I originally thought they were. This may make its way into my homelab after all.

And, of course, since I eventually want to rackmount all of this anyways, I'm going to need a bigger rack - 13U is not going to be nearly enough for all of the stuff I want to throw into it.

2
Dark_Llama_Too much time, not enough RAM•

Hardware R210 Xeon 4 Cores @ 2.4ghz 4GBs ECC Supermicro 1U Core 2 Duo 4GBs Supermicro 1U Core 2 Duo 2GBs

Software MineOS on Supermicro 4GB Windows ontop of Proxmox on R210 Nothing on 2GB SUpermicro but will be OpnSense soon.

What am I planing to deploy? Moar Hardware, when the local data center get rid of there old stuff later this year.

Software - But need more ram first :( Lab DNS, PowerDNS, PowerDNS, Grafana, Wikipedia, PBX, Download Server, Windows XP, Render Server, VyOS, OpenVPN, Snort, Lab Docs, Mail Server, PPPoE Server, IXP Server, Plus some misc Web Servers

EDIT Formating

2
mabti•

Getting serious about building mine, hoping to buy an R710 or similar in the next few weeks. So far I have:

  • AMD E-350 as a NAS
  • ASUS UN45H running Proxmox VE
  • EtherRouter-X not doing a lot, I want to use this for isolating a secure internal lab network and probably route out to a VPN
  • UniFi USG for main internet connection
  • UniFi AC LP WiFi
2
dscuk•

Currently running: ERx, AP-AC-LR, ProCurve dumb switches, 2x G7 Microservers as storage (1: 4x 2Tb HDD, 2: 3x275Gb SSD, both CentOS), 3x HP Elite 8300 i7's with 16Gb RAM running ESXi off a USB drive. VMs: ADx2, PiHole, Web, FTP, eMail, Nagios, Observium, UniFi Controller, WSUS, WDS, PXE, Ansible...

Planning to deploy: Maybe Asterisk, and separate internal Wiki server.

Why: Why not? Mainly to keep my skillz vaguely relevant...

New hardware: Alas no, I do need some more memory though, and a Synology...

1
ITmercinary•

Weighing my options between shiny new quiet hardware, or something like an r720 with a significantly lower WAF.

My pocket book likes the r720, but I really want to build a couple nodes of something mini itx or equivalently tiny.

Shooting to get my vcp under my belt in the near future.

1
6davids•

What shiny quiet hardware are you looking at? I’ve been going down that route and a happy so far.

1
iPhoid•

Wife Aggression Factor?

1
ForrodenOP•

Well it sure ain't Web Application Firewall, which threw me for a loop when I first got here.

Usually means Wife Acceptance Factor.

Luckily, servers are cheap and wives usually aren't, so it makes good financial sense to dump the wife and acquire more servers. /nod

4
ITmercinary•

Wife Acceptance Factor. While not impossibly loud, an r720 is louder and significantly larger than say a xeon-d supermicro.

1
CanuckFire•

An r720 is also much quieter than say, and r610 or other 1u box. According to the tech guide, they are actually fairly close to the desktops for noise. ~25-35dbm.

1
kalsikam•
  1. AMD A6-6400k 16gb ram - 2u case - pfsense - 4port intel nic - probably overkill for firewall

  2. AMD FX-8300E 8core 32gb ram - 2u case - plex with a bunch of external drives for media storage

  3. AMD A6-7400K 32GB RAM - 4u case - nas4free with 8x1tb, not being used that much really

  4. 2x HP Z400 Xeon 6core 12gb ram workstations with xenserver for running VMs

Networking: 2x TP-LINK 8 port smart switches with 3 vlans 1x cable modem from ISP 2x Apple Airport Extreme 6th gen for the Wifis Cat6 for gigabit Ethernet

Todo: -Assemble desk standing racks for rack mount cases listed above -install 48port smart switch instead of 2x TP-LINK -get beer

1
ShamalamadindongUnraid 6.2 - Windows/Linux/Docker•
  1. AMD A6-6400k 16gb ram - 2u case - pfsense - 4port intel nic - probably overkill for firewall

Anything you can do with pfsense to actually use that RAM? I happen to find myself with an abundance of 8GB DDR3 SODIMMs

1
kalsikam•

Not really for home use, not enough traffic, but in a workplace with 100 users it should help.

Might be able to create a ramdisk for web cache (squid) or something, but not sure how useful it is for home use and with super high speed internet being the norm.

My old workplace used pfsense on dual xeons, with 32gb ram, it was definitely utillized since it handled traffic for 300 people and had multiple internet connections (backups) and also had the phones running through it.

I didnt have any other use for the 2x8gb ddr3 ram in this case so just put it on pfsense box lol

1
ShamalamadindongUnraid 6.2 - Windows/Linux/Docker•

I didnt have any other use for the 2x8gb ddr3 ram in this case so just put it on pfsense box lol

I've got 11 of the damn things haha

1
steckums•

I finally got around to a few things I've been wanting to be doing. Converted my Windows 10 Plex/Factorio "server" (AMD FX-8320, 16GB RAM) which was the wife's old PC before I upped her to a Ryzen 5 1600, into a ESXI host. So I've got a VM running pfsense and an ubuntu server running plex. Haven't decided what I'm going to do about Factorio yet.

The pfsense VM is going to take running my VPN away from my Pi 1 Model B. That Pi is also running Pi-Hole (which I am considering moving to a VM as well) and hyperion (which controls the lights behind my TV)

Why? I've been wanting to use pfsense for a while to learn about networking and I also enjoy having the plex server offloaded from my main PC. I also really miss playing around with Linux and moving plex from Windows to Ubuntu has been fun!

1
kabayomi•

Good Day Everyone! I'm just starting in Linux and look forward to setting up a webserver/email server for learning and practical purposes. Someone sent me the link to this sub but after checking out all the different post i seem to be more confused than before. Can anyone outline a cheap effective setup (i'm a student) or is there anywhere to go read up on all the various options available.

Thanks!

1
ForrodenOP•

Have you had a look at the wiki? There are some great resources on there for getting started, and should help you on your way.

The wiki can be found here.

Most of the users here find the buying guide and hardware guide very informative reads.

Sorry if you've already read the wiki, this is a macro. Happy labbing!

1
kabayomi•

I havent yet. Thank you i will definately get started with it

1
[deleted]•

[removed]

0
r_hcaz•

Currently in the process of setting up a proxmox cluster across all my hosts, then running a docker swarm ontop of that.

I run all of my applications inside docker now, but I wanted to experiment with some windows VM's for GPU pass through and some other linux distros without affecting my docker swarm.

1
icebox1701•

Currently running (at my old place, waiting for fiber connection at my new home):

  • Zotac ZBOX CI323 nano as pfSense router (bare metal)
  • Dual E5-2570, 128GB RAM, 2x240GB intel SSD; 8x3TB RaidZ2 zfs pool as proxmox server
  • Mikrotik CSS326-24G-2S+RM switch (10G links for proxmox server and my desktop)
  • UniFi AP Pro

Waiting at my new place are:

  • 2 x Intel NUCs (i5, 16GB RAM, 120GB SSD each)
  • Atom c2550 board, 16GB RAM 6x3TB RAM disks whitebox build
  • My gaming/photo workstation 7700k, 1060TI, 32GB ram, 1TB nvme, 1TB sata, 2x3TB hdd, 10G network card

Software

  • proxmox, pfsense
  • VMs of plex, huginn, jenkins, gerrit, few windows vms, backup server, scripting server, etc.
1
TheBloodEagleXResident Noob•

I can't explain in any logical way "why" I have this but:

Hardware:

A. E5-1680V2 | Asrock x79 Extreme 11 | 64GB | 2x5TB HDD | 4X250 SSD

B. no chip yet | Asrock x79 Extreme 11 | empty RAM | 1x60GB SSD still WIP

C. i7 3770K | Asrock z77 Extreme 11 | 32GB | 3TB HDD | 1x128GB SSD

Software:

A: Windows 10 Pro Workstation edition

B: nothing yet

C: Windows 10 Pro

Network is just a ASUS router. Waiting for funds and more time to figure this all out. Also hoping to move everything to 4U Rosewill server chassis instead of odd mix of old cases.

1
alexthelyon•

Currently setting up a DL380p that I bought a couple weeks ago. Updated firmware, set up ZFS, installed proxmox, and now I'm working on a monitoring solution for the VMs and containers. Leaning towards netdata / collectd feeding data into influx / grafana.

My internet connection is extremely disappointing though because the ip keeps changing and the dyn dns can't keep up. On top of that, the ping is multiple seconds and being on holiday means working remotely is sufficiently tedious that I can't be bothered so it'll have to wait until I get home.

Finally, I set up an OpenVPN server but the client sends two UDP packets for handshaking which the NAT on the router translates to two different ports and the handshake fails. TCP works but looks like pfsense is on the horizon.

1