hyperactivedog

u/hyperactivedog


r/HomeNetworking•

I'm about to upgrade my NAS to something overkill. 96GB RAM, nvme SSDs, 2x10 Gbe SFP+ ports, etc.

Which is great. Except for my laptop. Which is increasingly becoming my primary machine.

My laptop has 40Gbps USB4/thunderbolt connectivity while the new NAS has 2x20Gbps USB4.

For a SINGLE device is there anything I ought to look into to effectively use the NAS as a VERY high speed network share. The dream in the short term would be to just use one thunderbolt cable and to get "decent" speeds and latency.

One "eventually" bit - I'd like to get an eGPU dock at some point. I'd consider it extra credit if I can do thunderbolt from the dock to the machine as well. I recognize that's an extr

00

r/datascience•

Are there any suggested tools in python for constructing decision trees? The more the better as there may or may not be an implementation within my company's internal infra.

My current use case is constructing segments using BOOL conditions. I want to have a reasonably large chunk with a relatively high uplift.

The current approach I'm considering: sklearn.tree.DecisionTreeClassifier with various max_features configs, using 1:100 as a random seed and using the top 20 or so outcomes on the test data as a basis for more manual tuning. I might do a variant where the features are reduced by means of using the top X features from varimp in sklearn.ensemble.RandomForestClassifier/ExtraTreesCl

35

r/zfs•

No performance/reliability issues that I'm aware of... with that said, this kind of annoys me and occasionally there's something that the server TRIES to send over.

zdb -s tank

...
cache
nvme0n1                              FAULTED      0     0     0  corrupted data
nvme0n1                              ONLINE       0     0     0

Some context - using Ubuntu. I know enough CLI to be dangerous. I mostly live in Windows.

Is there any easy way to just REMOVE all faulted devices?

411

r/zfs•

I want to do some performance profiling and tweaking. One thing I'm doing is using CrystalDiskMark at RND32K, since most of my reads appear to be 32K. I am not, however, sure of what queue depth my system's reads typically are at.

Is there any way of checking?

32

r/zfs•

I want to know some theoretical motivation for why IOPS would be cut so deeply.

I can see how for a single write, over a 4 device RAIDZ1 array you'd have data written on 3 devices and then parity on another...

For reads though, especially for small files where a single record might fit in a single block on one disk, wouldn't you expect IOPS between 4x 1 drive and 1 drive depending on HOW the data was written (so large files would be more dispersed but a single 4k file might end up on one drive with another copy on another meaning up to 2x IOPS in such a case)?

Do I understand the concepts correctly? Is there a solid power point slide deck somewhere?

I'm curious as I once (usually 0-100

727

r/homelab•

Goal: Get SMB multichannel working. I believe I need to do some routing (not something I've done before) such that A1 <-> B1; A2 <-> B2
Setup: HPE Microserver on Ubuntu 20.04 (192.168.1.20, 192.168.1.21), Windows 10 with 2x Gbe Intel NIC. (192.168.1.40, 192.168.1.41) transferring files to/from the NAS shows windows is splitting the load 50/50 between ethernet ports.

I'm trying to follow along on here: https://www.reddit.com/r/homelab/comments/5p6gy6/my_experience_with_samba_and_smb_multi_channel/

I had something similar to this:

# ip route show
default via 192.168.1.1 dev enp2s0f0
192.168.1.0/24 dev enp2s0f0 proto kernel scope link src 192.1
34

r/zfs•

Are there any decent scripts that can be used to fill ARC/L2ARC? Random files are fine. I periodically reboot my NAS. My performance is generally fine but I have a hard time getting both ARC and L2ARC full without doing things like moving a game from my local drive. Using ZFS on Linux.

I'm aware ZFS 2.0 has persistent L2ARC and I'll use that once it's stable.

Actual problem attempting to solve: reducing underutilized caching with minimal effort on my end with the goal of modest performance improvements.

343

r/HomeServer•

I'm relatively new to DIYing servers - I know enough to get started but not necessarily the names of all the things.

I'm running Ubuntu Server 20.04 and have it set up as a file server using SMB. I initially set up the server using a GUI/CL and have since killed the GUI and am running the server headless in a different room (I don't like harddrive noise).

I would like some additional flexibility to manage my NAS, similar to the web GUI of Synology and QNAP. Beyond that I'll likely be installing a handful of light apps here and there (think pihole class applications in terms of performance requirements)

What should I be looking into installing? OpenSSH? Cockpit? Webmin? VestaCP?

Use ca

313

r/zfs•

Background:
Tech enthusiast who does something VERY different for a living. Smart but not highly competent in this domain (read: better than 99% of randoms on the street, worse than 90% of people doing IT in a role beyond help-desk, previously worked with a bunch of network eng at an F500 but in a different capacity). I have a handful of issues and in some cases I don't know the NAME of the solution I should be asking for. I wanted more performance/flexibility out of my NAS so I built out the following using mostly spare parts:

Hardware:
HPE Proliant Gen 10 (Excavator based Opteron x3421 2M/4T)
32GB non-ECC RAM

27

r/MBA•

https://www.mckinsey.com/careers/mckinsey-achievement-awards/overview

I check the box for first gen, though not for ovaries or anal sex (why is this even a consideration? This is a significantly overrepresented minority).

Currently at a FAANG/Unicorn and overcame a bunch of BS (homelessness, lack of resources, etc.). Are there other programs similar to the McKinsey Achievement awards where I can apply to, do some stuff, maybe grow and develop and then add some prestige to the resume? GMAT was around 780, GRE similar, high GPA for grad, etc. if that matters.

20

r/homelab•

I'm looking to upgrade/migrate my NAS.

To that end I purchased an HPE Proliant MicroServer gen10 on the cheap. 4x excavator+ cores, ECC support and PCIe 3.0 x8 + x1 slots available and I'm able to use 32GB DDR4 (non-ECC) RAM I have lying around. I expect that I'll be running Ubuntu and running ZFS (I'm comfortable with debian-based stuff and use it at work/home). FreeNAS doesn't seem to easily work with my server. I might run a WiFi controller, POSSIBLY Blue Iris and a few small apps but nothing super intensive.

Usecase:
I want speedy and reliable and silent secondary storage for my computer (pictures, videos, maybe steam games) and 1 or 2 security ca

315

r/MBA•

Hello, I'm trying to do early due diligence for exec MBA apps years in advance. Anything that I should be worried about? FWIW, I applied previously for FT programs, got interviews but bombed them (was kind of over it, had recently received the post MBA job I wanted without the MBA, was also burnt out/tired from doing work + interviews + apps and a mountain of personal issues). Will I need to explain being half asleep and not giving a damn about previous interviews at W+S years after the fact?

Background

Work experience: Several F100s. Currently at GoogleBookAzon/Hot-Unicorn, etc. TC is ~350k a year. Multiple promotions. 8+ years WE as of present.                   
00

r/Ubiquiti•

I have two sets of family members on Edgerouter-x + AC Lites + AC Pros. Roughly a half dozen people from two different locations across the US.

0 down time (unless I'm messing with things or there's a lightning strike), great performance. I even managed to get one household to switch to streaming and upgrade their internet in this time and they're considering moving over to VOIP to cut landline costs.

30

r/sysadmin•

TLDR: I want to write some regex for an .htacess file on a nix server; sample code/data provided

I have a non-technical family friend who is in over his head that I sometimes help. I am NOT a sys admin but know enough to be dangerous.

He has a mix of .JPG and .jpg files on his local windows machine that cause issues on some but not all of his linux-based web servers.

I believe this is the most effective path forward:

  1. Set up a 301 redirect to make sure the server is always pulling from SOMETHING (can I get pointed in the right direction or be given code?)
  2. Batch convert images on his local machine from .JPG to .jpg (largely solved problem needing implementation)
  3. Eventually switch
14