Month: September 2022

The Cost of 10G Networking

Follow up on my previous 10G network install https://adam-s.ca/wp-admin/post.php?post=543&action=edit.

I included a cost breakdown of my 10G networking journey with the total cost being ~$660. There are certain costs that aren’t fully accurate as the Dell server was total 300$ not just the NIC but I included it for full transparency.

Item Cost
Server Dell R530 with 10G 2 port NIC$300
Intel Fiber SFP+ Module$24.99
Mikrotik Fiber SFP+ Module$20.99
Fiber Optic Cable 10M LC to LC$20.99
Mikrotik RJ45 SFP+ Module$69.99
Mikrotik 10G Switch CSS326-24G-2S+RM$145.01
Intel X520 10G SFP+ NIC$79.01
TOTAL$660.98

If I had to go back and change I found that the RJ45 SFP+ modules run hot and would swap it with a full DAC cable but I went with it because that is what I could do with the NIC I had in the server. Additionally I could have gone cheaper on the connection to my workstation but I felt it would be cool to do a fiber optic run with LC cables. I did pay a premium for this but now I can flex and say that my network connection is as fast as light ;).

10G Home Networking

I have recently updated my home network backbone to 10G but my ISP hasn’t gotten the message and still offers only max 300Mbps -_-.

With the recent acquisition of my new Dell R530 server and it’s accompanying 10G nic I decided it was time to upgrade my homelab backbone to 10G. The process was relatively painless and not too expensive. I purchased Intel 10G nics for the remaining computers and a Mikrotik CSS326-24G-2S+ switch to handle the 10G traffic. On top of this (and mainly for the bragging rights) I used fibre optics to connect my main workstation computer but user cat 6 RJ45 for the server.

When stress testing with Iperf3 I was able to achieve 7.41Gbps throughput but finding some stuttering. After investigating I am having some overheating concerns so I will be Jerry-rigging a fan for better cooling.

That being said I am still getting good real work performance with stable 571MBps file uploads and downloads from my NAS but I am seeing some PCIe Gen 3 limitations with my nvme drives that I will try to address on my next upgrade.

Overall this was a very successful upgrade so far and though there are still some open items and lessons learned it has drastically improved usability of the network and system backups no longer bring my network to a halt. Now if only my ISP would get the message and start offering fibre in my area.

Clear Ice at Home

I have never liked adding dirty/cloudy ice to a great cocktail but the cost of clear ice has always been a bit prohibitive for me. One method of making clear ice at home is to use a cooler. Filling a cooler ~75% with water and then putting it uncovered in a freezer for ~14 hours creates a crystal clear layer of ice while the dissolved gasses remain in the water layer below. The 1-2 inch sheet of clear ice can then be removed and cut down to size.

Outdoor Camping Shower and Water Tower

A neat project we have finished up is a custom water tower/shower for camping. A simple design using an IBC tote which are exceedingly ubiquitous perched ontop of a ~2m tower. It heats up fairly well from the sunlight but intention is to paint it black to help. The base doubles as a shower pulling directly from the water above and there is a distribution block that goes into a utility sink and to the camper.

Water pressure is not great but more than sufficient for outdoor needs. To refill the tank we have a 2nd IBC tote that we drive to a nearby steam fill up with a sump pump and then transfer into the raised IBC tote. It has been a very successful project that has provided a stable water supply to our campground.

Char Grilled Steak

In my opinion there is nothing quite as primal as eating a bone in steak and nothing tops that quite like a nice char grill finish.

Home Dried Peppers

Now that peppers are in season I have an abundance of hot peppers that are more that I can eat or give out. The solution is obviously to preserve them.

A new method I am trialling this year is to dehydrate them in my food dehydrator. I used a combination of peppers namely Chili, Birds Eye & Carolina Reapers and dehydrated them over 48hrs at 125F.

The end product was very successful but a partially expected consequence was that upon initial startup I effectively tear gassed the house as by heating the peppers at 125F I released some of their capsaicin oil. This is a bit of an exaggeration as it was completely bearable but there was a noticeable “spiciness” in the air. For next year I will attempt sun drying them or dehydrating in my sunroom.

Custom Fan Curve For Dell Servers (R530)

I was very happy to get my Dell R530 for what was effectively a steal up until I heard it turn on. For those that have never heard any server turn on, it is close to an airplane turbine spinning up (I am not kidding, my server fans can reach 15K RPM).

Now of course it promptly idled down but the problem I had is that it was idling at around 20% (3000RPM) which produced a noticeable hum that could be heard 2 floors up. There are some extenuating circumstances as I had added a few PCIe devices that cause Dell to compensate but that is aside from this.

A background note on fan curves and how computers stay cool. Dell servers have a fan curve which dictates the PWM output % for the system fans based on the air temperature. The problem is that these servers are designed to run with cold refrigerated incoming air in datacenters and in my condition 20c ambient translates to 20% fan speed and it is hard for me to go lower.

In a weird twist of worlds the consumer space already had a solution for this: the custom fan curve. In the consumer space, end users are able to adjust the original fan curve to what is best for their use case instead of being forced into the OEM curve.

To do something like this on a dell server is a bit more difficult though. I had to borrow from a github project where the host machine measures cpu temp and then issues IPMI commands to manually set a speed. Through this we can make a makeshift fan curve and I have shown mine below. This curve is a more user-centric where under idle conditions (<40c) fan speeds are relatively low and only ramp up when needed. This provides a good balance of thermal performance under load and loudness at idle.

Now the server is not bothering anyone at idle and I don’t have to worry about over temperature while under significant load.