# 45Drives HomeLab product line **URL:** \ **Category:** Hardware Questions\ **Tags:** storage, stonewire\ **Created:** [September 26, 2024, 4:26am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468 "2024-09-26T04:26:44Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 4:26am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/1 "2024-09-26T04:26:44Z")
Has anyone looked at 45drives new HomeLab line of products as a possible solution for central storage, or more specifically central Stone + Wire Server? I am looking at the HL15 system from 45Drives for a central stone + wire server solution. Wondering how it may stack up against other solutions this community may be using. [https://store.45homelab.com/configure/hl15](https://store.45homelab.com/configure/hl15) ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 4:46am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/2 "2024-09-26T04:46:53Z")
@MagicMtn - why not call 45Drives and tell them what you want to do? It’s not the old days - I’m sure they would be delighted to find out what you intend to do and help you solve the problem. remember, 15 interfaces is good for one user, not particularly good for two or more users, and as the workload becomes increasingly asymmetric, the performance will tail off. also networking… but those chassis are very good value for money. ---
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 5:11am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/3 "2024-09-26T05:11:48Z")
I have an existing relationship with 45Drives. I am simply in the research stage for what a central stone and wire solution may look like, cost etc. Wanted to hear some feedback from this community before reaching out to any vendors to work with. The HomeLab line from 45 Drives is more of a DIY type solution available through their online store front. If you want to work with the sales people you are almost certainly going to be quoted for their main product line at a higher price point. My understanding is the home lab line is only available thought the site…I could be wrong on this. Appears to be a very new product. What hardware are other people using? What vendors are you working with for this type of solution? We have three Mac based flames in our environment. ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 5:19am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/4 "2024-09-26T05:19:19Z")
How about: - How big are your projects? - How many simultaneous projects? - How many simultaneous users? - How long do your clients squat your storage? - How do you do lifecycle management? I would not recommend your suggested device as a shared solution - it will not cope today and will not scale for tomorrow. My $0.02 (But I think 45 Drives make great products, including the houston interface, and all of the training and outreach) ---
**Author:** ![finnjaeger](https://avatars.discourse-cdn.com/v4/letter/f/e99b99/32.png) [@finnjaeger](https://forum.logik.tv/u/finnjaeger)\ **Post date:** [September 26, 2024, 11:17am UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/5 "2024-09-26T11:17:43Z")
my 2c as someone that has just transitioned to central s+w → i setup a 10tb nvme raid as a central framestore 3 months in with heavy projects on mulitple machines and i am looking at 300GB used. its all just 10Gbit as well, way enough but nvme latencies makes flame really happy Thats because we also work completely unmanaged, so only thing in the central framestore is timeline renders and maybe proxys . and then I also switched all timeline caches to dwab exrs which makes everything tiny, its like prores but for exrs. its simple enough to adapt workflows to massively lower the amount of framestore space and networking speed to and from the framestore that will save you massive amounts of money and save you from the headache of having giant archives. Regarding s+w you want to run it in some kind of virtual machine like proxmox its bascially @ALan s kickass setup scaled down to a smaller shop doing commercials performance is great ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 12:31pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/6 "2024-09-26T12:31:01Z")
@finnjaeger - this is a much more tolerant method since NVMe performance and capabilities exceed the maximum network performance and capabilities. talk about what kind of CPU/RAM/network/OS/Hypervisor/VM backs this up and then you’re building a recipe, and that’s a very worthwhile discussion. then @ALan might/could choose to detail his own racing car and the community can start working on plans/dreams/aspirations. It’s a non-trivial exercise with spectacular results. ---
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 6:56pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/7 "2024-09-26T18:56:41Z")
Our three flames each have 15TB of available frame storage and a central server for project related data and archives thats about 120TB 2 - 3 simultaneous users. Not really to sure about the simultaneous projects thing. Clients keep data on our storage for 3 to 6 months (estimated) and then things get archived to LTO tape. As phil mentioned… I would love to hear more about CPU/RAM/network/OS/Hypervisor/VMs etc to see exactly what other people are doing, what exact type of hardware they have purchased etc. At the price point of our current solution. we are spending around $6k on the storage that attaches to our systems. My assumption is that the Central S+W solution maybe around double that costs so thats where the difficulty of getting this type of solution off the ground lies. I will have to explain to people why we ware spending more and what the benefit may be. ---
**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\ **Post date:** [September 26, 2024, 7:11pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/8 "2024-09-26T19:11:46Z")
What is this comprised of? > [@MagicMtn](#): > > Our three flames each have 15TB of available frame storage ---
**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\ **Post date:** [September 26, 2024, 7:20pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/9 "2024-09-26T19:20:10Z")
Remember you need to have a high speed network too. You can get cheap Mellanox 25gig cards off eBay for ~$50, and you can get a cost effective switch from Mikrotik for ~$800 > **[CRS510-8XS-2XQ-IN | MikroTik](https://mikrotik.com/product/crs510_8xs_2xq_in)** > > A versatile 100 Gigabit switch that offers speed, value, and diverse connectivity options. 2x 100 Gigabit QSFP28 ports, 8x 25 Gigabit SFP28 ports, dual hot-swap power supplies. > **[CRS504-4XQ-IN | MikroTik](https://mikrotik.com/product/crs504_4xq_in)** > > Your most affordable, compact, energy-efficient > doorway to the world of 100 Gigabit networking. > This switch is the next step in upgrading existing 10 or 25 Gigabit networks. Multiple powering options, dual hot-swap power supplies. > **[MCX4111A-ACAT MELLANOX CONNECTX-4 LX 25GBE SINGLE-PORT SFP28 PCI-E NETWORK CARD...](https://www.ebay.com/itm/225500943131?_skw=mellanox%2Bconnectx-4%2Blx&itmmeta=01J8QWC75Y0CRZR5XXQTW7E3JT&hash=item3480e7531b:g:RXkAAOSwisFkJyj0&itmprp=enc%3AAQAJAAAA8HoV3kP08IDx%2BKZ9MfhVJKmJ9fzl3lAEv3Kw0n18E2quDIUceAi42ZnBw75IPVakww39kRBJgkTr03OOCO1PLNs40PKAtOkZhSUMkkUlRVexBJc4TeXosn5gzmnBT8FvKDMOJJz7pp%2BuIUZW3rWR%2FNHc0AOWT2KM07hlMp90LK5O3%2FOFpDF%2FPZ0ROgAL12hpMqwf%2BOHyRJdS%2FC75En7i2sFk%2FEZRSvKhgvNtGdmpqaDNl154KRG81phBXUpHxjWfsyZqZ8YK6484fif7qAovcp6YJYSbU6mI6BtQbWdAggeIFe5M0hBoRegdecqHHXMPQg%3D%3D%7Ctkp%3ABFBMhvOw_MVk)** > > HARD DRIVE BACKPLANE. HARD DRIVE TRAYS. Item Condition New Pulls / No box / clamshell not included it's only for photo. POWER SUPPLIES. GRAPHICS CARDS. ANTI-STATIC BAGS. SERVER BOARDS. THERMAL GREASE. ---
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 7:32pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/10 "2024-09-26T19:32:44Z")
(2) 2019 MacPros with OWC Accelsior 4M2 16TB (1) iMac pro with OWC Thunderblade 16TB We have a 10 gig switch with a some available 40gb QSFP+ ports > **[L3 10Gbe Switch with 48 Ports and 40G Uplinks - FS.com](https://www.fs.com/products/69378.html?attribute=69639&id=1808334)** > > FS S5850-48T4Q L3 10 gigabit switch features 48x 10GBASE-T & 4x 40G QSFP+ ports, supporting MLAG for uninterrupted services. The 48-port 10g switch has dual hot-swappable power supplies and smart fans. It is ideal for data center, enterprise... If we utilized this switch would the 10gig ports be sufficient or should I be looking to use the 40gb ports? @ALan Thanks for the input. ---
**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\ **Post date:** [September 26, 2024, 7:42pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/11 "2024-09-26T19:42:19Z")
What is the specific breakdown of the topology of storage. Your post is a summary. I would not risk it with 10gig. Spend the $1200. Also, **everything** I say will be coming from the perspective of a Linux infrastructure and workstation. I have **ZERO** experience with Mac apart from being used as our side internet machines. ---
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 8:59pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/12 "2024-09-26T20:59:42Z")
Not 100% sure what your asking The storage on each system are 4x4tb NVMEs stripped to be a RAID0. On the mac pros they are PCIe connected and on the iMac Thunderblade connects via thunderbolt. Not against looking into switching to linux however the macs have been solid for us and being able to use jump desktop software makes it easy to give access to remote freelancers which is something that is done often. I think the way i pictured it, I could build a central frame store using proxmox and linux VMs that could be accessed by the Macs, or is that not recommended? ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 9:08pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/13 "2024-09-26T21:08:01Z")
@MagicMtn - proxmox is an excellent solution. @Alan turned me on to proxmox nearly 10 years ago. I prefer it to HyperV and could never afford VMWare. (Nowadays nobody can afford VMWare.) 45 Drives appear to be a great partner for you in your current project since they have a full support mechanism for proxmox. It’s free to try, and cheap to support. ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 9:10pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/14 "2024-09-26T21:10:19Z")
@MagicMtn - it also appears that you have the guts of a system anyway - you could repurpose all of your NVMe right now into a shared volume. Tidy up Do your archives Start on Friday night Finish on Sunday Restart production on Monday. ---
**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\ **Post date:** [September 26, 2024, 9:47pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/15 "2024-09-26T21:47:31Z")
Yes, this is the info I was asking. so you have about 48TB is NVMe. I assume this is the m.2 form factor. Enterprise gear really doesn’t have slots for mass amount of M.2, usually just like 2 ports on the motherboard for boot. You could get PCI cards that hold a lot of sticks, but then you have no hot swap, and I don’t really consider that enterprise solid. But it would also be a waste to not use those. 1. I really like Dell servers. They’ve been rock solid for us for years, and I’ve bought almost exclusively off e-Bay without issue. But certainly you could goto a reseller or whatever. 2. If you have a machine room and cooling and noise is not an issue, I’d look at the R7x0 series. (r740,r750,r760), or the R7x15 series (r7415,r7515,r7615). These are 2U units either Intel or AMD. These come in a variety of configurations, and most have 12 bays for 3.5" HDD, though some configuration I think have an additional 4. Even using conservative 16TB spinning drives, after accounting for RAID6 you could easily get 160TB to accomodate your current workload. 20/22TB drives are commodity now. Although SATA will work, SAS is much better. I’d buy 3 to have as cold spares. 3. If noise or heat is a problem, then look at the Dell T6x0 (630,640series. They are servers but in Tower form. They are 5U equivalent, and quiet. We have one from 10 years ago still in daily service without issue. They can be configured for up to 18 3.5" drives. 4. Find a PCI add in card that accomodates the most amount of m.2 sticks, which will likely be 4, and add those internally to use as either ZFS or LVM/XFS/Hardware Raid cache. Depending on configuration, the R series can probably have about 4 open PCI slots, and the T series has I think 6 or 8. Remember you will need 1 for the High Speed network card. You can now have a single server with more storage than you currently have, plus re-using the NVMe M.2 as a cache layer. Depending on what OS you use, you might host your S+W database servers locally. I like to use separate storage and VM hosts (Proxmox). Remember downtime is almost always more expensive than anything else. I’ll post some link below. These are just the first things I found on eBay, and definitely not selected for either price or optimal configuration. > **[DELL EMC POWEREDGE R750 12 BAY +4 REAR FLEX HDD CTO SERVER CHASSIS | eBay](https://www.ebay.com/itm/186663347079?_skw=dell%2Br750&itmmeta=01J8R3JEC9PPFJV76HNHQGPMDH&hash=item2b7600a387:g:-CcAAOSwqC1m00rv&itmprp=enc%3AAQAJAAAA4HoV3kP08IDx%2BKZ9MfhVJKmpyRY7FEh34sbv3ByZGZkGpfqQZKf%2FqZBoxfqCm6VJ%2FV0f%2BfOpO%2FMO6IcPCenMO2FZ2YLxhF3IcgaRBxLxzTvu2vL3V2%2FbEBl8tvKSkBFzoTGBPzX8vWmZyfGlRtkB9AVWil5Cw7sj6S1gf1QjA2Ni9BjwPxgLnZZ5kD3qjwX9bjCwsAnLsqQvV1O2K7yrl8lAtQ23YpdmwD9t1%2FZRgR216%2FFi%2FE6JQjET1%2BC6z4PLfUdZ7RaQUGEqwfZnchk9oRyeHYD%2BzRlGVXKuZTP7UIQ4%7Ctkp%3ABk9SR57myYPGZA)** > > SERIES: DELL EMC POWEREDGE R750 12 LFF + +4 REAR FLEX HDD SAS SATA SSD BAYS. DELL WARRANTY: UNDER DELL WARRANTY BUT UNABLE TO TRANSFER. OUR DELL SERVERS CAN BE CUSTOMIZED TO FIT YOUR NEEDS AND BUDGET. > **[Dell PowerEdge R7515 2U Server+AMD EPYC 7402P CPU+H730P Mini RAID Card | eBay](https://www.ebay.com/itm/135225173363?_skw=dell%2Br7515&itmmeta=01J8R40QWF7RMMT8V18Z9PN01S&hash=item1f7c0c6573:g:dkkAAOSwuIZkP5dV&itmprp=enc%3AAQAJAAAA0HoV3kP08IDx%2BKZ9MfhVJKlWSa%2F3zGZVjfJiWLZHIOs8gfAV4y9OuYSU9EX7X6FVI9P63erOzxuZFq0FP90sFMOBTXsDfwcxaM0BmIr8TT%2BLgwxHfeSXjEy1h6H53IN5%2B3s9Kkp7wPsRjTgtIuHCKyC7JhubjHBaHakc4u5zrgV3zsXbubmAnnqv7sAlruaqItXvTV4W5XFY6ZuiKR5dinX5LZtiUznSWnxVKXVpiWkJtEpYzZqwFhBMLPcmpRJ9Tyt%2BDyNWCPQrEWWhTDryc3A%3D%7Ctkp%3ABk9SR6r-goTGZA)** > > Motherboard PowerEdge R7515 motherboard with 2 x 1Gb on-board LOM (BCM5720)MLK. RAID C3, RAID 1 for 2 HDDs or SSDs (type/speed/capacity matching). > **[Dell PowerEdge T640 18 x 3.5" Chassis 2 x Silver 4110 Processor, RAM, Storage....](https://www.ebay.com/itm/325686766756?_skw=dell%2Bt640&itmmeta=01J8R41G244EWY35GX18JR3CW3&hash=item4bd471aca4:g:sI8AAOSw6LVkPYpx&itmprp=enc%3AAQAJAAAA8HoV3kP08IDx%2BKZ9MfhVJKn3jqpf%2ByfkJtq%2Bf95sYXXt698QUM%2BycHJKvl6SSzSQodRkiEpU%2FeHSv4dYWh%2BgOBww2HE%2FKY1viIev332xFOh4zWRU66n%2F4Mh3r%2FqxnM5%2FExaiGI2%2BXqVVLkaE%2Bvs4JYu%2Fu9GTMLWBDULhsgOT18YZCDymU%2B0wnfrYBXy334P%2BfcQ%2BsxbyJ1lVSsd9lrnQOGY0jITAY20mjhUwRVCwXeL%2FLRi%2Fh85PLDlQ7YuX6ZdaXjcGHnlaxpOyB%2FveKOOGIAuPHJFGd2zF7hxVNRUmgaHI%2FEw%2BvRjZWTBZzmQp46qIEg%3D%3D%7Ctkp%3ABk9SR5SBhoTGZA)** > > Dell PowerEdge T640. 2 x Silver 4110 Processor. 18 x 3.5" Chassis. > **[Toshiba MG09 MG09SCP18TA HDEPYA0SMB51 18TB 7.2K RPM SAS 12Gb/s 4Kn SED 3.5in...](https://serverpartdeals.com/collections/new-hdd-3-5-inch/products/toshiba-mg09-mg09scp18ta-hdepya0smb51-18tb-7-2k-rpm-sas-12gb-s-4kn-sed-3-5-hard-drive)** > > Buy the Toshiba MG09 18TB SAS 3.5" HDD MG09SCP18TA at the lowest price with free & fast shipping. Get volume discounts and excellent customer service. Shop now! > [@MagicMtn](#): > > Not 100% sure what your asking > The storage on each system are 4x4tb NVMEs stripped to be a RAID0. > > On the mac pros they are PCIe connected and on the iMac Thunderblade connects via thunderbolt. > > Not against looking into switching to linux however the macs have been solid for us and being able to use jump desktop software makes it easy to give access to remote freelancers which is something that is done often. > > I think the way i pictured it, I could build a central frame store using proxmox and linux VMs that could be accessed by the Macs, or is that not recommended? ---
**Author:** ![ManChicken](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/manchicken/32/233_2.png) [@ManChicken](https://forum.logik.tv/u/ManChicken)\ **Post date:** [September 26, 2024, 9:56pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/16 "2024-09-26T21:56:21Z")
I have an HL15 at home, with 8x18TB drives running RAIDz2 (ZFS’s version of RAID-6). It’s primarily my home server/dumping grounds, but I did want it to be fast for moving big files around and light home-Flame usage, to replace a small 4-drive SAS array currently directly attached to my main workstation at home (that spends most of its time running Windows but I also dual-boot Linux for occasional Flame stuff at home.) Running 10Gbit copper, I get pretty consistent 1GB/sec transfers. Linking a bunch of material of various flavors (4k XAVC MXF and ProRes) off it, I edited a little personal piece at home and it was well fast enough. I do not yet have the framestore on it, just source material, but will be trying that next at some point to see how it goes. I am considering doing an HL15 at the office to centralize and replace two existing/aging SAS arrays that are individually attached to my Flame workstation and an Avid workstation. I don’t really have any concerns about it speed-wise as a source media server, but might still do a small local SSD/nvme to use as the Flame framestore for faster cache playback when needed, depending on how my further home experiments go. Been pretty happy with the HL15 so far! I just got one of the fully built systems rather than building my own, as I’d just built my home workstation earlier this year and it’s not something I enjoy doing more than once every few years. ---
**Author:** ![cristhiancordoba](https://avatars.discourse-cdn.com/v4/letter/c/9e8a1a/32.png) [@cristhiancordoba](https://forum.logik.tv/u/cristhiancordoba)\ **Post date:** [September 26, 2024, 10:27pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/17 "2024-09-26T22:27:27Z")
In addition to what Alan just wrote which I find quite valuable. Not sure if this is of your interest but… I’ve found that many people dont know about enterprise/server ssds also known as 2.5 SFF SSD’s NVME, which are actually the same flash speed as m.2 factor nvme’s, but with several advantages over just m2 prices… - They are enterprise environment so it means they are way more realiable, way more TBW which is key in these environments. - These enterprise ssds are U.2 which is quite similar to SATA/SAS interface, so it means its cheaper to run, in raid mode. why cheaper? A good nvme raid card typically can hook up to 4 m2 nvme ssds and it costs at least 1K$, a BRAND NEW [raid card for the enterprise ssd](https://www.ebay.com/itm/145310201734) could cost around 100U$ and can handle up to 8 drives, there is also a [16 drives version] ([BROADCOM 05-50077-02 PCI-Express 4.0 x8 PCIe HBA 9500-16i Tri-Mode Storag - US | eBay](https://www.ebay.com/itm/145116855583)) for just less than 300U$ - M.2 NVME drives get QUITE HOT, which means degradation over the time…2.5 nvme ssds are not that hot. Also, temperature can lead to damage = Data loss. - In case of data loss, recoverying from these would be cheaper than m2 nvme thanks to the U.2 - SATA/SAS like interface. Like any other mechanical hdd. So, how many nvme cards do you need to buy to get 16 m2 nvme’s? if you have the money great, but, do you have enough pci slots? a board with several pcie slots costs a lot of money as well… so…yeah, running m2 nvme is quite quite expensive and not that realiable (IMO). They are fast but not many services do m2 nvme data recovery. Just my two cents. ---
**Author:** ![MagicMtn](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/magicmtn/32/5639_2.png) [@MagicMtn](https://forum.logik.tv/u/MagicMtn)\ **Post date:** [September 26, 2024, 10:40pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/18 "2024-09-26T22:40:59Z")
OK, thats interesting. I currently have a dell R730xd running truenas that is used for the 120TB server I described above. Are you suggesting regular mechanical harddrives are be able to read and write fast enough to work for for a central framestore as long as I have the correct network setup? (or is the pci card with 4 NVMEs necessary?) Right now I am running truenas with 12 x 16tb drives Topology is 2x 6 disks raidz2 vdevs for the storage pool. I was always under the impression that this set up wouldn’t be fast enough because ZFS had too much overhead or whatever. I could never really find any solid info on that so I never wanted to risk it. I dident think to add NVMEs as the L2ARC cache to speed things up. The dell system currently just runs on 10gig. I could slap a 40gig card in the dell and connect it to my switch and maybe thats all I need here for a test. The Macs would still be at 10gig but as a test case seems like it could be a good first step. ---
**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\ **Post date:** [September 26, 2024, 10:52pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/19 "2024-09-26T22:52:03Z")
Then you basically have all you need. Yeah, add a 40gigE card in that thing, buy more RAM off eBay, and add NVMe as cache. ZFS without lots of RAM and Cache is very slow. Those 2 things help to make it tolerable. [![](https://i.vimeocdn.com/video/1931315855-2b7764ac3f85b9a353329b998341404ae8bc1df7ec52e735ea795310dc88252e-d?f=webp "You've Been Inform'd Ep15: Thoughts on Networking and Storage") ](https://vimeo.com/1013347936) > [@MagicMtn](#): > > OK, thats interesting. > I currently have a dell R730xd running truenas that is used for the 120TB server I described above. > Are you suggesting regular mechanical harddrives are be able to read and write fast enough to work for for a central framestore as long as I have the correct network setup? (or is the pci card with 4 NVMEs necessary?) > > Right now I am running truenas with 12 x 16tb drives > Topology is 2x 6 disks raidz2 vdevs for the storage pool. > > I was always under the impression that this set up wouldn’t be fast enough because ZFS had too much overhead or whatever. I could never really find any solid info on that so I never wanted to risk it. > I dident think to add NVMEs as the L2ARC cache to speed things up. > > The dell system currently just runs on 10gig. I could slap a 40gig card in the dell and connect it to my switch and maybe thats all I need here for a test. > > The Macs would still be at 10gig but as a test case seems like it could be a good first step. ---
**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\ **Post date:** [September 26, 2024, 10:56pm UTC](https://forum.logik.tv/t/45drives-homelab-product-line/11468/20 "2024-09-26T22:56:29Z")
@MagicMtn - Intel NICs can do onboard processing bypassing CPU bottlenecks. The recipe appears to be shaking itself out. Lots of RAM, Lots of CPU (for PCIe lane management), Intel NICs, (Use Link Aggregation for more bandwidth), A good managed switch, Robert is your mother’s brother… But this is not 800 bucks and the cost of a few drives. Reuse what you can. Use the NVMe as a removable accelerator. You’re most of the way there. [Next page](https://forum.logik.tv/t/45drives-homelab-product-line/11468.md?page=2)