Two enclosures - raid 10 openZFS
Internal NVMe - L2RC
Internal NVMe - ZIL
More RAM
I am intrigued yet naive to OpenZFS. Are you able to elaborate? I’m a beginner in this area.
Happy to:
It would be better to explain a little about your system first.
It will make things more straightforward since it would be a targeted conversation.
Alan will also chip in I’m sure.
If you want to keep your specifics private you can send me a direct message or an email.
phil_man@mac.com
1 Like
And happy Chinese new year
1 Like
System A
16core Mac Pro 160GB RAM, Big Sur
Internal 32TB Pegasus j4i RAID5
Highpoint SD7201-A with x4 2TB NVME RAID0 framestore
x2 Thunderbay 6 enclosures, each with x6 8TB Iron Wolf, currently SoftRAID6+
System B
28core Mac Pro 160GB RAM, Catalina
Highpoint SD7201-A with x4 2TB NVME RAID0 framestore
Ok
Give me a while to drag up all the system details and build a spreadsheet.
What kind of reliable throughput (write/read) are you currently getting and how are you networking to date?
Off the top of my head…
The 32TB Pegasus is 535MB/s write and 160MB/s read
The Thunderbay RAID 6+ is 512MB write and 1660MB/s read
The NVME raids are about 6600MB/s read and 7600MB/sec write
10GB networking.
The 32TB Pegasus I’d rather not touch right now…thats got a bunch of stuff on it that keeps me workin.
The Thunderbays I have the data elsewhere local and offsite so those could be the experiment.
Ok
Good to know
Gigabit networking?
10Gb networking?
(10GB networking, post edited with this update. Thanks)
And I can donate 1 of the NVME RAIDs to science this right now, as its not booked coming up this week.
Are your machines the new format Mac Pro?
Is networking native or on PCIe cards?
Yes, 2019 Mac Pro 7,1, native networking.
Copy that
Give me a while
To drag all the bits together
Shouldn’t be long
I’m just pouring a large quarantini.
I’m dragging all of the details out of every Mac dot com
Then I’ll drag all the details for the storage
Then I’ll pull the ideas for openZFS
Give me a little while.
The good news is that your gear is all documented and tested.
(Unlike M1 chips)
I’m on my 3rd gin and tonic and watching West Wing so take all the time you need.
2 Likes
It must be that day of the week
Gin for the win!
I’m just reading about the thunder bay drives
Connected via thunderbolt 3 to the macs correct?
1 Like
Correct.
Ok
I’m just waking up on this west coast
Do you have both of thes enclosures connected to one workstation?
Does your network switch support bonding?
Do you have flash drives for both of your thunderbolt enclosures?
1 Like
The 16core has them direct attached. No flash avail in those enclosures.
Bonding capability is unknown.
Ok let me look up the switch
Meantime can you look up compatible flash from OWC (small quantities like 32GB or 64GB) because you can use them as write caches (ZIL for zfs)
I checked to see if Nic teaming is back on apples menu and it is.
I harbor an idea that you should be able to get roughly 750 Megabytes/s read and write to and from your enclosures and 20Gigabits per second to and from each Mac.
Grab the openZFS installer for Big Sur from the openZFS website.
You may want to sell your ram and buy a bigger set.
Like 384 gigabytes or something.
OpenZFS will use all available ram and once data is in Ram it moves faster than nvme .