Welcome to our community

Be a part of something great, join today!

  • Hey all, just changed over the backend after 15 years I figured time to give it a bit of an update, its probably gonna be a bit weird for most of you and i am sure there is a few bugs to work out but it should kinda work the same as before... hopefully :)

Supermicro X9DAi Weirdness

Luke Boyce

Well-known member
Joined
Apr 17, 2007
Messages
205
Reaction score
0
Points
0
Age
44
Website
virb.com
So the past several days have been frustrating for me. I switched to a PC build from working on Mac Pro's. Went with the Supermicro X9DAi as recommended multiple places. Unfortunately, it has not been a good experience and I want to see if anybody has any thoughts. First time we built the PC we through 128 gigs of Kingston 1600 RAM in there (as recommended by Jeff Kilgore) in all 16 slots, 8gb each. Computer would turn on but wouldn't boot into the BIOS. After many attempts we eventually narrowed it down by placing each RAM in one at a time in various slots. We finally figured out that any RAM placed in the top 2 slots of the bottom 4 DIMMS on the right CPU the computer wouldn't boot. Everytime we took them out, no problem. We tried multiple configurations with different sticks, both in and out. Same exact results, so we knew it wasn't our RAM. So we assumed that those slots were faulty and I returned the board and received the new one today. After rebuild: exact same problem on the exact same DIMM slots with a totally new board. What. The. Crap?!

Anybody care to enlighten me here? What am I doing wrong?

At the moment I'm running everything with those slots empty at 112gb of RAM (I know, poor me) and there's a few other strange things going on, but nothing too much. The main weirdness is that I have Windows running off of a brand new Kingston 240gb SSD. After installing Windows and updating everything, the computer is telling me that I have 220gb full on the SSD. All I have is Windows on it. What is going on there!? Things seem to be running okay outside of that, except for randomness here and there which I attribute to PC world.

But if anybody has any ideas regarding this, I'd love to hear 'em.

Thanks
 
Luke, the reason your drive is full is because you installed the OS with all the RAM loaded, and Windows made a huge page file. I don't have my windows running, but right click my computer, and under advanced settings, just remove your page file (option for that). You'll need a reboot. If the page file is still there, just delete it. I forgot the exact detailed method, but that should do the trick.

BTW, I've used that board with 128GB and it works with all the slots. There is a list on supermicro for that model board telling you which memory part numbers are compatible. If it's not on that list, it may or may not work.

These are known to be certified 8GB modules:

MT36JSF1G72PZ-1G6M1
M393B1K70DH0-CK0
 
Er... Did I recommend any Kingston RAM for this motherboard?

What specs are the RAM?

Do any/all modules fail, or the system fail, to post when installed in those specific DIMM slots? If so, that seems like a bad motherboard and I wouldn't waste my time trying to make it work by just not installing memory modules in slots that cause problems.

Installing Windows with all the RAM in place should have no bearing on page file size or disk consumption on a properly operational system. There's definitely something amiss here and based on the little bit of info posted so far, it seems like a defective motherboard and/or defective or incompatible RAM.

In my X9DAi system, I'm running Micron RAM. I have not tried any other RAM in this board, I know that Joseph used Samsung RAM in his. There was a lot of back and forth for a bit here in the forums because the RAM was (and still is) hard to come by at times. Last I recall talking about Kingston modules as a possibility was that they seem to align with what HP may be using in the Z620 / Z820 workstations. While kingston makes modules that have the proper specs on paper, SuperMicro has not added any Kingston modules to their tested memory module list.
 
Last edited:
Yep, the pagefile thing fixed it perfectly. Thank you so much for that. Everything seems to be running wonderfully now. I've got the RAM in all of the slots except for the 2 and everything works, so I may just be going with the 112gb for now.

Jeff, yes you did mention that you were very sure that the RAM in your Z820 was the Kingston. The specs matched up and the price was right so I went for it. I had a gut feeling that it could very well be the issue, but can't test it unless I threw approved RAM in those slots. And yes, the system fails to post anytime ANY RAM is in those slots, no matter what. I suppose if I encounter any problems along the way that seem like they could be related, I may have to move to the approved RAM, but as of now the system is actually running quite well. RED footage plays beautifully at 4k and everything is FAST.

Thanks for the help!!
 
The pagefile is usually twice the amount of RAM. Happens on all installs. Even in linux the swap file is twice the amount of ram (normally).

Yeah, I suppose it does do that initially. I guess I haven't run a small enough SSD for the OS in relation to the amount of RAM to encounter problems. Once loaded, I go through and tweak everything anyway...


Luke, as for the RAM issue in the non-working slots. This most certainly should not be happening. It could be due to a RAM incompatibility, but also highly likely that it is indeed a defective motherboard. I know it's not the easiest thing to diagnose without sourcing more components to test with. I would contact SuperMicro about it and see if they can assist. But it's definitely something I think you should diagnose in case the motherboard is in fact a dud. It may start with a couple DIMM sockets not working properly, could lead to memory corruption and therefore data corruption on disks or other problems down the road if there are electrical problems.

You are running 1600MHz RAM at 1.5V, correct? If you're running 1.35V modules, you will have a mis-match.
 
Luke,
Here are your RAM options on this X9DAi (Intel C602 chipset) with the RAM modules you've purchased:


16x 8GB 1600MHz Dual-Rank(x8) NON-ECC UDIMM modules, 1.5V
16x 8GB 1600MHz Dual-Rank(x8) ECC UDIMM modules, 1.5V


16x 8GB 1600MHz Dual-Rank(x8) RDIMM modules, 1.5V
16x 8GB 1600MHz Single-Rank(x4) RDIMM modules, 1.5V
16x 8GB 1600MHz Dual-Rank(x4) RDIMM modules, 1.5V


Other Important Notes and Restrictions:
• All RAM modules should be of the same type, same speed and same frequency.
Mixing of RDIMMs (registered), UDIMMs (unbuffered) or LRDIMMs is not allowed.

• Do not install both ECC and Non-ECC memory modules on the same motherboard.

• Using DDR3 DIMMs with different operating frequencies is not allowed. All channels
in a system will run at the lowest common frequency.

• Make sure the Memory Mode in the BIOS is set to Independent, which makes all RAM available to the OS.

Since you've already replaced your Motherboard, and experienced the same exact problem, we can probably rule-out the motherboard as the cause.
And you've stated that you've tested all modules separately, so we can also rule-out defective RAM sticks.
I highly suggest you check the model # on each of the RAM modules, and check they are all exactly the same. Sometimes they differ by a single character, which makes all the difference.
As a past server builder, I can tell you I've had my fare share of RAM mismatches, and only by inspecting them by model #, I could assure proper compatibility.

Good luck with your new PC system, I'm sure it's super-fast and rewarding (once everything works as expected).
 
Last edited:
PC's are so scary

What's scary about PC's is that many people build their own to "save money". If building a PC saves you money, then you obviously have a lot of free time on your hands....

I must have been really tired when making my last couple posts to this thread, I didn't notice when I read the first post that Luke had already swapped motherboards and still has the same memory issue. It's almost guaranteed to be incompatible or mis-matched RAM. I would double check that the RAM specs are indeed correct for the board. At 128GB capacity, they must be ECC Registered DIMMs, if they're non-ECC, you can also run into issues that may account for the issues you have with all the slots populated. Technically the board and chipset do support 128GB (or less) for non-ECC UDIMMs, but not if dispersed across all 16 sockets. Not as far as I'm aware, anyway. All things considered, you don't want to be running non-ECC, unbuffered RAM in these systems anyway.

According to your description of which DIMM sockets don't work, that's CPU1-D2 and CPU1-D1. Sounds to me like the RAM is mismatched or out of spec where the motherboard won't enable quad-channel mode. There is no quad-channel ability possible with those DIMMs removed.

One other possibility... Did you buy the DIMMs with the thermal sensor? I'm thinking of another possibility here, not sure if it will mean anything, but just thinking out loud in a way...
 
This is the RAM I purchased: http://www.newegg.com/Product/Product.aspx?Item=N82E16820239015

It is 1.5v Registered ECC RAM. When I get back in the office I'll have to check them to look for any irregularity.

If you purchased the ram at the same time from newegg, it seems weird they would send you different models or chips. When you inspect the chips, if they look the same, it seems like a compatibility problem with that specific ram and mo/bo combo. You may be stuck leaving those two slots open, or you could also try to return the ram and trying another brand. As mentioned above a lot of people buy PC’s to save money, but they don’t think about the long term costs involved in maintaining them. In the PC world, there are so many possible combinations of hardware that it is virtually impossible for a motherboard manufacture to test every hardware combination for compatibility issues. When buying a mac, they limit your hardware options down so much that everything can be tested and approved for compatibility. That is why Macs seem more stable.

On a side note, if you have hibernation enabled, windows will also store a temp file that is the size of your ram. So for future reference, along with making pagesys file smaller, make sure hibernation is also turned off.
 
hijacking this thread with my own questions about the X9DAi:
I can not figure out hot to get the SATA ports to work that come on that extra cable with the big connector. The connector seems to plug into a port on the motherboard called I-SAS/SATA in the manual. But those sata disks attached to those silver cables will not show up. Also there is a 5th connector on that combined cable which is not a SATA connector. Looks more like something that plug into the motherboard as well...

can somebody enlighten me on how I am able to use those 4 extra SATA ports?
 
Got the same problem Neil, everithing enabled (Bios) but no way...
Maybe a driver (SCU) problem

PS: Are you the Swiss Stubbings :) ?
 
yeah did not get it to work, both SAS options are enabled in the Bios. But theres no disks showing up...
There's so little (no) documentation about the SAS port. I must admit this SAS thing is completely new to me.
I am not sure if it might me broken... don't know any way of testing this.

Yes I am "the" swiss stubbings... am I famous lol?
 
Luke, the reason your drive is full is because you installed the OS with all the RAM loaded, and Windows made a huge page file. I don't have my windows running, but right click my computer, and under advanced settings, just remove your page file (option for that). You'll need a reboot. If the page file is still there, just delete it. I forgot the exact detailed method, but that should do the trick.

BTW, I've used that board with 128GB and it works with all the slots. There is a list on supermicro for that model board telling you which memory part numbers are compatible. If it's not on that list, it may or may not work.

These are known to be certified 8GB modules:

MT36JSF1G72PZ-1G6M1
M393B1K70DH0-CK0

Holy crap that worked!!!
 
got another problem with the X9DAi: I have 2 sonnet PCIe cards, an esata (Tempo SATA E2P) and a gigabit ethernet card (Presto Gigabit Pro PCIe) and they both do not seem to be detected by windows7. The ethernet card does not even seem to get any power as both LEDs are dark even with a cable connected... (In case you are wondering why I have an ethernet card: I am also running this computer as a hackintosh which has some problems with the onboard ethernet) I also have a PNY quadro 4000 graphics card and it seems to be working perfectly in every slot. But the sonnet cards don't. I checked the cards in an other computer (mac) and they where working, so they are not broken. any ideas?
 
I would contact Sonnet about the cards. No reason off the top of my head as to why they wouldn't work unless there's a BIOS conflict or something on the card itself where it doesn't like certain slot types. I've never worked with either of those cards, so I'd be guessing at their operation and driver situation anyway. Do the cards show up fine when OSX is launched on the system? Which leads to another question... why this system for a Hackintosh? There's no proper chipset / CPU support for OSX on these systems to maximize their throughput for onboard disk subsystems, CPU and memory bandwidth, cache, etc.. Some of that support is showing up in pre-release builds of Mountain Lion, but so far it's still incomplete. Most of the support that is there is probably coming via increased support for the Sandy Bridge / Ivy Bridge platforms in part of API/code packaging from Intel, not Apple specifically building in support themselves.

You do have two CPUs installed, right?
 
Back
Top