{"video_id":"fp_kC6K1vOaNz","title":"PCI Express x32 is a thing!","channel":"Techquickie","show":"Techquickie","published_at":"2024-05-07T19:34:00.024Z","duration_s":263,"segments":[{"start_s":0.0,"end_s":3.32,"text":"Your PC probably has a slot that looks like this.","speaker":null,"is_sponsor":0},{"start_s":3.32,"end_s":8.2,"text":"It's a PCI Express X16 slot, and it's commonly used for graphics cards,","speaker":null,"is_sponsor":0},{"start_s":8.2,"end_s":14.64,"text":"as it's one of the fastest connections on your motherboard. Even the chonkiest, most powerful GPUs can be handled","speaker":null,"is_sponsor":0},{"start_s":14.64,"end_s":20.24,"text":"by a single one of these slots, no problem. But there is another.","speaker":null,"is_sponsor":0},{"start_s":20.24,"end_s":23.64,"text":"Did you know that PCI Express X32","speaker":null,"is_sponsor":0},{"start_s":23.64,"end_s":29.4,"text":"is a real thing that actually exists? What the heck would you do with a slot that's twice as long?","speaker":null,"is_sponsor":0},{"start_s":29.4,"end_s":33.6,"text":"Well, to be clear, it's very difficult to find slots physically bigger","speaker":null,"is_sponsor":0},{"start_s":33.6,"end_s":37.36,"text":"than that standard X16 size. Remember that those numbers,","speaker":null,"is_sponsor":0},{"start_s":37.36,"end_s":41.44,"text":"when we're talking about PCI Express, refer to the number of lanes,","speaker":null,"is_sponsor":0},{"start_s":41.44,"end_s":48.32,"text":"not necessarily the physical size of the slot. A tiny M.2 SSD often uses four PCI Express lanes,","speaker":null,"is_sponsor":0},{"start_s":48.32,"end_s":53.8,"text":"even though the connector is quite a bit smaller than a regular PCIe X4 sized slot.","speaker":null,"is_sponsor":0},{"start_s":53.8,"end_s":57.36,"text":"How exactly does PCI Express X32 work then?","speaker":null,"is_sponsor":0},{"start_s":57.36,"end_s":63.48,"text":"But it turns out that the PCI Express standard doesn't support a single link greater than X16.","speaker":null,"is_sponsor":0},{"start_s":63.48,"end_s":69.2,"text":"The reason for this is because it's very difficult to actually implement links this wide in hardware.","speaker":null,"is_sponsor":0},{"start_s":69.2,"end_s":72.2,"text":"You see, when you send data down a PCI Express link,","speaker":null,"is_sponsor":0},{"start_s":72.2,"end_s":77.04,"text":"say to a graphics card, that data is striped across multiple lanes,","speaker":null,"is_sponsor":0},{"start_s":77.04,"end_s":81.28,"text":"and doing this is not trivial. When the data arrives wherever it's going,","speaker":null,"is_sponsor":0},{"start_s":81.28,"end_s":85.04,"text":"it has to be deskewed, meaning synchronized.","speaker":null,"is_sponsor":0},{"start_s":85.04,"end_s":89.8,"text":"Although PCI Express is a serial interface that doesn't require the data on each lane","speaker":null,"is_sponsor":0},{"start_s":89.8,"end_s":95.88,"text":"to arrive at exactly the same time, synchronizing the data still involves hardware overhead.","speaker":null,"is_sponsor":0},{"start_s":95.88,"end_s":100.16,"text":"And once you start getting past 16 lanes, it's just too much to keep up with.","speaker":null,"is_sponsor":0},{"start_s":100.16,"end_s":105.12,"text":"So instead of having one big slot, these higher PCI Express connections","speaker":null,"is_sponsor":0},{"start_s":105.12,"end_s":110.4,"text":"use a trick called driver binding. Essentially, this allows multiple PCIe devices","speaker":null,"is_sponsor":0},{"start_s":110.4,"end_s":113.72,"text":"to talk to each other and coordinate their traffic","speaker":null,"is_sponsor":0},{"start_s":113.76,"end_s":121.0,"text":"so they can act as one big device. So a PCIe X32 link is actually two X16 links","speaker":null,"is_sponsor":0},{"start_s":121.44,"end_s":127.44,"text":"mashed together in software, with the devices installed in two normal X16 slots.","speaker":null,"is_sponsor":0},{"start_s":127.44,"end_s":132.72,"text":"The performance overhead involved with driver binding for X32 isn't too bad.","speaker":null,"is_sponsor":0},{"start_s":132.72,"end_s":136.58,"text":"But if you were to theoretically go up to say X64,","speaker":null,"is_sponsor":0},{"start_s":136.58,"end_s":140.44,"text":"you'd likely need more hardware, as at that point you just have too many transactions","speaker":null,"is_sponsor":0},{"start_s":140.44,"end_s":144.64,"text":"for your poor system to handle. But wait a sec, why the heck would you need","speaker":null,"is_sponsor":0},{"start_s":144.64,"end_s":149.84,"text":"that much bandwidth to begin with? Now the appeal of having this many PCI Express lanes","speaker":null,"is_sponsor":0},{"start_s":149.84,"end_s":153.0,"text":"isn't so you can do something like squeeze more performance","speaker":null,"is_sponsor":0},{"start_s":153.0,"end_s":158.4,"text":"out of your graphics card. Even an RTX 4090 barely improves going from eight lanes","speaker":null,"is_sponsor":0},{"start_s":158.4,"end_s":161.4,"text":"to 16 lanes on a PCIe 4.0 slot.","speaker":null,"is_sponsor":0},{"start_s":161.4,"end_s":167.56,"text":"Instead, driver binding is used in applications where all the bandwidth you can get is appealing.","speaker":null,"is_sponsor":0},{"start_s":167.56,"end_s":171.16,"text":"You often see X32 links in certain kinds of networking cards,","speaker":null,"is_sponsor":0},{"start_s":171.2,"end_s":177.2,"text":"mostly for server and data center use. Although NVIDIA is obviously known more for GPUs and AI,","speaker":null,"is_sponsor":0},{"start_s":177.2,"end_s":180.68,"text":"they make a line of network adapters that supports both Ethernet","speaker":null,"is_sponsor":0},{"start_s":180.68,"end_s":184.64,"text":"and another high speed networking protocol called Infiniband.","speaker":null,"is_sponsor":0},{"start_s":184.64,"end_s":189.36,"text":"This product, for example, goes into a standard PCIe Express X16 slot,","speaker":null,"is_sponsor":0},{"start_s":189.36,"end_s":193.52,"text":"but it comes with a second auxiliary card with the same connector.","speaker":null,"is_sponsor":0},{"start_s":193.52,"end_s":198.36,"text":"They work in tandem to provide an X32 connection for extra bandwidth in case you're using","speaker":null,"is_sponsor":0},{"start_s":198.36,"end_s":202.16,"text":"a previous revision of PCIe Express that doesn't provide enough bandwidth","speaker":null,"is_sponsor":0},{"start_s":202.16,"end_s":207.36,"text":"to take full advantage of the network adapter's speed. There's also a special cable connecting them","speaker":null,"is_sponsor":0},{"start_s":207.36,"end_s":213.0,"text":"to allow them to share data while taking some of the pressure off of the PCIe Express bus itself.","speaker":null,"is_sponsor":0},{"start_s":213.0,"end_s":217.92,"text":"And connecting multiple machines with crazy amounts of bandwidth isn't even a rare use case.","speaker":null,"is_sponsor":0},{"start_s":217.92,"end_s":220.96,"text":"With how much growth we've seen with data hungry cloud services","speaker":null,"is_sponsor":0},{"start_s":220.96,"end_s":224.84,"text":"for applications like AI, gaming, and ultra high def video,","speaker":null,"is_sponsor":0},{"start_s":224.84,"end_s":230.4,"text":"data centers are already moving towards 400 gigabit connections or even beyond.","speaker":null,"is_sponsor":0},{"start_s":230.4,"end_s":233.6,"text":"That's 400 times faster than what you'll find","speaker":null,"is_sponsor":0},{"start_s":233.6,"end_s":239.72,"text":"in most garden variety desktop PCs, which is also part of why you simply don't need","speaker":null,"is_sponsor":0},{"start_s":239.72,"end_s":242.72,"text":"PCIe Express X32 in your personal rig.","speaker":null,"is_sponsor":0},{"start_s":242.72,"end_s":247.04,"text":"Although I'm sure some of you are already thinking of ways you're gonna justify your purchase.","speaker":null,"is_sponsor":0},{"start_s":247.04,"end_s":251.28,"text":"Hey, thanks for watching this video. Like it if you liked it. Dislike it if you disliked it.","speaker":null,"is_sponsor":0},{"start_s":251.28,"end_s":254.68,"text":"Check out our other video on PCIe Express 6.0.","speaker":null,"is_sponsor":0},{"start_s":254.68,"end_s":259.56,"text":"Comment below with video suggestions and don't forget to subscribe and follow to TechWiki,","speaker":null,"is_sponsor":0},{"start_s":259.56,"end_s":263.32,"text":"the channel that's all about doing the tech real quick.","speaker":null,"is_sponsor":0}],"full_text":"Your PC probably has a slot that looks like this. It's a PCI Express X16 slot, and it's commonly used for graphics cards, as it's one of the fastest connections on your motherboard. Even the chonkiest, most powerful GPUs can be handled by a single one of these slots, no problem. But there is another. Did you know that PCI Express X32 is a real thing that actually exists? What the heck would you do with a slot that's twice as long? Well, to be clear, it's very difficult to find slots physically bigger than that standard X16 size. Remember that those numbers, when we're talking about PCI Express, refer to the number of lanes, not necessarily the physical size of the slot. A tiny M.2 SSD often uses four PCI Express lanes, even though the connector is quite a bit smaller than a regular PCIe X4 sized slot. How exactly does PCI Express X32 work then? But it turns out that the PCI Express standard doesn't support a single link greater than X16. The reason for this is because it's very difficult to actually implement links this wide in hardware. You see, when you send data down a PCI Express link, say to a graphics card, that data is striped across multiple lanes, and doing this is not trivial. When the data arrives wherever it's going, it has to be deskewed, meaning synchronized. Although PCI Express is a serial interface that doesn't require the data on each lane to arrive at exactly the same time, synchronizing the data still involves hardware overhead. And once you start getting past 16 lanes, it's just too much to keep up with. So instead of having one big slot, these higher PCI Express connections use a trick called driver binding. Essentially, this allows multiple PCIe devices to talk to each other and coordinate their traffic so they can act as one big device. So a PCIe X32 link is actually two X16 links mashed together in software, with the devices installed in two normal X16 slots. The performance overhead involved with driver binding for X32 isn't too bad. But if you were to theoretically go up to say X64, you'd likely need more hardware, as at that point you just have too many transactions for your poor system to handle. But wait a sec, why the heck would you need that much bandwidth to begin with? Now the appeal of having this many PCI Express lanes isn't so you can do something like squeeze more performance out of your graphics card. Even an RTX 4090 barely improves going from eight lanes to 16 lanes on a PCIe 4.0 slot. Instead, driver binding is used in applications where all the bandwidth you can get is appealing. You often see X32 links in certain kinds of networking cards, mostly for server and data center use. Although NVIDIA is obviously known more for GPUs and AI, they make a line of network adapters that supports both Ethernet and another high speed networking protocol called Infiniband. This product, for example, goes into a standard PCIe Express X16 slot, but it comes with a second auxiliary card with the same connector. They work in tandem to provide an X32 connection for extra bandwidth in case you're using a previous revision of PCIe Express that doesn't provide enough bandwidth to take full advantage of the network adapter's speed. There's also a special cable connecting them to allow them to share data while taking some of the pressure off of the PCIe Express bus itself. And connecting multiple machines with crazy amounts of bandwidth isn't even a rare use case. With how much growth we've seen with data hungry cloud services for applications like AI, gaming, and ultra high def video, data centers are already moving towards 400 gigabit connections or even beyond. That's 400 times faster than what you'll find in most garden variety desktop PCs, which is also part of why you simply don't need PCIe Express X32 in your personal rig. Although I'm sure some of you are already thinking of ways you're gonna justify your purchase. Hey, thanks for watching this video. Like it if you liked it. Dislike it if you disliked it. Check out our other video on PCIe Express 6.0. Comment below with video suggestions and don't forget to subscribe and follow to TechWiki, the channel that's all about doing the tech real quick."}