Knowledge

InfiniBand

Source 📝

3000: 799: 27: 720:
Each link is duplex. Links can be aggregated: most systems use a 4 link/lane connector (QSFP). HDR often makes use of 2x links (aka HDR100, 100 Gb link using 2 lanes of HDR, while still using a QSFP connector). 8x is called for with NDR switch ports using OSFP (Octal Small Form Factor Pluggable)
1887:
InfiniBand FDR and FDR10 Overview FDR, standard InfiniBand data rate, where each lane of a 4X port runs a bit rate of 14.0625 Gbit/s with a 64b/66b encoding, resulting in an effective bandwidth of 54.54 Gbit/s. The FDR physical layer is an IBTA specified physical layer using different
269:
kernel. By February, 2005, the support was accepted into the 2.6.11 Linux kernel. In November 2005 storage devices finally were released using InfiniBand from vendors such as Engenio. Cisco, desiring to keep technology superior to Ethernet off the market, adopted a "buy to kill" strategy. Cisco
896:
for Linux and FreeBSD, and as Mellanox OFED for Windows (product names: WinOF / WinOF-2; attributed as host controller driver for matching specific ConnectX 3 to 5 devices) under a choice of BSD license for Windows. It has been adopted by most of the InfiniBand vendors, for
1888:
block types, deskew mechanism and framing rules. The SX6518 switch also supports FDR10, a non-standard InfiniBand data rate, where each lane of a 4X port runs a bit rate of 10.3125 Gbit/s with a 64b/66b encoding, resulting in an effective bandwidth of 40 Gbit/s.
1855:
FDR10 is a non-standard InfiniBand data rate, where each lane of a 4X port runs a bit rate of 10.3125 Gbit/s with a 64b/66b encoding, resulting in an effective bandwidth of 40 Gbit/s. FDR10 supports 20% more bandwidth over QDR due to better encoding
1262:
InfiniBand technology is now found on 205 systems, down from 235 systems, and is now the second most-used internal system interconnect technology. Gigabit Ethernet has risen to 218 systems up from 182 systems, in large part thanks to 176 systems now using 10G
112:. It is used for data interconnect both among and within computers. InfiniBand is also used as either a direct or switched interconnect between servers and storage systems, as well as an interconnect between storage systems. It is designed to be 289:, links running at about 56 gigabits per second (known as FDR, see below), were announced and demonstrated by connecting booths in the trade show. In 2012, Intel acquired QLogic's InfiniBand technology, leaving only one independent supplier. 750:. All transmissions begin or end at a channel adapter. Each processor contains a host channel adapter (HCA) and each peripheral has a target channel adapter (TCA). These adapters can also exchange information for security or 1539: 326:
Original names for speeds were single-data rate (SDR), double-data rate (DDR) and quad-data rate (QDR) as given below. Subsequently, other three-letter acronyms were added for even higher data rates.
238:
there was hesitation in the industry to invest in such a far-reaching technology jump. By 2002, Intel announced that instead of shipping IB integrated circuits ("chips"), it would focus on developing
1621: 277:
was the internal interconnect technology in 259 installations, compared with 181 using InfiniBand. In 2010, market leaders Mellanox and Voltaire merged, leaving just one other IB vendor,
821:
connector system for speeds up to 120 Gbit/s over copper, active optical cables, and optical transceivers using parallel multi-mode fiber cables with 24-fiber MPO connectors.
212:. Version 1.0 of the InfiniBand Architecture Specification was released in 2000. Initially the IBTA vision for IB was simultaneously a replacement for PCI in I/O, Ethernet in the 234:
had been founded in 1999 to develop NGIO technology, but by 2001 shipped an InfiniBand product line called InfiniBridge at 10 Gbit/second speeds. Following the burst of the
876:, which are abstract representations of functions or methods that must exist. The syntax of these functions is left to the vendors. Sometimes for reference this is called the 2158: 929:
Ethernet over InfiniBand, abbreviated to EoIB, is an Ethernet implementation over the InfiniBand protocol and connector technology. EoIB enables multiple Ethernet
1648: 196:. This led to the formation of the InfiniBand Trade Association (IBTA), which included both sets of hardware vendors as well as software vendors such as 1789: 1625: 1405: 1569: 2995:
Interfaces are listed by their speed in the (roughly) ascending order, so the interface at the end of each section should be the fastest.
2006: 1305: 2440: 1595: 2968: 921:
operating system, as well as "AIX InfiniBand verbs". The Linux kernel support was integrated in 2005 into the kernel version 2.6.11.
1679: 2597: 172:
InfiniBand originated in 1999 from the merger of two competing designs: Future I/O and Next Generation I/O (NGIO). NGIO was led by
2460: 286: 937:, usually referred to as TCP/IP, is different in some details compared to the direct InfiniBand protocol in IP over IB (IPoIB). 2267: 1279: 2648: 2319: 2131: 1813: 723: 1733: 2354: 1510: 2701: 2540: 2470: 292:
By 2014, InfiniBand was the most popular internal connection technology for supercomputers, although within two years,
2530: 865: 762:
InfiniBand transmits data in packets of up to 4 KB that are taken together to form a message. A message can be:
205: 2628: 1656: 2119: 1432: 1704: 2420: 806:
In addition to a board form factor connection, it can use both active and passive copper (up to 10 meters) and
2972: 2623: 2592: 2245: 2570: 1457: 842: 1760: 2896: 2835: 2690: 1982: 1212: 731: 3037: 2495: 2260: 1958: 1923: 1793: 1409: 1331: 1222: 846: 830: 574: 101: 2865: 2550: 1946: 1868: 1826: 1202: 261:
used InfiniBand in what was estimated to be the third largest computer in the world at the time. The
1983:"NVIDIA Announces New Switches Optimized for Trillion-Parameter GPU Computing and AI Infrastructure" 265:(later renamed OpenFabrics Alliance) was founded in 2004 to develop an open set of software for the 838: 711: 254: 2010: 1840: 1357: 3032: 3027: 3003: 2978: 2870: 2525: 934: 201: 2560: 2032: 213: 2187: 888:
and called the Open Fabrics Enterprise Distribution (OFED). It is released under two licenses
3022: 2824: 2777: 2633: 2405: 2253: 1217: 930: 770: 2820: 2673: 2555: 2230: 1484: 1197: 885: 262: 1249: 8: 2732: 2287: 2103: 2081: 807: 293: 217: 2234: 1814:
http://www.hpcadvisorycouncil.com/events/2014/swiss-workshop/presos/Day_1/1_Mellanox.pdf
145:, which are used by large computer system and database vendors in their product lines. 2276: 2220: 1227: 751: 379: 300: 200:. At the time it was thought some of the more powerful computers were approaching the 2722: 2344: 2280: 906: 881: 270:
successfully killed InfiniBand switching companies such as Topspin via acquisition.
61: 26: 2455: 2055: 1905: 787: 479: 274: 243: 225: 177: 138: 120: 1768:
Designing Cloud and Grid Computing Systems with InfiniBand and High-Speed Ethernet
2585: 2435: 2415: 2290: 818: 743: 384: 193: 117: 109: 123:. Between 2014 and June 2016, it was the most commonly used interconnect in the 2886: 2580: 2505: 2430: 2334: 2309: 1737: 235: 142: 3016: 2958: 2845: 2737: 2685: 2668: 2450: 2349: 2339: 2314: 2275: 282: 258: 221: 153: 87: 242:, and Microsoft discontinued IB development in favor of extending Ethernet. 2695: 2638: 2490: 2395: 2963: 2942: 2860: 2705: 2643: 2618: 2545: 2329: 2324: 933:
varying on the InfiniBand (IB) version. Ethernet's implementation of the
893: 310:
acquired Mellanox, the last independent supplier of InfiniBand products.
239: 113: 2782: 1382: 2816: 2304: 1869:"324-Port InfiniBand FDR SwitchX® Switch Platform Hardware User Manual" 854: 346: 105: 303:(an investor in Mellanox) might engineer its own InfiniBand hardware. 2840: 2830: 2797: 2792: 2727: 2602: 2390: 2375: 2370: 780: 197: 157: 2104:"Implementing InfiniBand on IBM System p (IBM Redbook SG24-7351-00)" 2850: 2787: 2520: 2380: 747: 231: 149: 130: 2225: 1947:
https://www.mellanox.com/files/doc-2020/pb-connectx-6-vpi-card.pdf
318:
Specifications are published by the InfiniBand trade association.
2983: 2937: 2921: 2747: 2565: 2510: 2445: 2400: 1736:. InfiniBand Trade Association. November 11, 2021. Archived from 902: 834: 798: 247: 1680:"Intel Snaps Up InfiniBand Technology, Product Line from QLogic" 73: 2916: 2807: 2772: 2767: 2762: 2757: 2575: 2465: 2425: 2385: 2240: 307: 278: 185: 134: 124: 83: 2901: 2812: 471: 2911: 2802: 2742: 2680: 2653: 2535: 2485: 2410: 2217:
Dissecting a Small InfiniBand Application Using the Verbs API
1207: 898: 850: 266: 209: 173: 1306:"Intel Introduces Next Generation I/O for Computing Servers" 2906: 2891: 2752: 2663: 2658: 2500: 889: 811: 224:. IBTA also envisaged decomposing server hardware on an IB 181: 100:) is a computer networking communications standard used in 1622:"Largest InfiniBand vendors merge; eye converged networks" 2855: 2480: 2475: 1790:"InfiniBand Roadmap: IBTA - InfiniBand Trade Association" 918: 910: 858: 189: 1277: 176:, with a specification released in 1998, and joined by 868:(API). The standard only lists a set of verbs such as 2053: 148:
As a computer cluster interconnect, IB competes with
776:
a transaction-based operation (that can be reversed)
1596:"Two rival supercomputers duke it out for top spot" 1511:"OpenIB Alliance Achieves Acceptance By Kernel.org" 1482: 1280:"Oracle Engineers Its Own InfiniBand Interconnects" 829:Mellanox operating system support is available for 1752: 1770:. Newport Beach, CA, USA: CCGrid 2011. p. 23 1758: 1728: 1726: 1406:"Brief History of InfiniBand: Hype to Pragmatism" 3014: 1649:"Mellanox Demos Souped-Up Version of InfiniBand" 1358:"An Introduction to the InfiniBand Architecture" 2598:Coherent Accelerator Processor Interface (CAPI) 1677: 1537: 1508: 1723: 1705:"Nvidia to Acquire Mellanox for $ 6.9 Billion" 1646: 1570:"What Cisco-Topspin deal means for InfiniBand" 817:The InfiniBand Association also specified the 802:InfiniBand switch with CX4/SFF-8470 connectors 82:"IBTA" redirects here. It could also refer to 2261: 1900: 1898: 1896: 1332:"Warring NGIO and Future I/O groups to merge" 1278:Timothy Prickett Morgan (February 23, 2016). 1761:"Network Speed Acceleration with IB and HSE" 1759:Panda, Dhabaleswar K.; Sayantan Sur (2011). 1430: 1303: 746:topology, as opposed to early shared medium 2156: 2120:Mellanox OFED for Windows - WinOF / WinOF-2 1906:"InfiniBand Roadmap - Advancing InfiniBand" 1533: 1531: 1458:"Virginia Tech Builds 10 TeraFlop Computer" 924: 793: 766:a remote direct memory access read or write 2268: 2254: 2056:"FreeBSD Kernel Interfaces Manual, mlx5en" 1893: 734:(RDMA) capabilities for low CPU overhead. 634: 536: 506: 2224: 2054:Mellanox Technologies (3 December 2015). 1485:"Linux Kernel 2.6.11 Supports InfiniBand" 1483:Sean Michael Kerner (February 24, 2005). 1349: 1329: 1528: 1273: 1271: 797: 667: 411: 371: 1782: 1433:"Sun confirms commitment to InfiniBand" 1375: 672: 287:International Supercomputing Conference 273:Of the top 500 supercomputers in 2009, 3015: 1593: 1540:"Is InfiniBand poised for a comeback?" 1355: 1244: 1242: 824: 601: 566: 441: 2249: 2241:InfiniBand Trade Association web site 1594:Lawson, Stephen (November 16, 2009). 1268: 941:Ethernet over InfiniBand performance 339: 330:InfiniBand unidirectional data rates 2214: 1678:Michael Feldman (January 23, 2012). 1538:Ann Silverthorn (January 12, 2006), 1509:OpenIB Alliance (January 21, 2005). 1142:60 × GbE to 1 × 50 GbE + 1 × 10 GbE 913:refers to a software library called 864:InfiniBand has no specific standard 160:. The technology is promoted by the 1999: 1239: 13: 1567: 1397: 1304:Scott Bekker (November 11, 1998). 14: 3049: 2208: 1619: 1431:Computerwire (December 2, 2002). 866:application programming interface 724:"Cable and Connector Definitions" 2999: 2998: 1647:Mikael Ricknäs (June 20, 2011). 671: 313: 25: 2180: 2150: 2124: 2113: 2096: 2074: 2047: 2025: 1975: 1951: 1940: 1916: 1861: 1833: 1819: 1807: 1697: 1671: 1640: 1613: 1587: 1561: 1502: 1476: 1403: 704: 208:bus, in spite of upgrades like 2157:Dotan Barak (March 11, 2014). 1450: 1424: 1323: 1297: 321: 299:In 2016, it was reported that 1: 2593:Intel Ultra Path Interconnect 2188:"10 Advantages of InfiniBand" 2082:"InfiniBand Cards - Overview" 1827:"InfiniBand Types and Speeds" 1330:Will Wade (August 31, 1999). 1233: 1048:30 × GbE to 1 × 25 GbE + 1 × 958:Compatible Ethernet quantity 2571:Intel QuickPath Interconnect 2561:Direct Media Interface (DMI) 2159:"Verbs programming tutorial" 1910:InfiniBand Trade Association 843:SUSE Linux Enterprise Server 184:. Future I/O was backed by 162:InfiniBand Trade Association 20:InfiniBand Trade Association 7: 2033:"Mellanox OFED for FreeBSD" 1734:"FDR InfiniBand Fact Sheet" 1213:List of interface bit rates 1191: 955:Compatible Ethernet type(s) 757: 737: 732:remote direct memory access 10: 3054: 2556:Compute Express Link (CXL) 1223:Parallel optical interface 167: 137:) manufactures InfiniBand 102:high-performance computing 81: 2992: 2951: 2930: 2879: 2793:IEEE-1284 (parallel port) 2715: 2708:logical device interface) 2611: 2363: 2297: 2136:IBM AIX 7.1 documentation 1878:. 2018-04-29. section 1.2 1203:iSCSI Extensions for RDMA 1146: 1056: 962: 884:software is developed by 662: 643: 641: 573: 478: 383: 378: 351: 345: 342: 336: 334: 250:continued to support IB. 68: 57: 49: 41: 33: 24: 1408:. Oracle. Archived from 925:Ethernet over InfiniBand 839:Red Hat Enterprise Linux 794:Physical interconnection 712:forward error correction 343:Signaling rate (Gbit/s) 127:list of supercomputers. 104:that features very high 1385:. Mellanox Technologies 1310:Redmond Channel Partner 1252:. Top500.Org. June 2016 1250:"Highlights– June 2016" 1185:40 × GbE to 1 × 40 GbE 1165:10 × GbE to 1 × 10 GbE 1122:40 × GbE to 1 × 40 GbE 1102:20 × GbE to 2 × 10 GbE 1028:20 × GbE to 2 × 10 GbE 1008:10 × GbE to 1 × 10 GbE 935:Internet Protocol Suite 296:started displacing it. 257:supercomputer built at 202:interconnect bottleneck 2355:List of bus bandwidths 2215:Kerr, Gregory (2011), 1356:Pentakalos, Odysseas. 803: 2009:. ITA. Archived from 1218:Optical communication 814:connectors are used. 810:(up to 10 km). 801: 352:Adapter latency (μs) 285:vendor. At the 2011 2798:IEEE-1394 (FireWire) 2536:PCI Extended (PCI-X) 1198:100 Gigabit Ethernet 886:OpenFabrics Alliance 730:InfiniBand provides 53:Promoting InfiniBand 45:Industry trade group 2639:Parallel ATA (PATA) 2235:2011arXiv1105.1827K 2013:on 24 November 2016 2007:"Specification FAQ" 1464:. November 30, 2003 942: 825:Software interfaces 808:optical fiber cable 710:Using Reed-Solomon 331: 294:10 Gigabit Ethernet 21: 2546:PCI Express (PCIe) 1740:on August 26, 2016 1228:SCSI RDMA Protocol 952:Bandwidth (Gbit/s) 940: 804: 752:quality of service 742:InfiniBand uses a 329: 301:Oracle Corporation 19: 3038:Computer networks 3010: 3009: 2996: 2723:Apple Desktop Bus 2700:PCI Express (via 2659:Serial ATA (SATA) 2345:Network on a chip 2060:FreeBSD Man Pages 1284:The Next Platform 1189: 1188: 907:Microsoft Windows 882:de facto standard 695: 694: 220:interconnect and 139:host bus adapters 80: 79: 62:Beaverton, Oregon 3045: 3002: 3001: 2994: 2456:HP Precision Bus 2270: 2263: 2256: 2247: 2246: 2237: 2228: 2203: 2202: 2200: 2198: 2184: 2178: 2177: 2175: 2173: 2163: 2154: 2148: 2147: 2145: 2143: 2128: 2122: 2117: 2111: 2110: 2108: 2100: 2094: 2093: 2091: 2089: 2078: 2072: 2071: 2069: 2067: 2051: 2045: 2044: 2042: 2040: 2029: 2023: 2022: 2020: 2018: 2003: 1997: 1996: 1994: 1993: 1979: 1973: 1972: 1970: 1969: 1955: 1949: 1944: 1938: 1937: 1935: 1934: 1920: 1914: 1913: 1902: 1891: 1890: 1884: 1883: 1873: 1865: 1859: 1858: 1852: 1851: 1837: 1831: 1830: 1823: 1817: 1811: 1805: 1804: 1802: 1801: 1792:. Archived from 1786: 1780: 1779: 1777: 1775: 1765: 1756: 1750: 1749: 1747: 1745: 1730: 1721: 1720: 1718: 1716: 1711:. March 11, 2019 1701: 1695: 1694: 1692: 1690: 1675: 1669: 1668: 1666: 1664: 1659:on April 6, 2012 1655:. Archived from 1644: 1638: 1637: 1635: 1633: 1624:. Archived from 1617: 1611: 1610: 1608: 1606: 1591: 1585: 1584: 1582: 1580: 1565: 1559: 1558: 1557: 1555: 1535: 1526: 1525: 1523: 1521: 1506: 1500: 1499: 1497: 1495: 1480: 1474: 1473: 1471: 1469: 1454: 1448: 1447: 1445: 1443: 1428: 1422: 1421: 1419: 1417: 1412:on 8 August 2014 1401: 1395: 1394: 1392: 1390: 1379: 1373: 1372: 1370: 1368: 1353: 1347: 1346: 1344: 1342: 1327: 1321: 1320: 1318: 1316: 1301: 1295: 1294: 1292: 1290: 1275: 1266: 1265: 1259: 1257: 1246: 1178: 1172: 1158: 1152: 1135: 1129: 1115: 1109: 1095: 1089: 1081: 1077: 1068: 1062: 1051: 1041: 1035: 1021: 1015: 1001: 995: 987: 983: 974: 968: 943: 939: 916: 875: 871: 788:atomic operation 727: 714: 708: 674: 669: 636: 603: 568: 538: 508: 473: 443: 413: 373: 332: 328: 275:Gigabit Ethernet 244:Sun Microsystems 178:Sun Microsystems 143:network switches 121:network topology 76: 74:infinibandta.org 29: 22: 18: 16:Network standard 3053: 3052: 3048: 3047: 3046: 3044: 3043: 3042: 3013: 3012: 3011: 3006: 2997: 2988: 2947: 2926: 2875: 2788:IEEE-488 (GPIB) 2711: 2607: 2586:Infinity Fabric 2416:Europe Card Bus 2359: 2293: 2274: 2211: 2206: 2196: 2194: 2186: 2185: 2181: 2171: 2169: 2161: 2155: 2151: 2141: 2139: 2130: 2129: 2125: 2118: 2114: 2106: 2102: 2101: 2097: 2087: 2085: 2080: 2079: 2075: 2065: 2063: 2052: 2048: 2038: 2036: 2031: 2030: 2026: 2016: 2014: 2005: 2004: 2000: 1991: 1989: 1987:NVIDIA Newsroom 1981: 1980: 1976: 1967: 1965: 1957: 1956: 1952: 1945: 1941: 1932: 1930: 1922: 1921: 1917: 1904: 1903: 1894: 1881: 1879: 1871: 1867: 1866: 1862: 1849: 1847: 1839: 1838: 1834: 1825: 1824: 1820: 1812: 1808: 1799: 1797: 1788: 1787: 1783: 1773: 1771: 1763: 1757: 1753: 1743: 1741: 1732: 1731: 1724: 1714: 1712: 1703: 1702: 1698: 1688: 1686: 1676: 1672: 1662: 1660: 1645: 1641: 1631: 1629: 1618: 1614: 1604: 1602: 1592: 1588: 1578: 1576: 1566: 1562: 1553: 1551: 1536: 1529: 1519: 1517: 1507: 1503: 1493: 1491: 1481: 1477: 1467: 1465: 1456: 1455: 1451: 1441: 1439: 1429: 1425: 1415: 1413: 1402: 1398: 1388: 1386: 1381: 1380: 1376: 1366: 1364: 1354: 1350: 1340: 1338: 1328: 1324: 1314: 1312: 1302: 1298: 1288: 1286: 1276: 1269: 1255: 1253: 1248: 1247: 1240: 1236: 1194: 1176: 1170: 1156: 1150: 1133: 1127: 1113: 1107: 1093: 1087: 1079: 1078:5 × GbE to 1 × 1075: 1066: 1060: 1049: 1039: 1033: 1019: 1013: 999: 993: 985: 984:2 × GbE to 1 × 981: 972: 966: 927: 914: 873: 870:ibv_open_device 869: 827: 796: 773:send or receive 760: 744:switched fabric 740: 722: 718: 717: 709: 705: 324: 316: 263:OpenIB Alliance 194:Hewlett-Packard 170: 118:switched fabric 91: 72: 17: 12: 11: 5: 3051: 3041: 3040: 3035: 3033:Supercomputing 3030: 3028:Computer buses 3025: 3008: 3007: 2993: 2990: 2989: 2987: 2986: 2981: 2976: 2966: 2961: 2955: 2953: 2949: 2948: 2946: 2945: 2940: 2934: 2932: 2928: 2927: 2925: 2924: 2919: 2914: 2909: 2904: 2899: 2897:Intel HD Audio 2894: 2889: 2887:ADAT Lightpipe 2883: 2881: 2877: 2876: 2874: 2873: 2868: 2863: 2858: 2853: 2848: 2843: 2838: 2833: 2828: 2810: 2805: 2800: 2795: 2790: 2785: 2780: 2775: 2770: 2765: 2760: 2755: 2750: 2745: 2740: 2735: 2730: 2725: 2719: 2717: 2713: 2712: 2710: 2709: 2698: 2693: 2688: 2683: 2678: 2677: 2676: 2671: 2661: 2656: 2651: 2646: 2641: 2636: 2631: 2626: 2621: 2615: 2613: 2609: 2608: 2606: 2605: 2600: 2595: 2590: 2589: 2588: 2581:HyperTransport 2578: 2573: 2568: 2563: 2558: 2553: 2548: 2543: 2538: 2533: 2528: 2523: 2518: 2513: 2508: 2503: 2498: 2493: 2488: 2483: 2478: 2473: 2468: 2463: 2458: 2453: 2448: 2443: 2438: 2433: 2428: 2423: 2418: 2413: 2408: 2403: 2398: 2393: 2388: 2383: 2378: 2373: 2367: 2365: 2361: 2360: 2358: 2357: 2352: 2347: 2342: 2337: 2335:Bus contention 2332: 2327: 2322: 2317: 2312: 2310:Front-side bus 2307: 2301: 2299: 2295: 2294: 2291:computer buses 2273: 2272: 2265: 2258: 2250: 2244: 2243: 2238: 2210: 2209:External links 2207: 2205: 2204: 2179: 2166:OpenSHEM, 2014 2149: 2123: 2112: 2095: 2073: 2046: 2024: 1998: 1974: 1959:"Introduction" 1950: 1939: 1924:"Introduction" 1915: 1892: 1860: 1832: 1818: 1806: 1781: 1751: 1722: 1696: 1670: 1639: 1628:on 1 July 2017 1612: 1586: 1568:Connor, Deni. 1560: 1527: 1501: 1475: 1449: 1423: 1396: 1374: 1348: 1322: 1296: 1267: 1237: 1235: 1232: 1231: 1230: 1225: 1220: 1215: 1210: 1205: 1200: 1193: 1190: 1187: 1186: 1183: 1180: 1174: 1167: 1166: 1163: 1160: 1154: 1148: 1144: 1143: 1140: 1137: 1131: 1124: 1123: 1120: 1117: 1111: 1104: 1103: 1100: 1097: 1091: 1084: 1083: 1073: 1070: 1064: 1058: 1054: 1053: 1046: 1043: 1037: 1030: 1029: 1026: 1023: 1017: 1010: 1009: 1006: 1003: 997: 990: 989: 979: 978:GbE to 2.5 GbE 976: 970: 964: 960: 959: 956: 953: 950: 947: 926: 923: 826: 823: 795: 792: 791: 790: 784: 777: 774: 767: 759: 756: 739: 736: 716: 715: 702: 701: 700: 699: 693: 692: 689: 686: 681: 678: 675: 670: 664: 663: 661: 658: 655: 650: 647: 644: 642: 640: 637: 631: 630: 627: 624: 621: 616: 613: 610: 607: 604: 598: 597: 594: 591: 588: 583: 580: 577: 572: 569: 563: 562: 559: 556: 553: 548: 545: 542: 539: 533: 532: 529: 526: 523: 518: 515: 512: 509: 503: 502: 499: 496: 493: 488: 485: 482: 477: 474: 468: 467: 464: 461: 458: 453: 450: 447: 444: 438: 437: 434: 431: 428: 423: 420: 417: 414: 408: 407: 404: 401: 398: 393: 390: 387: 382: 377: 374: 368: 367: 364: 361: 358: 354: 353: 350: 344: 341: 338: 335: 323: 320: 315: 312: 281:, primarily a 236:dot-com bubble 169: 166: 78: 77: 70: 66: 65: 59: 55: 54: 51: 47: 46: 43: 39: 38: 35: 31: 30: 15: 9: 6: 4: 3: 2: 3050: 3039: 3036: 3034: 3031: 3029: 3026: 3024: 3021: 3020: 3018: 3005: 2991: 2985: 2982: 2980: 2977: 2974: 2970: 2967: 2965: 2962: 2960: 2959:Multidrop bus 2957: 2956: 2954: 2950: 2944: 2941: 2939: 2936: 2935: 2933: 2929: 2923: 2920: 2918: 2915: 2913: 2910: 2908: 2905: 2903: 2900: 2898: 2895: 2893: 2890: 2888: 2885: 2884: 2882: 2878: 2872: 2869: 2867: 2866:External PCIe 2864: 2862: 2859: 2857: 2854: 2852: 2849: 2847: 2846:Parallel SCSI 2844: 2842: 2839: 2837: 2834: 2832: 2829: 2826: 2822: 2818: 2814: 2811: 2809: 2806: 2804: 2801: 2799: 2796: 2794: 2791: 2789: 2786: 2784: 2781: 2779: 2776: 2774: 2771: 2769: 2766: 2764: 2761: 2759: 2756: 2754: 2751: 2749: 2746: 2744: 2741: 2739: 2738:Commodore bus 2736: 2734: 2731: 2729: 2726: 2724: 2721: 2720: 2718: 2714: 2707: 2703: 2699: 2697: 2694: 2692: 2689: 2687: 2686:Fibre Channel 2684: 2682: 2679: 2675: 2672: 2670: 2667: 2666: 2665: 2662: 2660: 2657: 2655: 2652: 2650: 2647: 2645: 2642: 2640: 2637: 2635: 2632: 2630: 2627: 2625: 2622: 2620: 2617: 2616: 2614: 2610: 2604: 2601: 2599: 2596: 2594: 2591: 2587: 2584: 2583: 2582: 2579: 2577: 2574: 2572: 2569: 2567: 2564: 2562: 2559: 2557: 2554: 2552: 2549: 2547: 2544: 2542: 2539: 2537: 2534: 2532: 2529: 2527: 2524: 2522: 2519: 2517: 2514: 2512: 2509: 2507: 2504: 2502: 2499: 2497: 2494: 2492: 2489: 2487: 2484: 2482: 2479: 2477: 2474: 2472: 2469: 2467: 2464: 2462: 2459: 2457: 2454: 2452: 2449: 2447: 2444: 2442: 2439: 2437: 2434: 2432: 2429: 2427: 2424: 2422: 2419: 2417: 2414: 2412: 2409: 2407: 2404: 2402: 2399: 2397: 2394: 2392: 2389: 2387: 2384: 2382: 2379: 2377: 2374: 2372: 2369: 2368: 2366: 2362: 2356: 2353: 2351: 2350:Plug and play 2348: 2346: 2343: 2341: 2340:Bus mastering 2338: 2336: 2333: 2331: 2328: 2326: 2323: 2321: 2318: 2316: 2315:Back-side bus 2313: 2311: 2308: 2306: 2303: 2302: 2300: 2296: 2292: 2289: 2285: 2283: 2278: 2271: 2266: 2264: 2259: 2257: 2252: 2251: 2248: 2242: 2239: 2236: 2232: 2227: 2222: 2218: 2213: 2212: 2193: 2189: 2183: 2172:September 26, 2167: 2160: 2153: 2142:September 26, 2137: 2133: 2127: 2121: 2116: 2105: 2099: 2083: 2077: 2061: 2057: 2050: 2034: 2028: 2012: 2008: 2002: 1988: 1984: 1978: 1964: 1960: 1954: 1948: 1943: 1929: 1925: 1919: 1911: 1907: 1901: 1899: 1897: 1889: 1877: 1870: 1864: 1857: 1846: 1842: 1836: 1828: 1822: 1815: 1810: 1796:on 2011-09-29 1795: 1791: 1785: 1769: 1762: 1755: 1744:September 30, 1739: 1735: 1729: 1727: 1715:September 26, 1710: 1709:Press release 1706: 1700: 1689:September 29, 1685: 1681: 1674: 1663:September 30, 1658: 1654: 1650: 1643: 1627: 1623: 1620:Raffo, Dave. 1616: 1605:September 29, 1601: 1600:Computerworld 1597: 1590: 1575: 1574:Network World 1571: 1564: 1554:September 28, 1549: 1545: 1541: 1534: 1532: 1520:September 28, 1516: 1515:Press release 1512: 1505: 1494:September 28, 1490: 1489:Internet News 1486: 1479: 1468:September 28, 1463: 1462:R&D World 1459: 1453: 1442:September 26, 1438: 1434: 1427: 1416:September 28, 1411: 1407: 1400: 1389:September 26, 1384: 1378: 1363: 1359: 1352: 1341:September 26, 1337: 1333: 1326: 1315:September 28, 1311: 1307: 1300: 1289:September 26, 1285: 1281: 1274: 1272: 1264: 1256:September 26, 1251: 1245: 1243: 1238: 1229: 1226: 1224: 1221: 1219: 1216: 1214: 1211: 1209: 1206: 1204: 1201: 1199: 1196: 1195: 1184: 1182:GbE to 40 GbE 1181: 1175: 1169: 1168: 1164: 1162:GbE to 10 GbE 1161: 1155: 1149: 1145: 1141: 1139:GbE to 50 GbE 1138: 1132: 1126: 1125: 1121: 1119:GbE to 40 GbE 1118: 1112: 1106: 1105: 1101: 1099:GbE to 10 GbE 1098: 1092: 1086: 1085: 1074: 1071: 1065: 1059: 1055: 1047: 1045:GbE to 25 GbE 1044: 1038: 1032: 1031: 1027: 1025:GbE to 10 GbE 1024: 1018: 1012: 1011: 1007: 1005:GbE to 10 GbE 1004: 998: 992: 991: 980: 977: 971: 965: 961: 957: 954: 951: 948: 945: 944: 938: 936: 932: 922: 920: 912: 908: 904: 900: 895: 891: 887: 883: 879: 874:ibv_post_send 867: 862: 860: 856: 852: 848: 844: 840: 836: 832: 822: 820: 815: 813: 809: 800: 789: 785: 782: 778: 775: 772: 768: 765: 764: 763: 755: 753: 749: 745: 735: 733: 728: 725: 713: 707: 703: 697: 696: 690: 687: 685: 682: 679: 676: 666: 665: 659: 656: 654: 651: 648: 645: 638: 633: 632: 628: 625: 622: 620: 617: 614: 611: 608: 605: 600: 599: 595: 592: 589: 587: 584: 581: 578: 576: 570: 565: 564: 560: 557: 554: 552: 549: 546: 543: 540: 535: 534: 530: 527: 524: 522: 519: 516: 513: 510: 505: 504: 500: 497: 494: 492: 489: 486: 483: 481: 475: 470: 469: 465: 462: 459: 457: 454: 451: 448: 445: 440: 439: 435: 432: 429: 427: 424: 421: 418: 415: 410: 409: 405: 402: 399: 397: 394: 391: 388: 386: 381: 375: 370: 369: 365: 362: 359: 356: 355: 348: 333: 327: 319: 314:Specification 311: 309: 304: 302: 297: 295: 290: 288: 284: 283:Fibre Channel 280: 276: 271: 268: 264: 260: 259:Virginia Tech 256: 253:In 2003, the 251: 249: 245: 241: 237: 233: 229: 227: 223: 222:Fibre Channel 219: 215: 211: 207: 203: 199: 195: 191: 187: 183: 179: 175: 165: 163: 159: 155: 154:Fibre Channel 151: 146: 144: 140: 136: 133:(acquired by 132: 128: 126: 122: 119: 115: 111: 108:and very low 107: 103: 99: 95: 89: 88:ticker symbol 85: 75: 71: 67: 63: 60: 56: 52: 48: 44: 40: 36: 32: 28: 23: 3023:Serial buses 2515: 2491:TURBOchannel 2281: 2216: 2195:. Retrieved 2191: 2182: 2170:. Retrieved 2165: 2152: 2140:. Retrieved 2135: 2126: 2115: 2098: 2086:. Retrieved 2076: 2066:19 September 2064:. Retrieved 2059: 2049: 2039:19 September 2037:. Retrieved 2027: 2015:. Retrieved 2011:the original 2001: 1990:. Retrieved 1986: 1977: 1966:. Retrieved 1962: 1953: 1942: 1931:. Retrieved 1927: 1918: 1909: 1886: 1880:. Retrieved 1875: 1863: 1854: 1848:. Retrieved 1844: 1841:"Interfaces" 1835: 1821: 1809: 1798:. Retrieved 1794:the original 1784: 1774:13 September 1772:. Retrieved 1767: 1754: 1742:. Retrieved 1738:the original 1713:. Retrieved 1708: 1699: 1687:. Retrieved 1683: 1673: 1661:. Retrieved 1657:the original 1652: 1642: 1630:. Retrieved 1626:the original 1615: 1603:. Retrieved 1599: 1589: 1577:. Retrieved 1573: 1563: 1552:, retrieved 1547: 1543: 1518:. Retrieved 1514: 1504: 1492:. Retrieved 1488: 1478: 1466:. Retrieved 1461: 1452: 1440:. Retrieved 1437:The Register 1436: 1426: 1414:. Retrieved 1410:the original 1399: 1387:. Retrieved 1377: 1365:. Retrieved 1361: 1351: 1339:. Retrieved 1335: 1325: 1313:. Retrieved 1309: 1299: 1287:. Retrieved 1283: 1261: 1254:. Retrieved 1072:GbE to 5 GbE 928: 877: 863: 828: 816: 805: 783:transmission 761: 741: 729: 719: 706: 683: 652: 618: 585: 550: 520: 490: 455: 425: 395: 325: 317: 305: 298: 291: 272: 252: 230: 214:machine room 171: 161: 156:, and Intel 147: 129: 97: 93: 92: 58:Headquarters 2964:CoreConnect 2943:ExpressCard 2871:Thunderbolt 2861:Camera Link 2644:Bus and Tag 2330:Address bus 2325:Control bus 2320:Daisy chain 2197:January 28, 2132:"Verbs API" 1963:NVIDIA Docs 1928:NVIDIA Docs 1845:NVIDIA Docs 1816:// Mellanox 1263:interfaces. 894:BSD license 721:connectors 376:2001, 2003 322:Performance 240:PCI Express 116:and uses a 3017:Categories 2817:ACCESS.bus 2716:Peripheral 2516:InfiniBand 2511:HP GSC bus 2305:System bus 2168:. Mellanox 2084:. Mellanox 2035:. Mellanox 1992:2024-03-19 1968:2023-11-12 1933:2023-11-12 1882:2023-11-12 1850:2023-11-12 1800:2009-10-27 1404:Kim, Ted. 1383:"Timeline" 1234:References 931:bandwidths 917:, for its 915:libibverbs 855:VMware ESX 609:256b/257b 347:Throughput 340:Line code 106:throughput 94:InfiniBand 2778:Lightning 2728:Atari SIO 2603:SpaceWire 2436:Zorro III 2376:S-100 bus 2371:SS-50 bus 2364:Standards 2284:standards 2277:Technical 2226:1105.1827 2062:. FreeBSD 880:API. The 781:multicast 544:25.78125 349:(Gbit/s) 198:Microsoft 158:Omni-Path 34:Formation 3004:Category 2979:Wishbone 2952:Embedded 2931:Portable 2851:Profibus 2783:DMX512-A 2669:Parallel 2521:Ethernet 2431:Zorro II 2381:Multibus 2282:de facto 1544:Infostor 1362:O'Reilly 1336:EE Times 1192:See also 988:2.5 GbE 845:(SLES), 758:Messages 748:Ethernet 738:Topology 596:<0.6 514:14.0625 484:10.3125 306:In 2019 255:System X 232:Mellanox 150:Ethernet 131:Mellanox 114:scalable 2984:SLIMbus 2938:PC Card 2922:TOSLINK 2612:Storage 2566:RapidIO 2446:FASTBUS 2401:STD Bus 2298:General 2231:Bibcode 2088:30 July 2017:30 July 1684:HPCwire 1632:29 July 1579:19 June 1367:28 July 903:FreeBSD 847:Windows 835:FreeBSD 831:Solaris 771:channel 754:(QoS). 612:106.25 579:53.125 528:163.64 525:109.08 480:64b/66b 248:Hitachi 218:cluster 204:of the 168:History 110:latency 69:Website 50:Purpose 2917:S/PDIF 2808:1-Wire 2773:RS-485 2768:RS-423 2763:RS-422 2758:RS-232 2619:ST-506 2576:NVLink 2426:STEbus 2386:Unibus 2192:NADDOD 2138:. 2020 1876:nVidia 1082:5 GbE 1052:5 GbE 905:, and 857:, and 517:13.64 385:8b/10b 308:Nvidia 279:QLogic 226:fabric 192:, and 186:Compaq 135:Nvidia 125:TOP500 84:Ibotta 64:, U.S. 2912:McASP 2880:Audio 2825:SMBus 2821:PMBus 2803:UNI/O 2743:HP-IL 2696:SATAe 2681:ESCON 2654:HIPPI 2486:NuBus 2441:CAMAC 2411:Q-Bus 2406:SMBus 2391:VAXBI 2288:wired 2221:arXiv 2162:(PDF) 2107:(PDF) 1872:(PDF) 1856:rate. 1764:(PDF) 1208:iWARP 949:Lanes 899:Linux 878:verbs 851:HP-UX 698:Notes 691:4800 688:3200 660:2400 657:1600 639:2024 626:1200 606:2022 571:2018 541:2014 521:54.54 511:2011 476:2011 472:FDR10 446:2007 416:2005 337:Year 267:Linux 210:PCI-X 174:Intel 2969:AMBA 2907:MADI 2892:AES3 2753:MIDI 2706:NVMe 2702:AHCI 2664:SCSI 2649:DSSI 2624:ESDI 2501:SBus 2461:EISA 2396:MBus 2286:for 2279:and 2199:2023 2174:2021 2144:2021 2090:2014 2068:2018 2041:2018 2019:2014 1776:2014 1746:2021 1717:2021 1691:2021 1665:2021 1634:2014 1607:2021 1581:2024 1556:2021 1522:2021 1496:2021 1470:2021 1444:2021 1418:2021 1391:2021 1369:2014 1343:2021 1317:2021 1291:2021 1258:2021 1147:QDR 1057:DDR 963:SDR 946:Type 890:GPL2 812:QSFP 684:1600 680:400 677:400 649:200 646:200 623:800 615:100 593:600 590:400 575:PAM4 561:0.5 558:300 555:200 531:0.7 501:0.7 498:120 466:1.3 436:2.5 389:2.5 366:12x 246:and 182:Dell 180:and 141:and 42:Type 37:1999 2973:AXI 2902:I²S 2856:USB 2841:D²B 2836:SPI 2831:I3C 2813:I²C 2748:HIL 2733:DCB 2704:or 2691:SSA 2674:SAS 2634:SMD 2629:IPI 2551:AGP 2541:PXI 2531:PCI 2526:UPA 2506:VLB 2496:MCA 2481:VPX 2476:VXS 2471:VXI 2466:VME 2451:LPC 2421:ISA 1653:CIO 1550:(2) 1067:000 975:2.5 973:000 919:AIX 911:IBM 892:or 872:or 859:AIX 819:CXP 786:an 673:TBA 668:GDR 653:800 635:XDR 619:400 602:NDR 586:200 582:50 567:HDR 551:100 547:25 537:EDR 507:FDR 495:80 487:10 463:96 460:64 449:10 442:QDR 433:48 430:32 412:DDR 403:24 400:16 380:NRZ 372:SDR 363:8x 360:4x 357:1x 206:PCI 190:IBM 86:'s 3019:: 2823:, 2819:, 2229:, 2219:, 2190:. 2164:. 2134:. 2058:. 1985:. 1961:. 1926:. 1908:. 1895:^ 1885:. 1874:. 1853:. 1843:. 1766:. 1725:^ 1707:. 1682:. 1651:. 1598:. 1572:. 1548:10 1546:, 1542:, 1530:^ 1513:. 1487:. 1460:. 1435:. 1360:. 1334:. 1308:. 1282:. 1270:^ 1260:. 1241:^ 1179:40 1177:00 1171:00 1159:10 1157:00 1151:00 1136:60 1134:00 1130:12 1116:40 1114:00 1108:00 1096:20 1094:00 1088:00 1061:00 1042:30 1040:00 1036:12 1022:20 1020:00 1014:00 1002:10 1000:00 994:00 967:00 909:. 901:, 861:. 853:, 849:, 841:, 837:, 833:, 779:a 769:a 629:? 491:40 456:32 452:8 426:16 422:4 419:5 406:5 392:2 228:. 216:, 188:, 164:. 152:, 98:IB 2975:) 2971:( 2827:) 2815:( 2269:e 2262:t 2255:v 2233:: 2223:: 2201:. 2176:. 2146:. 2109:. 2092:. 2070:. 2043:. 2021:. 1995:. 1971:. 1936:. 1912:. 1829:. 1803:. 1778:. 1748:. 1719:. 1693:. 1667:. 1636:. 1609:. 1583:. 1524:. 1498:. 1472:. 1446:. 1420:. 1393:. 1371:. 1345:. 1319:. 1293:. 1173:4 1153:1 1128:0 1110:8 1090:4 1080:0 1076:0 1069:5 1063:1 1050:0 1034:0 1016:8 996:4 986:0 982:0 969:1 726:. 396:8 96:( 90:.

Index


Beaverton, Oregon
infinibandta.org
Ibotta
ticker symbol
high-performance computing
throughput
latency
scalable
switched fabric
network topology
TOP500
Mellanox
Nvidia
host bus adapters
network switches
Ethernet
Fibre Channel
Omni-Path
Intel
Sun Microsystems
Dell
Compaq
IBM
Hewlett-Packard
Microsoft
interconnect bottleneck
PCI
PCI-X
machine room

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.