#GeForceRTX4090

[govindhtech]

How LM Studio Accelerates Larger LLMs Quickly On RTX

LM Studio

The AI Decoded series introduces new hardware, software, tools, and accelerations for GeForce RTX PC and NVIDIA RTX workstation users and demystifies AI.

Productivity is changing as a result of large language model (LLM). They can write documents, summarize webpages, and, with extensive training on a wide range of data, provide precise answers to inquiries about almost any subject.

Digital assistants, conversational avatars, and customer support agents are just a few of the new applications of generative AI that rely heavily on LLMs.

Many of the most recent LLMs are capable of operating locally on workstations or PCs. For a number of reasons, this is helpful: users may use AI without the internet, keep chats and content secret on-device, or just utilize the potent NVIDIA GeForce RTX GPUs in their system. Other models require hardware at huge data centers due to their size and complexity, which prevents them from fitting into the local GPU’s visual memory (VRAM).

However, RTX-powered PCs can use a method called GPU offloading to locally speed up a portion of a task on a data-center-class model. As a result, users can take advantage of GPU acceleration without being constrained by GPU memory.

Size and Quality vs. Performance

There is a trade-off between performance, response quality, and model size. Larger machines typically produce better results but operate more slowly. Performance increases while quality decreases with smaller models.

It’s not always easy to make this trade-off. In certain situations, performance may be more crucial than quality. Because it can operate in the background, certain users might place a higher priority on accuracy for use cases like content production. On the other hand, a conversational assistant must respond accurately and quickly.

Tens of gigabytes in size, the most accurate LLMs are made to operate in a data center and might not fit in a GPU’s memory. Normally, this would stop the application from utilizing GPU acceleration.

But with GPU offloading, some of the LLM is used on the CPU and some on the GPU. This enables users, irrespective of model size, to fully benefit from GPU acceleration.

Optimize AI Acceleration With GPU Offloading and LM Studio

With an intuitive interface that enables a great deal of modification in the way those models function, LM Studio is a program that enables users to download and host LLMs on their desktop or laptop computer. Since LM Studio is based on llama.cpp, it is completely compatible with GeForce RTX and NVIDIA RTX graphics cards.

Even if the model cannot be fully loaded into VRAM, LM Studio and GPU offloading use GPU acceleration to improve the speed of a locally hosted LLM.

LM Studio separates the model into smaller sections, or “subgraphs,” which stand in for layers of the model architecture, in order to facilitate GPU offloading. Subgraphs are loaded and unloaded on the GPU as needed rather than being fixed there permanently. The GPU offloading slider in LM Studio allows users to control how many of these layers are handled by the GPU.

Consider employing this GPU offloading method on a large model, such as the Gemma 2 27B. The number of parameters in the model, shown by “27B,” provides an estimate of the amount of memory needed to run the model.

Each parameter uses half a byte of memory, according to 4-bit quantization, a method for shrinking an LLM without appreciably lowering accuracy. Accordingly, the model should need roughly 13.5 billion bytes, or 13.5GB, plus some overhead, which typically falls between 1 and 5GB.

The GeForce RTX 4090 desktop GPU has 19GB of VRAM, which is needed to fully accelerate this model on the GPU. The model can operate on a system with a less powerful GPU and still gain acceleration with to GPU offloading.Image credit to NVIDIA

It is feasible to evaluate the performance impact of varying GPU offloading levels in LM Studio in comparison to CPU-only. The results of executing the same query on a GeForce RTX 4090 desktop GPU at various offloading settings are displayed in the table below.Image credit to NVIDIA

Even customers with an 8GB GPU can get a noticeable speedup on this specific model as compared to those who solely utilize CPUs. Naturally, a smaller model that completely fits in GPU memory can always operate on an 8GB GPU and receive full GPU acceleration.

Achieving Optimal Balance

The GPU offloading feature of LM Studio is an effective tool for maximizing the performance of data center-specific LLMs, such as Gemma 2 27B, locally on RTX AI PCs. It enables access to larger, more intricate models on all PCs with GeForce RTX and NVIDIA RTX GPUs.

Read more on govindhtech.com

[teknolojihaber]

GeForce RTX 4090 ekran kartlarının güç konektörleri yük altında hâlâ eriyor

GeForce RTX 4090 ekran kartlarının konektörler ve güç adaptörleri erimeye devam ediyor. Bu ekran kartlarının piyasaya sürülmesinden bir yıl sonra bile sorun ortadan kalkmadı. Nvidia, sonunda güç konektörlerini orijinal 12VHPWR'den yeni 12V-2x6'ya yükseltti, ancak bunların yük altında erimesi sorunu, CableMod'un bunlara dayalı özel güç adaptörlerini piyasaya sürmesiyle yeniden gündeme geldi. CableMod sonuçta dik açılı güç adaptörlerini geri çağırdı ve müşterilere para iadesi teklif etti. Ayrıca şirket, ekran kartlarına verilen zarar��n tazminini taahhüt etti. Analize göre yaklaşık 74 bin dolar tutarındaydı . Güç adaptörlerinin resmi olarak geri çağrılmasından önce bile CableMod, bunların erime vakalarıyla karşılaştı . Üreticiler suçu birbirlerine yüklediler ve sonunda güç kablosu ve adaptör tedarikçilerini suçladılar. Böyle bir ürünü desteklemek imkansız hale geldi. Video kartı onarım şirketi NorthridgeFix'e göre CableMod aslında iyi bir ürün ortaya çıkardı. Ancak doğası gereği zayıf bir temel üzerine inşa edilmiştir: 12+4 pinli veya 16 pinli konnektör olarak da adlandırılan yeni 12VHPWR standardı. Nvidia artık tüm GeForce RTX 40 serisi grafik kartlarını yeni 12V-2x6 konnektörle gönderiyor. Konektörün sokete tam olarak takılmaması durumunda GPU'ya ek güç sağlanmasını önleyen daha kısa sinyal pinlerine sahiptir. Ancak buna rağmen servis merkezi, eriyen güç konektörleri nedeniyle hasarlı GeForce RTX 40 serisi ekran kartlarını almaya devam ediyor. NorthridgeFix'e göre geçen ay bu yanmış konnektörlerin yaklaşık 200'ü değiştirildi. Bir şirket çalışanı, sözlerini doğrulamak için bir kutu dolusu yanmış ve daha sonra değiştirilen konnektörleri gösterdi. Ancak NorthridgeFix tarafından yayınlanan videoda bunların hangi konnektörlerin eski veya yeni olduğu belirtilmiyor. Nvidia ve ortakları, GeForce RTX 40 serisi video kartlarıyla yalnızca video kartlarının kendisinde bulunan yerel adaptörlerin veya güç kaynaklarıyla birlikte verilen orijinal güç kablolarının kullanılmasını önermektedir. Üçüncü taraf güç adaptörleri ve konektörleri, özellikle konektör konektöre düzgün şekilde bağlanmadığında aşırı ısınma ve erime riski taşır. Bazı durumlarda yük altında 600 W tüketebilen GeForce RTX 40 serisi grafik kartları ve özellikle RTX 4090 sahipleri, grafik hızlandırıcılarındaki güç konnektörlerinin durumuna daha yakından bakmalı. NorthridgeFix tarafından yayınlanan videoda ayrıca hasarlı güç konnektörünün sökülüp yenisiyle değiştirilmesi süreci de gösteriliyor. Nvidia'nın yeni nesil GeForce RTX ekran kartlarını geliştirirken konnektör erimesi sorununa daha dikkatli yaklaşacağına inanıyorum. Aynı AMD ve Intel daha önce de güvenilmezliği nedeniyle 12VHPWR ve 12V-6X2 güç konektörlerini gelecekteki ekran kartlarında kullanmayı planlamadıklarını belirtmişlerdi. https://www.youtube.com/watch?v=NgJgoIWP9fA&embeds_referring_euri=https3dnews-ru.translate.goog1103219konnektori-pitaniya-videokart-geforce-rtx-4090-popregnemu-plavyatsya-pod-nagruzkoy-odin&source_ve_path=MjM4NTE&feature=emb_title Read the full article

[luckyfalconcomputer]

PNY

Unleash the Future of Gaming and Creation with PNY's 40's Series Graphic Cards! Experience the Power of GeForce RTX 4090 and GeForce RTX 4080 16GB, fueled by NVIDIA's Ada Lovelace Architecture. Elevate Your Performance with Neural Rendering and Cutting-Edge Platform Capabilities.

[marcdecaria]

Tweaking the pc. #GPUupgrade #gpu #msi4090 #graphiccard #liquidcooling #4090 #geforcertx4090 #msisuprimx #vrgaming #pcgaming https://www.instagram.com/p/CnaT4E_pCEm/?igshid=NGJjMDIxMWI=

[govindhtech]

RAPIDS cuDF Boosts Python Pandas On RTX-powered AI PCs

This article is a part of the AI Decoded series, which shows off new RTX workstation and PC hardware, software, tools, and accelerations while demystifying AI by making the technology more approachable.

AI is fostering innovation and increasing efficiency across sectors, but in order to reach its full potential, the system has to be trained on enormous volumes of high-quality data.

Data scientists are crucial to the preparation of this data, particularly in domain-specific industries where improving AI skills requires specialized, sometimes private data.

NVIDIA revealed that RAPIDS cuDF, a library that makes data manipulation easier for users, speeds up the pandas software library without requiring any code modifications. This is intended to assist data scientists who are facing a growing amount of labor. Pandas is a well-liked, robust, and adaptable Python computer language data analysis and manipulation toolkit. Data scientists may now utilize their favorite code base without sacrificing the speed at which data is processed with RAPIDS cuDF.

Additionally, NVIDIA RTX AI hardware and technology help speed up data processing. Proficient GPUs are among them, providing the computing capacity required to swiftly and effectively boost AI across the board, from data science operations to model training and customization on PCs and workstations.

Python Pandas

Tabular data is the most often used data format; it is arranged in rows and columns. Spreadsheet programs such as Excel may handle smaller datasets; however, modeling pipelines and datasets with tens of millions of rows usually need data frame libraries in Python or other programming languages.

Because of the pandas package, which has an intuitive application programming interface (API), Python is a popular option for data analysis. However, pandas has processing speed and efficiency issues on CPU-only systems as dataset volumes increase. enormous language models need enormous datasets with a lot of text, which the library is infamously bad at handling.

Data scientists are presented with a choice when their data needs exceed pandas’ capabilities: put up with lengthy processing times or make the difficult and expensive decision to migrate to more complicated and expensive technologies that are less user-friendly.

RAPIDS cuDF-Accelerated Preprocessing Pipelines

Data scientists may utilize their favorite code base without compromising processing performance using RAPIDS cuDF.

An open-source collection of the Python packages with GPU acceleration called RAPIDS is intended to enhance data science and analytics workflows. A GPU Data Frame framework called RAPIDS cuDF offers an API for loading, filtering, and modifying data that is similar to pandas.Image credit to Nvidia

Data scientists may take use of strong parallel processing by running their current pandas code on GPUs using RAPIDS cuDF‘s “pandas accelerator mode,” knowing that the code will transition to CPUs as needed. This compatibility offers cutting-edge, dependable performance.

Larger datasets and billions of rows of tabular text data are supported by the most recent version of RAPIDS cuDF. This makes it possible for data scientists to preprocess data for generative AI use cases using pandas code.

NVIDIA RTX-Powered AI Workstations and PCs Improve Data Science

A recent poll indicated that 57% of data scientists use PCs, desktops, or workstations locally.

Significant speedups may be obtained by data scientists beginning with the NVIDIA GeForce RTX 4090 GPU. When compared to conventional CPU-based solutions, cuDF may provide up to 100x greater performance with NVIDIA RTX 6000 Ada Generation GPUs in workstations as datasets expand and processing becomes more memory-intensive.Image credit to Nvidia

With the NVIDIA AI Workbench, data scientists may quickly become proficient with RAPIDS cuDF. Together, data scientists and developers can design, collaborate on, and move AI and data science workloads across GPU systems with our free developer environment manager powered by containers. Several sample projects, like the cuDF AI Workbench project, are available on the NVIDIA GitHub repository to help users get started.

Additionally, cuDF is pre-installed on HP AI Studio, a centralized data science platform intended to assist AI professionals in smoothly migrating their desktop development environment to the cloud. As a result, they may establish, work on projects together, and manage various situations.

Beyond only improving performance, cuDF on RTX-powered AI workstations and PCs has further advantages. It furthermore

Offers fixed-cost local development on strong GPUs that replicates smoothly to on-premises servers or cloud instances, saving time and money.

Enables data scientists to explore, improve, and extract insights from datasets at interactive rates by enabling faster data processing for quicker iterations.

Provides more effective data processing later on in the pipeline for improved model results.

A New Data Science Era

The capacity to handle and analyze large information quickly will become a critical difference as AI and data science continue to advance and allow breakthroughs across sectors. RAPIDS cuDF offers a platform for next-generation data processing, whether it is for creating intricate machine learning models, carrying out intricate statistical analysis, or investigating generative artificial intelligence.

In order to build on this foundation, NVIDIA is supporting the most widely used data frame tools, such as Polaris, one of the fastest-growing Python libraries, which out-of-the-box dramatically speeds up data processing as compared to alternative CPU-only tools.

This month, Polars revealed the availability of the RAPIDS cuDF-powered Polars GPU Engine in open beta. Users of Polars may now increase the already blazingly fast dataframe library’s speed by up to 13 times.

Read more on govindhtech.com

[govindhtech]

MSI X870E: ATX 3.1 Ready Motherboard For Next-Gen PCs

Introducing a revolutionary feature to its MSI X870E series motherboards gives MSI great pleasure. This cutting-edge technology, which offers the additional power needed for AI computation and GPU-intensive applications, was created with professionals and gamers in mind. With its inbuilt 8-pin PCIe power connector, the supplemental PCIe Power feature provides more power to GPUs that require more watts, enabling them to operate at their best. When combined with the ATX 3.1 power standard, which can withstand a 2.5x power excursion for improved power delivery and reliability, this feature guarantees steady, effective, and prolonged performance even when faced with high loads. For the most demanding conditions, this additional PCIe Power gives unparalleled reliability and stability, whether gaming or handling complicated programs.

Supplemental PCIe Power: What Is It?

Consider it an additional motherboard battery pack. The motherboard‘s 24-pin power socket provides 12V electricity to the system, which powers the RGB extensions, fans, and PCIe interface in general. Even still, the additional PCIe power makes sure everything functions properly when your PC is stressed, such as when playing very graphically demanding games or using all of the fan dissipation for optimal performance.

- Advertisement -

With more power, you can work more efficiently, play games longer, and use your PC to its full potential without worrying about power outages or unstable systems. The Supplemental PCIe Power guarantees that your system remains stable and operates at peak efficiency, regardless of whether you’re running sophisticated AI programs or immensely demanding games. It’s like knowing that whatever you put at it, your system will keep up.

ATX 3.1

Motherboards from MSI X870E series are prepared to accommodate the most recent ATX 3.1 and PCIe 5.1 standards, offering the best basis for computing that will last into the future. Users can now run even the most demanding a games and apps with confidence thanks to the Supplemental PCIe Power feature, since their system is supported by MSI’s cutting-edge power management technology and ready to handle future increases in processing power requirements.

MAG X870 TOMAHAWK WIFI

Key Features of Power Management Broken Down

MAG X870 TOMAHAWK WIFI motherboard is one way MSI caters to performance-hungry customers. Imagine using it with the cutting-edge GeForce RTX 4090 SUPRIM X 24G GPU and AMD Ryzen 9950X processor. These components use a lot of electricity while operating at maximum load. Generally, the 24-pin 12V power connector on the motherboard is limited to 168W of power. This may be sufficient for simple activities, but when trying to push everything to its limits, particularly with RGB lighting, fans, and a powerful GPU like the 4090 connected, it becomes insufficient.

The MSI 8-pin Supplemental PCIe Power Connector comes into play in this situation. This extra connector on the MAG X870 TOMAHAWK WIFI offers up to 252W of additional power, making sure that everything has adequate power to function as intended. The combined power output of the 24-pin and 8-pin connectors is 420W, which provides the system with enough headroom to function properly even in the most taxing circumstances.

- Advertisement -

MSI X870E Motherboards

For users, what does this mean? The MSI X870E motherboards are guaranteed to offer the steady, reliable power required to manage high-end GPU performance and optimized system cooling at the same time thanks to the Supplemental PCIe Power. Whether adding a second GPU or overclocking a 4090 GPU, these motherboards are well-suited to handle the upcoming generation of power-hungry components, providing performance and stability. for AI demanding processing workloads.

The ATX 3.1 / 3.0 Ready PCIe5 PSU series from MSI provides reliable and effective power delivery for all connected devices, fully supporting the extra 8-pin PCIe power need. This includes strong support for all MEG, MPG, and MAG types, guaranteeing effective power distribution across the motherboard and any attached peripherals.

X870E Motherboard price

The price of an X870E motherboard can vary depending on the manufacturer, features, and retailer. On average, similar embedded or specialized ARM-based boards like the X870E might range from $50 to $150 USD

X870E Release Date

The MSI X870E series motherboards with Supplemental PCIe Power will be available for purchase on September 26.

Read more on govindhtech.com

[govindhtech]

HP Omen 27qs 240 Hz Gaming Monitor: Great Value & Results

Two gaming monitor value options exist. Some low-cost displays sacrifice features. The second kind sacrifices nothing and delivers 98% of premium screen performance for 30% of the cost. That category has many 27-inch QHD panels.

HP’s Omen display series offers good gaming performance, accurate and saturated color, and sturdy build quality for the price. My test product is the 27qs, a sweet spot product. The 27-inch IPS QHD monitor has 240 Hz, Adaptive-Sync, HDR, and wide gamut. Let’s look.

The Omen 27qs has a QHD (2560×1440) IPS panel. Ideal pixel density is 109ppi. It’s ideal because it produces sharp images with less processing than 4K’s 8.3 million pixels.

HP’s Adaptive-Sync and front-mounted G-Sync badge indicate Nvidia certification for premium video processing. You also get an effective backlight strobe (MPRT), that almost eliminates the phasing artifact on many other monitors. It’s a good alternative to Adaptive-Sync and works up to 240 Hz on the Omen 27qs. Multiple artifact-free options and smooth motion resolution make the overdrive well-implemented.

Very accurate color and a wide gamut mode that covers 90% of DCI-P3 ensure picture quality. VESA DisplayHDR 400 supports HDR10. My tests showed over 500 nits peak with a nice bump from 9,000:1 thanks to eight-zone edge dimming.

Standard gaming features include aiming points, timers, frame rate counters, and alignment marks. An LED ring in the back plays different colors and effects for light shows. HP’s sturdy chassis is built for long-term use.

Accessories and Assembly

HP Omen 27qs packaging is mostly plastic-free and foam-free. A few Teflon bits prevent scratching on molded cardboard pulp. A captive bolt connects the base and upright, and the panel snaps on. Fasteners and a 100mm VESA pattern are protected by a plastic shroud. The bundle includes high-quality USB and DisplayPort cables and IEC power for the internal supply. A metal VESA mount adapter is included.

No sharp corners or molded trim lines define the Omen 27qs’s sleek design. The white Omen logo is the only decoration on the front. An oversized version with a smooth taper is on the back. HP’s diamond motif appears on the LED ring, square base, and tiny white power LED.

The minimalist stand is sturdy enough to prevent wobbling. Ergonomics include 3.9-inch height adjustment and 5/20-degree tilt. Despite not swiveling, the base pivots as a unit on the desktop, allowing for unlimited swivel adjustment. Also included is a 90-degree portrait mode. Using a snap-on clip keeps cables tidy.

The usual up-and-under input panel has two HDMI 2.0 and one DisplayPort 1.4. The latter supports 55-240 Hz FreeSync and G-Sync. USB 3.2 has one upstream and two downstream ports. Plug headphones into the 3.5mm jack or use the three-watt internal speakers, which sound better than most. Their frequency range is wide and they play loudly without distortion.

OSD Features

The HP Omen 27qs uses nav pad keys with four directionals and a central selector instead of a joystick. Separate button toggles power. A quick menu opens with any key press, and the full OSD appears with a second select button press.

The Omen 27qs OSD has another diamond in the top left corner. Gaming has all video processing options. You get a five-level overdrive without trail artifacts until level four. MPRT, the backlight strobe, has five pulse widths. High settings reduce blur but reduce light output. Four was my test level. Level five is dark and best used in a dark room. Aiming point, frame rate indicator, and timer are available.

The rear LED ring can play three moving effects or be static. Variable breathing speed, and Random Color changes hue every five seconds to an hour. You can also turn off or adjust all effects’ brightness over 10 steps.

In the Image menu, you can enable dynamic contrast for SDR content that uses field dimming to reach 5,000:1. In HDR mode, the screen’s bottom backlight array dims eight vertical zones.

HP’s picture modes are unique and thoughtful. All eight Omen 27qs presets can be calibrated with RGB sliders. A gamma control is the only thing missing. Standard is the default and nearly matches the sRGB gamut, 2.2 gamma, and 6500K color temp. Native provides wide gamut SDR color. It needs calibration but looks great afterward.

The Audio menu has Voice, Music, and Video modes. Each is unique and favors different frequencies. You can assign the four directional buttons to quickly access color mode, brightness, and more in the Menu section.

HP Omen 27qs Calibration

To use sRGB color for SDR content, leave the Omen 27qs in Standard mode. No calibration or adjustments are needed. It matches grayscale, gamma, and color. Choose Native for SDR wide gamut color. It needs tweaking due to its slight blue tint. Auto-switching HDR signals gray out all picture controls. Its edge zone dimming and color accuracy give it over 9,000:1 contrast.

Game and Hands-on

The best thing about 27-inch QHD gaming monitors is that they do everything well yet are affordable. You can increase resolution by buying a more expensive display and video card and sacrificing frame rates. Higher speed requires sacrificing pixel density and paying more for 360 or 500 Hz.

It was ideal for a single daily monitor. Though measured average color gamut volume, high accuracy made using the wide gamut for SDR enjoyable. The pixel-free image is sharp. A density of 109ppi delivers most of Ultra HD’s clarity and allows higher gaming frame rates.

Doom Eternal was hard to leave due to the Omen 27qs’ premium feel and response. Virtually no input lag and super-fast panel response. Overdrive was perfectly tuned to eliminate motion blur. We could use the backlight strobe instead of Adaptive-Sync without penalty. A GeForce RTX 4090 video card locked frame rates at 240fps, preventing tearing. MPRT works without obvious phasing. Level 3 balanced light output and motion resolution. To offset narrow pulse widths, overhead brightness is ample.

Audio quality from the Omen 27qs impressed me. This is exceptionally clear and full. Quality op-amps allowed me to crank the volume past a comfortable level without distortion

Takeaway: The Omen 27qs offers great value with premium gaming and everyday usability. Its vibrant image is perfect for work or play. It can satisfy casual and professional gamers with its excellent video processing and low input lag.

Read more on Govindhtech.com

[govindhtech]

Power Up! Seasonic’s New 12V-2×6 Cable Exclusive Beta

Seasonic’s 12V-2×6 Cable Guide

Coming shortly, Seasonic’s 90-degree angled 12V-2×6 Cable power connection cables will support the next generation of GPUs.

Seasonic Launches Angled Power Connector Cables for PSUs and Next-Gen GPUs: Out: 12VHPWR, In: 12V-2×6 Cable.

The 12VHPWR connection started poorly and was incompatible with the finest NVIDIA GeForce RTX 4090 GPUs due to melting and burning. The 12V-2×6 connection cable was created by PCI-SIG and power supply manufacturers to overcome these issues. AIBs’ new GPUs and PSUs will come with this connection and cables.

Seasonic, a leading PSU manufacturer, produced 12V-2×6 Cable connection cables. These wires are L-shaped and 90° angled. The new ATX 3.1 PSU series will come with these cables, and Seasonic ATX 3.0 PSU (FOCUS/Vertex/PRIME) owners may request free shipment.

User ownership of the Seasonic PSU and 12VHPWR graphics card must be validated. The first users will get these connections on January 10, followed by a general release later in the month. These new 12V-2×6 Cable connection cords correspond with the planned debut of the NVIDIA GeForce RTX 40 SUPER GPU family, which will fully leverage the new power interface, as shown in this ASUS RTX 4070 .

Seasonic recently advised consumers to bend the 12VHPWR/12V-2×6 Cable connection wires using a hair dryer before installing a graphics card in a PC. An angled connection lets you use the graphics card without bending the cord with a heat source; simply plug it in and enjoy. Seasonic has listed numerous benefits for their angled 12V-2×6 Cable connection (via Seasonic / Machine Translated):

The 90-degree L-shaped interface saves space and allows secure chassis side panel closure.

Integrated molding, improved terminal construction, and high-current alloy copper right angle terminals.

The 16AWG high-spec wire diameter provides reliable connections and precision wire and terminal welding.

PCIe CEM 5.1 and ATX 3.1 compliant, 600W power output.

The delicately woven embossed thread enhances the masterpiece.

Expect more GPU and PSU manufacturers to implement angled designs like this one by 2024.

Read more on Govindhtech.com

[govindhtech]

AI Concerns Recall RTX 4090 using Nividias gaming powerhouse

RTX 4090 and RTX 6000 Ada

The United States government has prohibited Nvidia from importing its most powerful gaming GPU from China. As a result, the chipmaker has removed the RTX 4090 from its listings owing to worries over artificial intelligence, but they have left the RTX 6000 Ada in the market.

On the Chinese version of Nvidia’s website, you may still find listings for workstation-grade RTX 6000 Ada systems. According to the most recent set of regulations governing commerce in the United States, the company’s most powerful graphics card, the RTX 6000 Ada, is among the goods that are prohibited from being sent to China, along with certain other countries.

In point of fact, the RTX 6000 Ada is a very good fit for the training of artificial intelligence due to the fact that it has a tiny blower cooler and 48 GB of memory. In contrast, VideoCardz found that Nvidia and its partners no longer offer the GeForce RTX 4090 graphics card in China, and the company has removed any mention of the consumer product from its Chinese website.

One of the best graphics cards available, the Nvidia GeForce RTX 4090, is based on the AD102 graphics processing unit and has a total processing performance score of 5,280 (based on its FP8 Tensor FLOPS performance of 660 TFLOPS). This score makes it an export-licensable item because its TPP is higher than 4,800. Nvidia and its partners are now need to seek an export license from the United States Department of Commerce in order to send GeForce RTX 4090 devices to China.

This requirement was previously not in place. Since such licensing applications are reviewed with the expectation that they will be denied, it appears that Nvidia would prefer not to sell its GeForce RTX 4090 in China.

Given the aforementioned information, it is puzzling that the business continues to offer its RTX 6000 Ada Generation graphics board for use by professionals in China. This solution uses the AD102 graphics processing unit, which has 18,176 CUDA cores active, giving it a total processing performance score of 5,828 (based on its 728.5 FP8 TFLOPS performance without sparsity). Because this graphics card has 48 gigabytes of RAM, it is actually a better choice for artificial intelligence training and inference than the GeForce RTX 4090, which is designed for consumers.

What is perhaps more important is that Generation comes with a compact blower cooling system. This makes it easy to use in data center environments and makes it useful both for AI training / inference jobs as well as high-performance computing, as it supports FP64 without any constraints.

Read more on Govindhtech.com