News
Be prepared, GPU price increase incoming --> Samsung sells out 100% of all 2027 HBM capacity - HBM prices expected to jump 200% next year, DRAM prices expected to see a double-digit price increase
Take care of your hardware, everyone! Use a UPS, keep the dust off, shit, I dunno. We should put together maintenance schedules, we need this shit to last!
How often should I change my GPU's oil? Every 5M tokens? And should I touch the blinker fluid?
Seriously though, unless you have a full water-cooled rig there's not much to really maintain. Probably a yearly dusting (or sooner depending on your environment) and keep an eye on temps. If you start seeing those creeping up, it's probably time to swap out pads/paste. Hell, even with my water-cooled build I've set it up to be pretty hands-off, using EPDM w/ clear coolant and using PTM7950 instead of paste for the GPU/CPU. My fan configuration is set up for positive pressure, so dust is a non-issue.
Probably the best thing to do is power limit your card to keep temps and volts/amps in check, and if you have a 12VHPWR connector use one of those monitoring modules to make sure it doesn't burn your house (and your GPU) down.
Thanks for the reminder btw, I actually do have to order parts for my car's yearly maintenance...
Also, depending on the card and the age of the card, it could need a repasting if it does not come with a phase-change or graphite pad from the manufacturer
While true, thermal cycling is the big one. Try to keep your electronics at a constant temperature and avoid both thermal and power cycling. Kind of like light bulbs, that initial power on is a prime time for failures.
It's slowly feeling like the shortages we had before when I was trying to build a new gaming PC and had to wait and wait for the CPU I wanted to finally be in stock and then disappeared from Micro Center before I could get in the door. I eventually just had to settle telling myself I'll upgrade when the stock comes back and I never did.
Cooler Master GPU Shield cable seems to be a universally-compatible and effective protection against the connector issue. Monitors the amperage on each pin and shuts down if any enter dangerous territory.
Same. I wish I'd gone with something a little more powerful than my 3070 Ti, but it'll do. Not a fucking chance I'm giving any more money to these colluding, greedy companies until prices are reasonable again. If my hardware dies, it dies. I have other things to do.
I just hope we get more smaller independent fabrication companies making ram, and other things in house. Issue is supply chain right now for even the things that make them.
Yeah, the big thing stopping people from entering the Dram market is the sheer cost to enter it. Well, all this investment and demand is driving money into more production, which is leading to new players entering the field, and hopefully newer, more efficient chips as well that will come together to bring prices down.
Perhaps this is hopelessly naive, but I love the idea of High Bandwidth Flash, where you can run models straight from a glorified SSD and have it be faster than current ram.
What really sucks is that the world got not enough fab capacity. Ideally, HBM prices shouldn't impact DRAM at all, cause those two are used in very different products; but that's only true when there's enough manufacturing capacity to satisfy both markets. Building more fabs should fix it, and Asian companies are going hard at it; but it still takes years to do.
China is ramping up. Profit too good to be left out.
And we will win in the end as capacity increases and frontier companies either fail, lose funding, or slow buildouts. It may take a few more years unfortunately.
The several year gap is my worry. Nearly all my hardware has 3 year warranties but I worry they'll just give back my original money vs give a replacement...
I bought 128GB AI395 and DGX boxes at release, 1799 and 3100ish respectively. Both those boxes are now selling for over double. Hell, I've got a 3090 I picked up in 2020 for 1599 I could probably break even or pull a lil profit on at this point, though no f'n way would I let a GPU leave this house right now, need all of em... /sigh
Jaw on the floor! This isn't free market. They refused to build more factories years ago when the first GPU shortage happened. All these manufacturers are working together and investing in eachother... no one is motivated to compete. I'm rooting for China at this point sonce they're the only ones trying to moderate value in their equations.
We cant build the future on a foundation we cant afford. I guess the reality is they're building a future for them not for us.
They're all building factories, but it doesn't make business sense to over build. When the cycle is over, you're stuck with huge capital spent that drag down the company. It's pretty common sense. And it's not like they can just wave them into existence.
They dont want to build more factories because its cheaper to just simply raise prices
The bastards just found new suckers to pay the overpriced costs
People need to understand that this entire ai bubble is a gamble on fusion energy and when you realize how wild that is you suddenly grasp how big scale this whole thing is
It’s not. Fusion energy isn’t happening at all in the next 20 years, and if it did, it will still take another 20 to commercialize the tech. The bubble is going to burst or deflate long before that. LLMs will still be around and potentially useful, but private liquidity isn’t going to hold out long enough for fusion to enter the chat.
Do you see how insane then this gamble is. When you listen to how they go "hey we need to quadruple our power output in like 5-10 years for this" it's completely infesable.
Helios I'm sure fusion pilled San Fran and they went nuts with the promise of unlimited energy.
They are claiming they're deploying micro fusion reactors to Microsoft servers but who knows if they work or not and their efficiency or even when.
based on non binding orders from companies who dont have cash in hand for those orders. at this point i'm rooting for VC to dry up, a few companies to go bankrupt and then the overflow hits retail.
If there's a crash, the rich will get richer. It's not like crashes help the general populace. When the US housing market exploded in early 2010s, anyone with cash picked up homes at 70% discount. Banks were wholesaling lots of 100 3br2 solid block. Buyers didn't even have to look at any details. I bought a few homes myself.
If there's a crash, expect them to buy up everything again and you're still super fucked.
Not sure why you're getting downvoted, when what you're saying is objectively true.
Anthropic and OpenAI are ultimately startups that are still in their "growth at all costs" phase. If shit hits the fan, they're going to be the first to face the consequences.
Nvidia and Google are absolutely too big to fail, Musk as well if you count SpaceX. I'd add Apple, Microsoft and Meta to that list as well.
Ah..... what China did in EVs, they are doing in space. They have an absurd number of launch systems, like 20 odd. So far. Just 2-3 weeks ago they had 4 launches within 48hours. Each one from a different company. Sure, Spacex is too big to fail as the national carrier of the US. But commercially, internationally I'm not so sure if they will be successful.
SpaceX will remain the main launch vehicle provider indefinitely, the US would never give up commercial Starlink market share to a Chinese version, same way they haven’t for EV’s.
Commercially, my understanding is that Starlink receivers are predicted to be integrated into new phones in a couple years, but I guess we’ll see
takes at least 3 years to ramp up a new fab. If they were smart, they started that process a year ago like Samsung and SKHynix. But even so, still waiting until end of 2028 until new fab capacity comes online. I do think that 2028 and 2029 we will see these prices become more sane and start to go down tho.
Here's hoping they can actually produce something viable. They always seem to be far enough behind that even their flagship processors barely complete with last year's mid range processors from the major players. I think they're gpus are even further behind.
China is behind for sure, but they have a few key advantages, such as a focused government that is relentless on what it targets. They're going to succeed sooner or later. With enough capital they evolve and reiterate like crazy. Their EVs are amazing, if a bit chaotic.
there really is no car manufacturer on Earth at their level in terms of value
It's not just value, it's expertise. China manufactures better than anyone else in the world. Chinese factories are the envy of the world. That's why they can offer such value. Since they simply make things better, faster, cheaper. That's why new US factories are trying to knock off Chinese factories.
So it's down to process tech to get the density and defect rate necessary to make really dense really fast memory. I did a couple Google searches and it does look like they have their own HBM equivalent, but it appears to be bundled with systems nearly as expensive as Nvidia. So at least one foundry can make it, just need the cost to be reasonable for consumers (and not completely used up by their own domestic data centers)
Hbm isn't relevant for us consumers other than for every one stick of hbm they could have made 3-4 consumers sticks of ram. China can make bank off regular ram.
HBM, GDDR and regular DDR are all DRAM chips. They are the same product in that the technology, IP, and manufacturing is 90% the same, if not more. The only difference is the interface.
Fabs aren't generic, despite what many think. They are built for the category of product they will make: logic, DRAM, etc.
The World has added quite a bit of wafer capacity in the last few years, just not DRAM wafer capacity.
I'm flaky on details, but I remember reading somewhere that HBM specifically uses some complicated multilayer manufacturing approach (as in they have multiple layers of transistors), instead of regular DRAM only having just 1 layer, or way less of them, hence why I claim those are different products - cause the manufacturing isn't the same. I would love to be corrected if I'm wrong on that.
Would help to ask Google or your favorite LLM about it. It's like a 3 minute read.
Nobody is doing multiple layers of transistors. It's multiple dies, stacked together. Pretty much all memory makers know how to make it by now.
There are two issues with HBM:
* it's much less space efficient on a wafer than regular DRAM. The stacking means each HBM chips has to have "through silicon vias", or TSVs (vertical wires going through the silicon die itself). Those TSVs are quite big, relatively speaking, making the die much bigger for the same amount of capacity.
* stacking means those TSVs need to be soldered together through micro solder balls. This inevitably introduces defects, lowering yields.
Between those two, DRAM executives have commented that HBM capacity is around 1/3rd vs conventional DRAM in gigabits for a given wafer capacity. That's a big part of the reason for the crunch.
HBM, GDDR and regular DDR are all DRAM chips. They are the same product in that the technology, IP, and manufacturing is 90% the same, if not more.
No. They're similar only sort of. 90% overlap manufacturing? No.
I'm actually curious how people read this and ... just believe you.
Fabs built around DDR cannot suddenly shift to HBM at a whim. They're not 90% the same. They're vastly different layouts. Instead of promising you LLMs and my complete lack of knowledge, I'll just refer you to Asianometry's video on it.
Strangely you are aware of the fact that they use TSVs etc and pretend that it's all the same.
Yeah, it's all technically "DRAM". That doesn't mean the same fab can make them. Also, the HBM standard specifically has a logic core at the bottom, so it's not even like you can say they make only logic or DRAM or whatever. It's a packaged standard. Logic -> DRAM Layer 0 -> DRAM Layer 1 -> Etc. As per JEDEC.
Hats off for the asianometry reference. You're mixing a lot of things, and seem to have a shallow understanding of the process. The main IP and bulk of manufacturing lies in the DRAM cells and multiplexers to make the memory banks on each die. HBM, broadly speaking, adds TSVs to make the IO through the die, to enable stacking, rather than have all IO on the edges of the die like regular DRAM (or the vast majority of chips for that matter).
I didn't say the chip is 90% the same. I said the manufacturing is 90% the same.
TSVs don't require any special machinery or different processes that a fab doesn't have.
The logic die (not core) is sourced from 3rd parties like TSMC or Samsung. It doesn't require leading edge manufacturing.
The same fab absolutely can switch from making desktop DRAM, to GDDR, to HBM with minimal reconfiguration. Sure you need new masks, the extra stack binding steps, and different QA, but that's why I left the 10% out.
The stacking you described is a packaging step, which happens off fab, often in a different country and/or by a different contract company altogether. It's still precision work, but peanutes compared to making the memory dies themselves.
There's only so much holding back. In today's drmand, if you aren't building a fab, then there's a brand new company that will totally buold it. Cartel tactics don't work when demand is unlimited.
What really sucks is that the world got not enough fab capacity. Ideally, HBM prices shouldn't impact DRAM at all, cause those two are used in very different products; but that's only true when there's enough manufacturing capacity to satisfy both markets. Building more fabs should fix it, and Asian companies are going hard at it; but it still takes years to do.
What is worse is that Amazon and the other companies do not have the datacenters to install the hardware they are buying. So you end up with the NVidia GPU dies WITH the memory, just sitting in warehouses.
The reason why companies do not stop buying until they have capacity to install it all, is because the high demand means they lose spots in their order deliveries.
"O, you do not want anymore, sure, we instantly give to somebody else but when you come back, its with new prices and maybe no capacity for you".
So we are have this snake that eats it own tail... The moment that this cycle breaks, and you have warehouses full of unused GPUs + mem for years, will be fun time... This is also part of the reason why companies are more reluctant to build too much new capacity, as that pushes this breaking point forwards.
Personally, I am hoping that we start seeing GPUs obsoleted and sold off to us. Gives the companies a bit more coin to spend on their upgrades, and we get to pester local AI with problems that don't justify a big model's attention. Win-win.
that's not gonna happen, even today software tricks like strata and freetoken already make smaller gpus relevant as well, so their prices go up as well. And the one thing that is now evolving wildly, is in fact software, so a lot of the gpus that are in use today, will be used for a loooooong time. So by the time a gpu is no longer relevant to a hosting company, it will barely be relevant for you. And just when maybe that would happen, ASIC llm cards will become viable, at which point even a datacenter gpu becomes irrelevant, and nobody will want to use gpus for ai, even at home, because of the wild difference in performance.
Giant companies are warehousing chips for lack of power, but keep buying more to inflate the value of the chips already on their balance sheets. Financial schemes that keep GPUs artificially expensive hurt teams' ability to get models trained.
So the big Corpos are still stockpiling gpus in warehouses and apparently the pace of acquisition is accelerating and the data centres to accommodate the acquired GPUs are years from being built.
I know it's been happening for a while now but what the actual hell?
Not only that, every hardware vendor in the world is moving to 64GB and 128GB laptops and desktops for business machines. The world has moved from 16GB and 32GB to 64GB and 128GB, the new ram normal is 4x what it used to be.
I'm an individual with about 1800 gb of GPUs. I have been screaming in this subreddit for the last 3 years for folks to get GPU because demand is going to be crazy and prices will be going up for a long time. I got lots of downvotes and here we are. I always stayed on the lookout for cheap GPUs and got P40s for $150, MI50 for $100, 3090s for $700, cmp170hx, etc. Every single GPU I own was bought used and they have all doubled in price.
So you're part of the problem? It doesn't sounds like you're using the GPUs. You're just hoarding them to scalp them? Not everyone can afford to just buy every GPU they come across. It's also very wrong to do this
I am tired of this bs, you do not get extra credit for having the same thoughts many already have and your downvotes were probably because of how you communicate, not what you are communicating.
Insufferable people are insufferable.
Do you want a shiny medal for being the only smart prson alive or something?
That said, being a future scalper isn't a noble thing.
I think they are lobbying into not letting AI be optimized, the moment a breakthrough happens NVIDIA will go back to "gaming doesn't matter" era. Still needed, but running frontier models on 8GB of VRAM would erase trillions from the market and possibly lead society to total collapse.
I saw a YT video last night in which the author (btw a local AI channel) was calculating how building your own local AI machine has become so expensive, while meanwhile many cloud services have become cheaper, that the break even has moved really far away in time. Especially with MoE models, that the datacenters can serve to multiple users at the same time easier, justifying the huge amount of money now needed for any local inference computer, even the smallest one, has become really hard to do.
I know I will get downvoted for this, but unfortunately it is what it is.
ATP the only reason to go local is like 3 reasons:
You own it forever
It’s good if you have lump sums instead of regular paychecks or similar (rare, but it’s my situation)
Privacy
Anything else… idk. If I didn’t gaf about privacy or if I regularly had money I’d probably be using cloud models more than I currently do. But local is just so much cooler and I know that none of my stuff is being seen by anyone else! I don’t care that they don’t care about my weird harmless chats, I don’t want them to see it.
Censorship and changes in quality of how models get served over cloud are two other huge reasons to go local. If I run an AI service through the cloud and they change the engine or quant of the model I use and the output quality changes, that can be a huge problem.
That's because you're still treating it as a consumable.
I bought 6 3090s for $850 at the start of last year. today they're worth $1700 each on us eBay and even more where I come from...while churning out Billions of token on ever improving models what it strata and derivatives release almost weekly.
The economics still speak to ownership, because in this demand climate, I can build out a $28k server, use it for at least 1 year of Ramageddon, and sell it off for at least break even having extracted compute worth 20% of its value before selling at a 20% loss.
On my current rig, if I sold my 3090s, I'd make $5100. Add in how many billion tokens of GLM, Deepseek and Qwen models I have avoided paying a cloud provider for and it's easy to rationalize.
My thing with local is that it forces the big guys to keep prices reasonable. If local models are improving and doing a great job, then Anthropic is disincentivized from cranking up their prices to the point that it's unaffordable. If local is so far behind that it's worthless, then OpenAI can charge 1000 a month for a max plan.
You can also use it offline which is huge for many cases. Sometimes I want or need an agent that operates offline. Maybe I live off grid and internet use is expensive/hard so I compensate with a local model. There’s a lot of reasons out there to not depend on a centralized computing cluster
The thing I often tell with going local, if you use your setup only for LLM inference, yes it's probably more expensive, but you can do way more with an AI Computer. If you combine it with Image gen, video gen, voice gen and music gen it's definitely much cheaper than paying for all those services.
In the end you have an AI rig for running AI services, not limited to llm's plus the ability to tailor them to your needs, this is much more than any service could sell you.
Great point! I love the image gen, I made a face swap clip once, I have it generate podcasts and stuff. And running every local model for every niche thing is super fun. Additionally you get a really beefy computer for doing whatever you want. I can run 20-30 Claude code sessions on my Mac Studio
True. And that's the reason why I chose the Nvidia-PC path. Most GPU-compute projects are CUDA-only (or at least develop a lot faster for CUDA than MLX or ROCm).
>I saw a YT video last night in which the author (btw a local AI channel) was calculating how building your own local AI machine has become so expensive, while meanwhile many cloud services have become cheaper,
Not really true. If you want to just get few answer sure. If you want to do agentic coding ? Nope.
with my RTX5090 i run 12 agent slots at around 800-1500t/s with qwen 3.8 27b via MegaCapybara engine and with kenshi decompilation project i used like 10B tokens already. Something like that would cost me arm and leg via normal cloud stuff.
how many 5090s are you using? I'm using OpenCode go at the moment with deepseek v4.1 flash orchestrated by Opus 5.5 but my usage at this pace is at 30 Billion tokens per month for Deepseek. I'm gonna run out already by today
I have a single RTX 3090 with 64 GB of DDR4. I'm hoping we have newer smarter smaller models but even so, if I resolve to my current hardware, I think I'll definitely have a reduction in my output.
I'm also decompiling games and I want to do it nonstop before the walls close in and these companies do something about it
Just run one 5090 with Qwen Flash Next, I have 2 5090 but one runs FN so well that i don't really care about using both. I was "originally" planning to have one powerful workstation with 2x 5090, 192GB DDR5 to run 27B Q8 (which requires 40gb VRAM or more depending on context) as fast as possible, but FN worked so well with only one that i finally decided to build a second "PC" to leave one 5090 exclusively as a server for FN and divide the 192GB (4x48) between both PC to run them at lower latency/higher speeds. Besides, in terms of prompt processing the 5090 with FN is way faster than 27B.
I'm using sergqwer's NVFP4 fork of Strata, it doesn't have the same problems as the lower quants used by the original Strata, even when compared to Q4 i would say Maximilian228's NVFP4 GPTQ is completely superior, and it has an uncensored option . You definitely need at least 96GB of RAM to get those speeds tho, which means if you only have 96GB of RAM you will only be left with around 10GB of RAM, but that's actually what made me decide for the server option, as i could use 2x48gb exclusively for FN, while my main Workstation would get the 2x48gb without a need to use RAM for LLMs.
Privacy is the main reason and only reason. When you have an always on agent that is actively assisting your personal life and work 24 x 7, you do not want to send those data to some private companies. It is more absurb than the facebook year that you upload your photo and personal info into it. The agent will have access to your voice recording, email, whatsapp conversation and they will work against you in any court cases.
Privacy is the main concern. Everything is monitored and censored. Also after using AI for a while it knows way too much about you, more than any other company.
Except the only people making a profit are the people who are renting hardware Did they purchased when it was cheaper. I agree that local hardware is a really tough sell economically, and it doesn't make any sense for it to be so without investor losses.
Cost per task is going down but how does that ever equate to any profitability?
With the current dominating architecture for LLMs, data centers are more appealing because of the bottleneck being transfer speeds and not compute. Diffusion models/NCM (for example, because there’s some hype rn) proposes a different architecture that almost flips this and makes local single use stations more ideal than a data center because the bottleneck becomes compute.
I don’t think we’re going to see any architectural shakeups, but the possibility is there
If you are searching for an alternative opinion in this discussion: this is obviously same as dot com bubble or house bubble. If you need GPUs for local AI you had three years for that. At some point economy will crash same way as before.
The big corps are being pumped full of unimaginable amounts of money while simultaneously being drained of nearly all of it. The perfect setup to see them crash when the spigot is removed, and buy them up cheap.
If I were a member of an Oligarchical circle, I know that's certainly something I might consider proposing.
The future rests completely in China's hands. If they manage to master the production of these chips, prices will crash. But if they decide to focus on annexing Taiwan instead, we can forget about buying graphics cards forever. Prices will launch into another galaxy and won't come back down in our lifetime.
Yes, until money well dries up. Some of the highest rollers in the so-called circular group is finally having serious issues finding a lender (SoftBank+OpenAI, CoreWeave) but it seems it's time to China big techs to step in, to some lesser extent.
It's all about supply and demand. For me it's obvious the demand will go down one day because now we're still in the expansion phase for datacenters. When all datacenters are built, well we aren't going to build much more. They all said 2027 was going to be worse so I'm not surprised. After 2027 I don't know. But going back on supply and demand, demand will go down, the only question at that moment is what's going to happen to the supply?
If Nvidia was producing GPUs for 20k/chip, would they go back to producing GPUs for 2k/chip, even if they were profitable? And if they did that, wouldn't that destroy the asset-based valuation of all the companies they've invested in?
The big risk imo is that when demand will go down, they'll ALL organize the supply to also go down, to ensure the prices stay very high. Remember, they control the market, there is no competition yet.
They will all claim it's not profitable to produce more GPUs/RAM at a lower price because their profitability includes the need to make billions in profits.
All of these data centers are being built around the same time. The problem with that is that their normal hardware refresh cycles will be somewhat synced, and unless nvidia increases manufacturing capacity this is going to be the new normal. Their capacity is really limited by TSMC fab time and memory manufacturers.
I doubt the secondary market will get much better either, as even used gear will be valuable in bulk to smaller datacenters all around the world. That’s even if there is a possibility we can reasonably run the gear. They are moving to water cooled units that will require a chiller and higher voltages that a lot of residential homes won’t have.
This is not news anymore. Scalpers did the "research" a few years back, now manufacturers apply the resulting information: people still keep buying sh*t, no matter what the price is. So the prices will go up, they will never ever come down. Ever. Even when the world collapses, there will be rich aholes to buy shit.
The scalper narrative was always a reddit hivemind delusion perpetuated only because it served as a convenient explanation to the cognitive dissonance that gamers felt when confronted with the reality that their beloved hardware daddy Jensen sold them out in favor of business and enterprise customers. Go back to 2021 and you'll see tons of news about how NVIDIA was shipping pallets upon pallets of GPUs to mining companies in the middle of a gigantic GPU shortage.
On release night of the 3060 in 2021 Feb, the cheapest option out of 6 officially partnered NVIDIA retailers was ~$1600 USD in my EU country. It would be years until it went down to its $329 MSRP, because the card was mining $300/mo after electricity up until Eth switched to PoS. It had practically nothing to do with these evil boogeyman called scalpers, and everything to do with demand.
People tend to yell that scalpers increase price but thats never the case. They only pocket the spread between sell and buy. The price is high because people are willing to pay for it. If scalpers didnt exist, the price would just increase in another step of the supply chain. Everybody is trying to maximize their profits, and scalpers are just the "most risk - last step".
Saying scalpers increases prices just portaits complete lack of understanding how markets operate.
implying this is a "people" or a consumer problem also portrays a complete lack of understanding on how the world operates too.
yes, a singular "person" is accountable for their own behavior, like buying from scalpers, or "voting correctly" with their wallet.
yet a group of "people" who does the same is not. when enough "people" are showing the same behavioral patterns following market dynamics (i.e buying high from scalpers), that problem is attributed to the system - not the individual.
thus the solution required isn't blaming consumers or yelling useless "dont buy from scalpers!!!!!!" or "vote with your wallets!!!!" - but rather a systemic change, rather it be policy, law, or a mandate.
if people are regularly running over children on a street, the solution isn't to yell "drive carefully everyone!" or to blame the drivers- it's to redesign the street, install traffic stops/cameras and set a speed limit.
that said, I'll still yell don't buy from scalpers and look at anybody who does with disgust - but I know very well that's not the root cause.
Honestly as long as nothing in my setup breaks that doesn't bother me.
I started with local LLM on 2 3060 12GB than I had to take a break for reasons and came back with 2 A4000 16GB while setting things up I discovered Strata. Yes Vibe coded slop Blabla....
But my point is increasing Hardware price also increase the will to squeeze what hardware you got to the maximum. Specialized Inference Engines, new developments in the quantization area and so on.
Yes some bubble will pop at some time but I don't think that it will rain RAM/VRAM and you just have to collect it. That shits gonna cost you as well. There is a lot of loss to compensate.
To be realistic most of us are well prepared before the price hike because we knew it would've happened anyway, there're posts asking about what to buy but those are either late bloomers or just want to buy regardless to upgrade their existing rigs.
I would say those who can run Q38-27 and Q38FN are very well fine for at least 5-6 years from now, you're given a very capable employee, what you do with them is up to you.
Appreciate with what you have and do not FOMO without a goal, the price will go down as Anthropic, OpenAI... are not making money, it will be a disaster if they go IPO.
Yeah good advice, if you can Qwen 27b or QFN just hold tight until prices come down a bit. Maybe get an extra gpu if you see a bargain on the used marketplace. Tough to buy new in this market
Corsair 7000D case
64GB DDR-6 (should have gone 128GB).
2 NVME 2 TB high speed storage devices
Sadly I knew the RTX 50 series was coming so I just put in a RTX 4070. I didn’t quite need a 4090 just yet. Sat on the sidelines too long on upgrading.
I just added an RTX 5070 TI with 16GB of RAM. Gives me 28GB between the two cards.
Perf is pretty good on the popular smaller models before splitting models into system RAM.
What’s your PSU? Is 1k enough to run both a 5070TI and 4070? I have a 7800xt and I’m thinking of getting a 9070xt and running both but I only have a 750w PSU which is already tight
Is this actually significant news though? If you look at the ETF DRAM, yes it's up right now but it's been hovering at this price for the last 5 months. Mr market doesn't think the situation is so different what what we've been seeing lately
I’m hoping this won’t affect NVMe drives as well. I’ve been noticing that NVMe drives are playing a bigger role in offloading memory usage from DRAM lately.
While this article is too short to explain what's happening, Samsung recently showed their next generation of HBM that makes noticable jump in performance, the price hike is because there's a new tier of the product which must be offering reduced memory scaling in some way for thier primary customer Nvidia to be happy to take a premium per GB. So who knows how much it makes the market for the worse.
Maybe it is time to buy a farm in the middle of nowhere with a small workshop to keep the grey matter excercised. Solar/hydro electricity and just live off the land. This is getting ridiculous to be honest.
Privacy and censorship. I need to run security checks for my private network and both require a local open model and one without heavy guardrails. As RAM and GPU prices continue to soar, our ability to protect ourselves against AI attacks and our right to privacy is being pulled further away from us. The AI has two main attack vectors - cyber and economic. Huggingface is nothing compared to the economic attack AI has bestowed the last 5 years. Debt is out of control and we the People don’t have Second Amendment protections to defend ourselves. gg
Alarmist pap. I'm pretty sure this action is just staying the course at 100% of the prices we're already seeing, doing what they've already been doing, not doubling them again.
If they tried to increase them much more, there would be consequences. On the consumer end, you can't squeeze blood from a stone. But surely even the corporations will have a limit to how much they're willing to borrow before having their own multi-hundred-billion-dollar RAM production fab starts to look better on a balance sheet.
No sense worrying about it. There's not much I can do about it as a consumer but stop buying and hope the political tide turns. Maybe it's just as well I upgraded from my not-quite-obsolete Samsung phone to an Apple one... but who manufactured the screen for it?
It’s clear they are conspiring. The memory manufactures are making hand over fist money with no real plans to expand production.
They are all very happy to make huge profits without having to do anything. Our only real hope is china getting into the market like that have with drones, 3d printers, etc and forcing the price to bottom out.
but 2028 will be the year of almost free datacenter GPUs
the math is not adding up and the debt collectors are coming over, unless some breakthrough happens and the AI models start pumping out new drugs and materials
•
u/WithoutReason1729 12h ago
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.