eleitl @ eleitl @lemmy.ml Posts 336Comments 497Joined 5 yr. ago
Nobody is using MMF these days even for local runs. As to sfp, check https://fs.com and pick a matching pair that is cheapest. These days it makes sense to use 10G or 25G rather than 1G. Some people run 100G for their homelab, but even used it's pricy and noisy.
IBM does 60 deg C watercooling which can be not a lot of thermal delta in nonarctic environments. It's a lot of km of infrastructure to vent directly if you want to dissipate a nuclear reactor's worth of power in a single site.
A free running cellular automaton (CA) approach in hardware would work, but each cell would be a much souped up SRAM cell, the interactions would be all local and 2D. Considering Cerebras is 40 G SRAM on the 300 mm WSI and is about at the cooling limit I'm afraid you do not have 5 orders of magnitude. Perhaps reversible spintronics can help with the power draw, but you still have to splat a higher dimensional network so not just local interactions into a 2D array.
Notice you have to cool both in the power plant and the DC. And these DCs run up to a GW or more.
Global Financial Crisis 2 is definitely a fast component in the overall collapse process. Unaccounted consumer debt is a useful facet of a diagnostic. We don't know where exactly the spark will originate that will blow up GFC2. It could as well start there, though it's not very probable.
You seem to not be using open source software packaged for multiple architectures or which can be built for your binary target. Most people will be just using a browser and an office suite.
No, that captures just the neuroanatomy. Not the properties like density of ion channels, type, value of the synapse and all the things we don't know yet.
You seem to trust Nvidia. I don't.
I would look into thin clients and Lenovo etc. tiny PC for office on eBay. I run old low power low noise rackmount Supermicros which are nice but hard to find at low prices.
Nicely put. I fully agree with this description.
Yes orders of magnitude, but not too many of them. The real estate of a 300 mm wafer is limited, the structure shrink is saturating and you can't get too many layers. You still need a packet switched network on the wafer even if the rest is mostly analog. Perhaps spintronics can limit the power requirements too.
I think we are already at the catabolic collapse stage where the elites are cannibalizing the periphery before the heartland. On the other hand the US has been also being stripped bare in patches for a while. So it is a simultaneous progressive process.
And these power lines into the EU are very easy to disrupt and disrupt again after repairs.
Factor in power bills and heat and noise into your calculations.
Secure has no meaning.
Sadly, you can't download the hardware to run models that size.
There are diminishing returns in semiconductor photolitho. Moore scaling is long over, absolute real estate see WSI with Cerebras, DC costs and power envelope are all sending a clear message. Quantization is there, so you can go from digital multipliers to analog and go spiking networks, but transformers and Co have little power there.
Also, the kind of economy that can carry Gen AI as business model is not a given, long term.
You could highlight the phrase, and he'll still fail to get it.
https://h01-release.storage.googleapis.com/data.html
Make sure you have spare 1400 terabytes.
A climate-induced tree species bottleneck for forest management in Europe - Nature Ecology & Evolution
Climate extremes likely to drive land mammal extinction during next supercontinent assembly - Nature Geoscience (2023)
Thermodynamics, thermal performance and climate change: temperature regimes for bumblebee (Bombus spp.) colonies as examples of superorganisms
Farmers warn food aisles will soon be empty because of crushing conditions: 'We are not in a good position'
