1
point
gzer0
Joined 4,961 karma
ai @ anthropic
- gzer0This is hands down one of the best visualizations I have ever come across.
- M5 Chip currently only avaialble with up to 32 GB of RAM on the 14 inch Macbook pro variant, just FYI.
[1] https://www.apple.com/us-edu/shop/buy-mac/macbook-pro/14-inc...
- Nooooo I'm going to have to use my brain again and write 100% of my code like a caveman from December 2024.
Comment last time that had me chuckling.
- The best way to phrase this would be, information seeking as a form of procrastination itself.
I first remember reading this phrasing here on HN and I've been using it for years to explain to others that what I am doing is not "work", its just a hobby.
- 3 points
- Very nice and solid release by the Qwen team. Congrats.
- Both the Golden Record and the Pioneer Plaque were carefully crafted with universality in mind, drawing on fundamental scientific principles understandable by any intelligent civilization. They both shared many similarities. [1][2]
[1] Explanation of the Voyager record cover diagram, as provided by NASA> Some images contain indications of chemical composition. All measures used on the pictures are defined in the first few images using physical references that are likely to be consistent anywhere in the universe. > The pulsar map and hydrogen molecule diagram are shared in common with the Pioneer plaque.https://upload.wikimedia.org/wikipedia/commons/thumb/e/ed/Vo...
- Your skepticism about the Golden Record is understandable, but its value goes beyond mere practicality—it's a powerful symbol of humanity's hopes, dreams, and curiosity.
Sure, the odds of another civilization discovering and fully decoding it are slim. But the Record was never simply meant as a practical tool, like the Svalbard seed bank or the LHC. Instead, it's an intentional gesture of optimism, an attempt to capture and communicate the essence of who we are at this unique moment in our history.
Importantly, the Golden Record was carefully designed using universal scientific principles—binary notation, hydrogen atom properties, and pulsar maps—ensuring that any intelligent civilization might realistically decode it. The instructions etched onto its cover rely on fundamental concepts universally understandable across the cosmos.
The greetings, music, and even brainwave recordings aren't strict instructions but rather snapshots showcasing humanity’s diversity, creativity, and complexity. Even partial understanding by an advanced civilization would provide profound insights into human emotion, ingenuity, and our deep desire for connection.
In the end, the Golden Record is NOT just about practical outcomes; it's about reflecting humanity’s best qualities back to ourselves and inspiring us to strive toward the ideals we've shared with the universe.
- 10M context length and surpasses claude-3.7-sonnet and GPT-4.5.
Can't wait to dig in on the research papers. Congrats to the llama team!
- Every time this topic comes up on HN, I always like to remind readers about the following:
One of my favorite facts ever is that Voyager 1 contains something called the Voyager Golden Record [1]. It has the following quote written:
This is a present from a small, distant world, a token of our sounds, our science, our images, our music, our thoughts and our feelings. We are attempting to survive our time so we may live into yours.
I get chills every time I think about this.
- Can confirm, this isn't just an IT thing. Physicians are a prime example—people tend to put doctors on a pedestal, and some doctors start believing they know everything about everything, even when it's clearly outside their wheelhouse. Being smart in one area doesn’t automatically make you an expert in another, but it’s easy for everyone involved to forget that.
- Great insight—thanks for sharing. It strikes me that bureaucracy is inherently self-perpetuating- once established, it rewards compliance over creativity, steadily shifting the culture until innovation becomes the exception rather than the rule.
Perhaps the real challenge isn't balancing innovation and marketing—it's creating a culture that genuinely rewards bold ideas and meaningful risk-taking.
- I spent time working with Andrej and the rest of the FSD team back in 2020/2021, and we had plenty of conversations on how human visual processing maps onto our neural network architectures. Our approach—transformer-based attention blocks, multi-scale feature extraction, and temporal fusion—mirrors elements of the biological visual cortex (retina → LGN → V1 → V2 → V4 → IT) which break down raw inputs and integrate them over time. It’s amazing how closely this synthetic perceptual pipeline parallels the way our own brains interpret the world.
The key insight we discovered was that explicitly enforcing brain-like topographic organization (as some academic work attempts - such as this one here) isn't necessary - what matters is having the right functional components that parallel biological visual processing. Our experience showed that the key elements of biological visual processing - like hierarchical feature extraction and temporal integration - emerge naturally when you build architectures that have to solve real visual tasks.
The brain's organization serves its function, not the other way around. This was validated by the real-world performance of our synthetic visual cortex in the Tesla FSD stack.
Link to the 2021 Tesla AI day talk: https://www.youtube.com/live/j0z4FweCy4M?t=3010s
- Demon Adam didn’t become standard largely for the same reason many “better” optimizers never see wide adoption: it’s a newer tweak, not clearly superior on every problem, is less familiar to most engineers, and isn’t always bundled in major frameworks. By contrast, AdamW is now the “safe default” that nearly everyone supports and knows how to tune, so teams stick with it unless they have a strong reason not to.
Edit: Demon involves decaying the momentum parameter over time, which introduces a new schedule or formula for how momentum should be reduced during training. That can feel like additional complexity or a potential hyperparameter rabbit hole. Teams trying to ship products quickly often avoid adding new hyperparameters unless the gains are decisive.
- This is a great build, thanks for sharing your learnings.
The best build I have seen so far had 6x4090's. Video: https://www.youtube.com/watch?v=C548PLVwjHA
An interesting choice to go with 256GB of DDR5 ECC; if spending so much on the 6x4090's, might as well try to hit 1 TB of RAM as well.Specifications - GPU Accelerator - 6 x 24GB NVIDIA GeForce RTX 4090 - Processor - Intel Xeon W7-3465X, 28C/56T, 2.5GHz - 4.8GHz - Memory - 256GB (8x32GB) DDR5 ECC 4800MHz - System Drive - 2TB Samsung 980 PRO NVMe PCIe 4.0 M.2 SSD - Storage Drive - 4TB Samsung 870 EVO SSD - Operating System - Ubuntu 20.04The cost of this... not even sure. Astronomical.
- For the $20/month subscription: you get 50 generations a month. So it is included in your subscription already! Nice.
For the Pro $200/month subscription: you get unlimited generations a month (on a slower que).
- The core issue here is the sheer volume of applicants. Microsoft opened 30 new-grad software engineering positions. Care to guess how many applications they got within 24 hours? 1,000? 10,000?
Nope.
100,000 applications. In under a single day.
With that kind of applicant pool, I’m honestly not sure what the best approach is—even though, in a perfect world, your suggestion would be the more appropriate route. The reality, however, is that these numbers are just absurd.
