Hacker Neue

Preferences
wskish
Joined 277 karma
Technical founder (Ruckus Wireless and Cogniac); kicking ideas and playing around towards #3.

See also @wskish on twitter.

  1. wskish
    Skills are basically (on-demand) man pages for other libraries or cli tools, or SOPs for other more complex processes. A beautiful, minimal abstraction.
  2. wskish
    codebases of high quality open source projects and their major dependencies are probably another good source. also: "transformative fair use", not "stolen"
  3. wskish
    I think about this a lot. Consider the difference between the tidy signage of Tokyo versus the pell-mell streetfronts of Hong Hong. Societies should be able to choose how businesses impinge the public space.
  4. wskish
    Amplified messaging from corporations is not the same as the free speech of individuals. Just as we disallow advertising for cigarettes and hard liquor on TV, a democratic society should be free to select other classes of messages that corporations are not permitted to amplify into public spaces.
  5. wskish
    "Let’s delve into the details"
  6. wskish
    To fully experience the night sky there is no substitute for getting up to altitude. Most of the atmosphere that really interferes with the view is way down low. Try a moonless night at 8000 to 11000 feet elevation in the eastern Sierra or Yosemite high country to really blow your mind. Boss level is a summit bivy during a new moon meteor shower with a close friend or lover.
  7. wskish
    "The Andrew Message System is one of the most ambitious and technically successful systems yet built in the area of electronic communication. In this paper, the authors of the system explain the key decisions in the architecture and reflect on what was done right and what was clearly wrong. Implementation details are mentioned only in passing, in order to maximize the relevance of this paper for the designers of successor systems."
  9. wskish
    I came here to mention MenuMeters as well. It's the closest thing I can find to those beloved X window system load indicators of yore.
  10. wskish
    interesting, GPT refuses to summarize this content: "I'm sorry, but I can't generate a summary for that content." per https://github.com/jiggy-ai/hn_summary & https://t.me/hn_summary
  11. wskish
    I'm curious about the methodology but couldn't find an associated paper or research report. The original source seem to be university PR.
  12. wskish
    It is amazing much room there is to re-optimize cities around smaller electric vehicle transportation when you think on a slightly longer timescale.
  13. wskish
    It isn't so clear to me. If it conveys a human in any way that humans don't naturally move unassisted then in my mind it qualifies as a conveyance and hence a vehicle, especially in the sense of the the French véhicule, from Latin vehiculum (“a carriage, conveyance”), from vehere (“to carry”)
  14. wskish
    "Attention with Linear Biases (ALiBi): Inherited from the MPT family, this feature eliminates the context length limits by replacing positional embeddings, allowing for efficient and effective processing of lengthy documents. In future we are planning to finish training on our larger dataset and to increase amount of tokens for context."

    This is interesting, but also confusing. What is the current context limit? It mentions eliminating the limit but then mentions increasing it in the future.

  15. wskish
    here is code (with several examples) that takes it a couple steps further by validating the output json and pydantic model and providing feedback to the llm model when it gets either of those wrong:

    https://github.com/jiggy-ai/pydantic-chatcompletion/blob/mas...

  16. wskish
    Do they mention anywhere the definition of "low quality" data or the proportion of removed data that was low quality versus duplicate?

    They mention "When upsampled, we expect SlimPajama to perform equal to or better than RedPajama-1T when training at trillion token scale." But i guess "upsampling" in this case is just explicit duplication of the training data. So the only potential gains would be from the removal of the low quality data?

  17. wskish
    Interesting that we have OpenAI using the more generic "GPT" here. Previously they would refer more specifically to ChatGPT, GPT-3, or GPT-4. I am guessing this is related to their trademark application for GPT, which was initially refused by the USPTO on the grounds of "GPT" being "merely descriptive".

    https://www.hackerneue.com/item?id=36155583

  18. wskish
    I uploaded the USPTO office action to a JiggyBase (https://jiggy.ai) collection and used GPT-4 and the JiggyBase ChatGPT plugin to help make sense of this:

    https://chat.openai.com/share/6a16cc77-4ef7-4e3a-bddb-dedd3f...

  19. wskish
    "REFUSAL—MERELY DESCRIPTIVE: Registration is refused because the applied-for mark merely describes a feature, function, or characteristic of applicant’s goods and services."

    There are other details that exceed my trademark ken. Anyone with trademark experience care to parse this for us?

This user hasn’t submitted anything.