Hacker Neue

Preferences
ericlewis
Joined 498 karma
[ my public key: https://keybase.io/ericlewis; my proof: https://keybase.io/ericlewis/sigs/XCTPq2tHD_F6eEQRWHPFiliVwNrX6bv4CDPfBnACmP0 ]
  1. ericlewis
    I still dont understand why people point to this chart as any sort of meaning. Cost per task is a fairly arbitrary X axis and in no way representing any sort of time scale.. I would love to be told how they didn't underprice their model and give it an arbitrary amount of time to work.
  2. ericlewis
    US, GA here. My mom was big on tanning and warned of us this (lemons are also bad). I believe she said something about it being used on purpose for tanning, but that you had to be careful or you would badly burn. She probably did that around the late 80s or early 90s.
  3. ericlewis
    As a person who works on this kinda stuff I know what they mean. It’s very hard to debug things totally blind.
  4. ericlewis
    Higher the precision the better. Use what works within your memory constraints.
  5. ericlewis
    If you are using the user attribution with OpenAI (as you should) then they will block that users id and the rest of your app will be fine.
  6. ericlewis
    The theory is that you increase the context with more relevant tokens to the problem at hand, as well as its solutions, which in theory makes it more likely to predict the correct solution.
  7. ericlewis
    This reminds of a TPU.
  8. ericlewis
    I have one of these. It’s not there.
  9. ericlewis
    Perhaps it’s because I know human beings that have the exact same operation and failure mode as the LLM here and I’m probably not the only one. Failing at something you’ve never seen and faking through it is a very human endeavor.
  10. ericlewis
    My wife is capable of “automatic driving” and I am not. She describes it as a flow state.
  11. ericlewis
    You would need both. RAG will have to be part of the process if you want to generate or work on an existing project. Since it stands for Retrieval Augmented Generation. A fancy way of saying an LLM can access documents.
  12. ericlewis
    GPT-4 is fine-tunable.

    https://platform.openai.com/docs/guides/fine-tuning

    “ Fine-tuning for GPT-4 is in an experimental access program - eligible users can request access in the fine-tuning UI when creating a new fine-tuning job.”

    You need only have fine-tuned a 3.5 model ime.

  13. ericlewis
    ChatGPT is in-fact that. GPT-4 the API is not that. There is clearly no RAG, you bring that yourself, same with toxicity filtering, again - a different api, up to you to implement. etc. There is probably something going on before the input reaches GPT-4 and we are definitely not seeing the raw output from the LLM. But the layers over GPT-4 the API are thinner than ChatGPT.

    The Assistants API is closer to ChatGPT & what you are describing.

    Edit: it should be noted that the Assistants API is somewhat model agnostic as well, so the product part of this isn't part of the inference system.

  14. ericlewis
    It’s kinda specific to Claude, but the overall concept and really a lot of the api shape is similar for most other LLMs, especially ones that adopt the OpenAI api model.

    This is probably best described as a tutorial for how to use tools with Claude.

  15. ericlewis
    useEffect is best thought of as a synchronization mechanism between external state and react state and the function it returns may actually be better thought of as a side effect. UseEffect makes sense in this case because you aren’t on the side!
  16. ericlewis
    I wanted to replicate many parts of the Ai pin and did research into laser projectors. It’s probably a MEMs projector. The cyan color they use is custom, at least. Minifying that tech and making it robust enough to be knocked around on a wearable device is pretty challenging and I couldn’t find anything of a similar size off the shelf. They also run pretty hot and apparently the pin has heat issues (and according to folks at CES (?) using the laser a lot makes it over heat.
  17. ericlewis
    Not that it really matters I guess, but electron apps are chunky. Huge bin size and large memory usage.
  18. ericlewis
    Xcode cloud isn’t running on Apple silicon, arguably a place where it would make tons of sense.
  19. ericlewis
    I’ve used it since close to day one and it’s great. You can get some detailed information and action items and it’s super easy to use.
  20. ericlewis
    Ah cool. I messed around with this a while ago: https://github.com/ericlewis/swift-playdate

This user hasn’t submitted anything.