Looks dope

someone had to do this as OSS MIT, great, thx!

Pennies per request would be a lot, it's a fraction of a penny per request.

Thank you! :D

Thanks. This was something I tried earlier. I noticed that using the maximum number of estimators almost always lead to the highest cross validation score. I was worried there would be some overfitting as a result.

Very cool!

Thanks for letting me know a better way.

Human Feedback is being boostsrapped by GPT3 predictions "stolen" against OpenAI's will (for just $500 API bills).

Open source doesn't mean freely used. That's the whole reason there's an F in FOSS.

ncdu ftw

🤷

Sometimes models just come out crap. Like BLOOM which has almost the same number of parameters as GPT3, but is absolute garbage in any practical use case. Like a kid from two smart parents that turns out dumb. Just blind chance.

Or they could be wrong. 🤷

I haven’t tried the larger models unfortunately. However I wonder how the model could be „shockingly bad“ despite having almost three times the parameter count.

You can do this using replicate: https://github.com/replicate/cog-llama

Couldnt it be possible to set up a large community Q/A repositiry then? Just crowdsource whatever it outputs and document collectively.

which can make a huge difference: GPT-3 + RLHF = Chat-GPT

Okay. I don't have the capacity right now (old laptop, disk too small to really use a second OS). I appreciate the help! I will once I get a new computer.

In German this command could be interpreted as "you son of a whore"

For Android build please use Linux ( tested with Ubuntu 20.04)

LGTM

Ok, so all of these are linear ( logistics) regression models, for which it makes sense to have more data points, because the weights aren't as constraint as in a convolutional layer I.e. but it is still a rule of thumb, not exactly a proof.

Provide a clear and formal way for the community to express its opinion. You know, as opposed to tweeting at one person who does not have absolute control over Meta AI. Notable people have brought attention to that pull request and it is currently gaining traction.

Thanks!

Both of the instructions (for Android which I'm attempting, but also the Windows instructions) result with the > C:/MinGW-32/bin/make.exe: invalid option -- ? error. I can't seem to figure out what make version I should use instead, or how to edit that.

Demo page: https://searchgpt-demo.herokuapp.com/

Github : https://github.com/michaelthwan/searchGPT

searchGPT is a search engine or question-answer bot based on LLM to give natural language answers. You may see the footnote which is the reference of sources from the web. Below there is a explainability view to show how the response is related to the sources.

Why Grounded though?

Because it is impossible for the LLM to learn everything during the training, thus real-time factual information is needed for reference.
This project tried to reproduce work like Bing and perplexity AI which have external references to support the answer of LLM.

Some examples of good grounded answer from searchGPT and wrong ungrounded answer from ChatGPT is mentioned in the github.

I have updated readme with Windows build instructions,please check https://github.com/rupeshs/alpaca.cpp#windows

Creating a monopoly on AI can be extremely risky. Although OpenAI was founded to prevent it, recent actions by the company suggest that they may be contributing to monopolization by reducing prices.