Artificial Intelligence Stack Exchange Community Digest

Top new questions this week:

Is Clipping Necessary for PPO?

I believe I have a decent understanding of PPO, but I also feel that it could be stated in a simpler, more intuitive way that does not involve the clipping function. That makes me wonder if there is ...

reinforcement-learningproximal-policy-optimizationactor-critic-methods

asked byBeane Score of 3 answered byjoerg-de Score of 2

Greatest hits from previous weeks:

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer.If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...

neural-networksmachine-learningdeep-learningconvolutional-neural-networksnatural-language-processing

asked byAsciiom Score of 103 answered byBlindKungFuMaster Score of 73

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it.What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...

natural-language-processingchat-botsnatural-language-understandingchatgpt

asked bymilez Score of 58 answered bymilez Score of 32

What is the difference between an agent function and an agent program?

In section 2.4 (p. 46) of the book Artificial Intelligence: A modern approach (3rd edition), Russell and Norvig writeThe job of AI is to design an agent program that implements the agent function — ...

terminologycomparisonnorvig-russell

asked byAbhishek Bhatia Score of 10 answered byNietzscheanAI Score of 10

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words....

neural-networksdeep-learningnatural-language-processingberttext-generation

asked bych271828n Score of 35 answered bysoloice Score of 37

What is the "temperature" in the GPT models?

What does the temperature parameter mean when talking about the GPT models?I know that a higher temperature value means more randomness, but I want to know how randomness is introduced.Does ...

machine-learningterminologygptlanguage-modelgpt-3

asked byTom Dörr Score of 39 answered byspiridon_the_sun_rotator Score of 44

Is it possible to train the neural network to solve math equations?

I'm aware that neural networks are probably not designed to do that, however asking hypothetically, is it possible to train the deep neural network (or similar) to solve math equations?So given the ...

neural-networksmathapplications

asked bykenorb Score of 35 answered byzergylord Score of 24

Was ChatGPT trained on Stack Overflow data?

Has ChatGPT used highly rated and upvoted questions/answers from Stack Overflow in its training data?For me it makes complete sense to take answers that have upwards of 100 upvotes and include them ...

chat-botschatgptlanguage-model

asked byNicolas Zein Score of 52 answered byLong Luu Score of 61