1. Agrawal, M., Peterson, J.C., Griffiths, T.L.: Scaling up psychology via scientific regret minimization. Proc. Natl. Acad. Sci.117(16), 8825–8835 (2020).https://doi.org/10.1073/pnas.1915841117

   Article  Google Scholar 

2. Azevedo, R., Hadwin, A.F.: Scaffolding self-regulated learning and metacognition-implications for the design of computer-based scaffolds. Instr. Sci.33(5/6), 367–379 (2005)

   Article  Google Scholar 

3. Baker-Sennett, J., Matusov, E., Rogoff, B.: Planning as developmental process. Adv. Child Dev. Behav.24, 253–281 (1993)

   Article  Google Scholar 

4. Baldi, P., Atiya, A.F.: How delays affect neural dynamics and learning. IEEE Trans. Neural Netw.5(4), 612–621 (1994)

   Article  Google Scholar 

5. Bandura, A., Walters, R.H.: Social Learning Theory, vol. 1. Prentice Hall, Englewood Cliffs (1977)

   Google Scholar 

6. Bitterman, M.: Classical conditioning since Pavlov. Rev. Gen. Psychol.10(4), 365–376 (2006)

   Article  Google Scholar 

7. Blum, A., Mansour, Y.: Learning, regret minimization, and equilibria. In: Nisan, N., Roughgarden, T., Tardos, E., Vazirani, V.V. (eds.) Algorithmic Game Theory, pp. 79–102. Cambridge University Press, Cambridge (2007).https://doi.org/10.1017/CBO9780511800481.006

8. Brown, N., Lerer, A., Gross, S., Sandholm, T.: Deep counterfactual regret minimization. In: International Conference on Machine Learning, pp. 793–802. PMLR (2019).https://proceedings.mlr.press/v97/brown19b.html

9. Butz, M.V., Achimova, A., Bilkey, D., Knott, A.: Event-predictive cognition: a root for conceptual human thought (2021).https://doi.org/10.1111/tops.12522

10. Byrne, R.M.: Cognitive processes in counterfactual thinking about what might have been. In: Medin, D. (ed.) The Psychology of Learning and Motivation: Advances in Research and Theory, pp. 105–154. Academic Press, San Diego (1997)

    Google Scholar 

11. Byrne, R.M.: Mental models and counterfactual thoughts about what might have been. Trends Cogn. Sci.6(10), 426–431 (2002)

    Article  Google Scholar 

12. Byrne, R.M.: The Rational Imagination: How People Create Alternatives to Reality. MIT Press, Cambridge (2007)

    Google Scholar 

13. Clark, R.E.: The classical origins of Pavlov’s conditioning. Integr. Physiol. Behav. Sci.39(4), 279–294 (2004)

    Article  Google Scholar 

14. Connolly, T., Zeelenberg, M.: Regret in decision making. Curr. Dir. Psychol. Sci.11(6), 212–216 (2002)

    Article  Google Scholar 

15. Dix, A.: The adaptive significance of regret (2005).https://alandix.com/academic/essays/regret.pdf, unpublished essay

16. Dykes, J.: The carbon footprint of AI and cloud computing. Geographical (2020).https://geographical.co.uk/nature/energy/item/3876-the-carbon-footprint-of-ai-and-cloud-computing

17. Egan, K.: Memory, imagination, and learning: connected by the story. Phi Delta Kappan70(6), 455–459 (1989)

    Google Scholar 

18. EPSRC: Human-like computing: Report of a workshop held on 17 & 18 February 2016, Bristol, UK (2016)

    Google Scholar 

19. Epstude, K., Roese, N.J.: The functional theory of counterfactual thinking. Pers. Soc. Psychol. Rev.12(2), 168–192 (2008)

    Article  Google Scholar 

20. Fehrer, E.: Effects of amount of reinforcement and of pre-and postreinforcement delays on learning and extinction. J. Exp. Psychol.52(3), 167 (1956)

    Article  Google Scholar 

21. Freitag, C., Berners-Lee, M., Widdicks, K., Knowles, B., Blair, G.S., Friday, A.: The real climate and transformative impact of ICT: a critique of estimates, trends, and regulations. Patterns2(9), 1–18 (2021).https://doi.org/10.1016/j.patter.2021.100340

    Article  Google Scholar 

22. Friedman, S.L., Scholnick, E.K.: The Developmental Psychology of Planning: Why, How, and When Do We Plan? Psychology Press, London (2014)

    Book  Google Scholar 

23. Kahneman, D., Miller, D.T.: Norm theory: comparing reality to its alternatives. Psychol. Rev.93(2), 136–153 (1986).https://doi.org/10.1037/0033-295X.93.2.136

    Article  Google Scholar 

24. Kahneman, D., Tversky, A.: Prospect theory: an analysis of decision under risk. Econometrica47(2), 263–291 (1979).https://doi.org/10.2307/1914185.http://www.jstor.org/stable/1914185

25. Lattal, K.A.: Delayed reinforcement of operant behavior. J. Exp. Anal. Behav.93(1), 129–139 (2010).https://doi.org/10.1901/jeab.2010.93-129

    Article  Google Scholar 

26. Loomes, G., Sugden, R.: Regret theory: an alternative theory of rational choice under uncertainty. Econ. J.92(368), 805–824 (1982).https://doi.org/10.2307/2232669

    Article  Google Scholar 

27. MacIntyre, P., Gregersen, T.: Emotions that facilitate language learning: the positive-broadening power of the imagination. Stud. Second Lang. Learn. Teach.2(2), 193–213 (2012).https://pressto.amu.edu.pl/index.php/ssllt/article/view/5009/5229

28. Markman, K.D., McMullen, M.N.: A reflection and evaluation model of comparative thinking. Pers. Soc. Psychol. Rev.7(3), 244–267 (2003)

    Article  Google Scholar 

29. Markman, K.D., McMullen, M.N., Elizaga, R.A.: Counterfactual thinking, persistence, and performance: a test of the reflection and evaluation model. J. Exp. Soc. Psychol.44(2), 421–428 (2008)

    Article  Google Scholar 

30. McCormack, T., Feeney, A., Beck, S.R.: Regret and decision-making: a developmental perspective. Curr. Dir. Psychol. Sci.29(4), 346–350 (2020).https://doi.org/10.1177/0963721420917688

    Article  Google Scholar 

31. McSweeney, F.K., Bierley, C.: Recent developments in classical conditioning. J. Consum. Res.11(2), 619–631 (1984)

    Article  Google Scholar 

32. Muggleton, S., Chater, N.: Human-Like Machine Intelligence. University Press, Oxford (2021)

    Book  Google Scholar 

33. O’Connor, E., McCormack, T., Feeney, A.: Do children who experience regret make better decisions? A developmental study of the behavioral consequences of regret. Child Dev.85(5), 1995–2010 (2014).https://doi.org/10.1111/cdev.12253

    Article  Google Scholar 

34. Pearce, J.M., Bouton, M.E.: Theories of associative learning in animals. Annu. Rev. Psychol.52(1), 111–139 (2001).https://doi.org/10.1146/annurev.psych.52.1.111

    Article  Google Scholar 

35. Sanna, L.J., Stocker, S.L., Clarke, J.A.: Rumination, imagination, and personality: specters of the past and future in the present. In: Chang, E.C., Sanna, L.J. (eds.) Virtue, Vice, and Personality: The Complexity of Behavior, pp. 105–124. American Psychological Association (2003).https://doi.org/10.1037/10614-007

36. Shalev-Shwartz, S., et al.: Online learning and online convex optimization. Found. Trends Mach. Learn.4(2), 107–194 (2011).https://doi.org/10.1561/2200000018

    Article MATH  Google Scholar 

37. Skinner, B.: Operant conditioning. In: The Encyclopedia of Education, vol. 7, pp. 29–33

    Google Scholar 

38. Smith, T.A., Kimball, D.R.: Learning from feedback: spacing and the delay-retention effect. J. Exp. Psychol. Learn. Mem. Cogn.36(1), 80 (2010)

    Article  Google Scholar 

39. Staddon, J.E., Cerutti, D.T.: Operant conditioning. Annu. Rev. Psychol.54(1), 115–144 (2003)

    Article  Google Scholar 

40. Touretzky, D.S., Saksida, L.M.: Operant conditioning in Skinnerbots. Adapt. Behav.5(3–4), 219–247 (1997)

    Article  Google Scholar 

41. Touretzky, D., Saksida, L.: Skinnerbots. In: Maes, P., Mataric, M., Meyer, J.A., Pollack, J., Wilson, S.W. (eds.) From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, pp. 285–294. MIT Press, Cambridge (1996)

    Google Scholar 

42. Van de Ven, N., Zeelenberg, M.: Regret aversion and the reluctance to exchange lottery tickets. J. Econ. Psychol.32(1), 194–200 (2011)

    Article  Google Scholar 

43. Weick, K.E.: The role of imagination in the organizing of knowledge. Eur. J. Inf. Syst.15(5), 446–452 (2006).https://doi.org/10.1057/palgrave.ejis.3000634

    Article  Google Scholar 

44. Zeelenberg, M., Pieters, R.: Consequences of regret aversion in real life: the case of the Dutch postcode lottery. Organ. Behav. Hum. Decis. Process.93(2), 155–168 (2004)

    Article  Google Scholar 

45. Zeelenberg, M., Van Dijk, W.W., Manstead, A.S.R., der Pligt, J.: The experience of regret and disappointment. Cogn. Emot.12(2), 221–230 (1998)

    Article  Google Scholar 

46. Zhang, Z., Ji, X.: Regret minimization for reinforcement learning by evaluating the optimal bias function. In: Advances in Neural Information Processing Systems, vol. 32 (2019).https://proceedings.neurips.cc/paper/2019/file/9e984c108157cea74c894b5cf34efc44-Paper.pdf

47. Zinkevich, M., Johanson, M., Bowling, M., Piccione, C.: Regret minimization in games with incomplete information. In: Proceedings of the 20th International Conference on Neural Information Processing Systems (NIPS 2007), pp. 1729–1736. Curran Associates Inc., Red Hook (2007)

    Google Scholar 

Download references