A New AI Evaluation Cosmos: Ready to Play the Game?
Hernández‐Orallo, José, Baroni, Marco, Bieger, Jordi, Chmait, Nader, Dowe, David L., Hofmann, Katja, Martínez‐Plumed, Fernando, Strannegård, Claes, Thórissons, Kristinn R.
Published in The AI magazine (22.09.2017)
Published in The AI magazine (22.09.2017)
Get full text
Journal Article
A general supply-inspect cost framework to regulate the reliability-usability trade-offs for few-shot inference
Martínez-Plumed, Fernando, Jaimovitch-López, Gonzalo, Ferri, Cèsar, Ramírez-Quintana, María José, Hernández-Orallo, José
Published in Complex & intelligent systems (01.12.2024)
Published in Complex & intelligent systems (01.12.2024)
Get full text
Journal Article
Futures of artificial intelligence through technology readiness levels
Martínez-Plumed, Fernando, Gómez, Emilia, Hernández-Orallo, José
Published in Telematics and informatics (01.05.2021)
Published in Telematics and informatics (01.05.2021)
Get full text
Journal Article
Larger and more instructable language models become less reliable
Zhou, Lexin, Schellaert, Wout, Martínez-Plumed, Fernando, Moros-Daval, Yael, Ferri, Cèsar, Hernández-Orallo, José
Published in Nature (London) (03.10.2024)
Published in Nature (London) (03.10.2024)
Get full text
Journal Article
Computer models solving intelligence test problems: Progress and implications
Hernández-Orallo, José, Martínez-Plumed, Fernando, Schmid, Ute, Siebers, Michael, Dowe, David L.
Published in Artificial intelligence (01.01.2016)
Published in Artificial intelligence (01.01.2016)
Get full text
Journal Article
Can language models automate data wrangling?
Jaimovitch-López, Gonzalo, Ferri, Cèsar, Hernández-Orallo, José, Martínez-Plumed, Fernando, Ramírez-Quintana, María José
Published in Machine learning (01.06.2023)
Published in Machine learning (01.06.2023)
Get full text
Journal Article
Research community dynamics behind popular AI benchmarks
Martínez-Plumed, Fernando, Barredo, Pablo, hÉigeartaigh, Seán Ó, Hernández-Orallo, José
Published in Nature machine intelligence (01.07.2021)
Published in Nature machine intelligence (01.07.2021)
Get full text
Journal Article
Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models
Schellaert, Wout, Martínez-Plumed, Fernando, Vold, Karina, Burden, John, A. M. Casares, Pablo, Sheng Loe, Bao, Reichart, Roi, Ó hÉigeartaigh, Sean, Korhonen, Anna, Hernández-Orallo, José
Published in The Journal of artificial intelligence research (01.01.2023)
Published in The Journal of artificial intelligence research (01.01.2023)
Get full text
Journal Article
Knowledge acquisition with forgetting: an incremental and developmental setting
Martínez-Plumed, Fernando, Ferri, Cèsar, Hernández-Orallo, José, Ramírez-Quintana, María J
Published in Adaptive behavior (01.10.2015)
Published in Adaptive behavior (01.10.2015)
Get full text
Journal Article
Mapping Intelligence: Requirements and Possibilities
Bhatnagar, Sankalp, Alexandrova, Anna, Avin, Shahar, Cave, Stephen, Cheke, Lucy, Crosby, Matthew, Feyereisl, Jan, Halina, Marta, Loe, Bao Sheng, Ó hÉigeartaigh, Seán, Martínez-Plumed, Fernando, Price, Huw, Shevlin, Henry, Weller, Adrian, Winfield, Alan, Hernández-Orallo, José
Published in Philosophy and Theory of Artificial Intelligence 2017 (2018)
Published in Philosophy and Theory of Artificial Intelligence 2017 (2018)
Get full text
Book Chapter
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
Tolan, Songül, Pesole, Annarosa, Martínez-Plumed, Fernando, Fernández-Macías, Enrique, Hernández-Orallo, José, Gómez, Emilia
Published in The Journal of artificial intelligence research (2021)
Published in The Journal of artificial intelligence research (2021)
Get full text
Journal Article