r/LearningMachines

153 archived posts · Jul 2023 – Apr 2024

Random post

u/michaelaalcorn•

Hey, all. Thanks for participating in this little experiment. Unfortunately, it doesn't seem like the subreddit ever hit the critical mass necessary to sustain itself, so I've decided to put r/LearningMachines in restricted mode so that I don't have to worry about moderating submissions. I'm happy to hand r/LearningMachines off to someone else who's interested with the requirement being that you are (1) not anonymous and (2) a machine learning professional (i.e., full-time in industry or academia). Thanks again, everyone!

241

u/1mprobability•

We introduce GAIA, a benchmark for General AI Assistants that, if solved, would represent a milestone in AI research. GAIA proposes real-world questions that require a set of fundamental abilities such as reasoning, multi-modality handling, web browsing, and generally tool-use proficiency. GAIA questions are conceptually simple for humans yet challenging for most advanced AIs: we show that human respondents obtain 92\% vs. 15\% for GPT-4 equipped with plugins. This notable performance disparity contrasts with the recent trend of LLMs outperforming humans on tasks requiring professional skills in e.g. law or chemistry. GAIA's philosophy departs from the current trend in AI benchmarks sugges

50