Abstraction and Reasoning Challenge

  • 2 Replies
  • 126 Views
*

infurl

  • Trusty Member
  • ********
  • Replicant
  • *
  • 700
  • Humans will disappoint you.
    • Home Page
Abstraction and Reasoning Challenge
« on: February 14, 2020, 03:01:41 AM »
https://www.kaggle.com/c/abstraction-and-reasoning-challenge/overview

Quote
In this competition, you’ll create an AI that can solve reasoning tasks it has never seen before. Each ARC task contains 3-5 pairs of train inputs and outputs, and a test input for which you need to predict the corresponding output with the pattern learned from the train examples.

There's a total prize pool of $20k available in this competition. You will need programming skills to enter. You will probably also need to lease some expensive hardware in the cloud to work on it, although I think kaggle may offer access for free. Does anyone have experience with kaggle?

https://www.kaggle.com/

*

infurl

  • Trusty Member
  • ********
  • Replicant
  • *
  • 700
  • Humans will disappoint you.
    • Home Page
Re: Abstraction and Reasoning Challenge
« Reply #1 on: February 14, 2020, 03:05:04 AM »
You can find hints and tips for getting started in the comments on the challenge page.

There is also a Twitter thread about it.

https://twitter.com/fchollet/status/1228056479854317568

*

infurl

  • Trusty Member
  • ********
  • Replicant
  • *
  • 700
  • Humans will disappoint you.
    • Home Page
Re: Abstraction and Reasoning Challenge
« Reply #2 on: February 19, 2020, 10:13:54 PM »
https://bdtechtalks.com/2020/02/19/kaggle-arc-challenge-francois-chollet/

This article provides some more background for the Abstract Reasoning Challenge. It goes into some detail about why this challenge is so important.

Quote
The Abstract Reasoning Corpus is a set of problem-solving tasks that require general problem-solving skills. There are a few things about ARC that make it especially interesting. First, there aren’t a ton of training examples. The system that wants to solve a set of problems has to learn the rules from a few examples
Quote
Another important aspect of ARC is that it levels the ground between AI and humans. The current artificial intelligence landscape is composed of many challenging fields such as computer vision and natural language processing.

Comparing AI performance to humans in those fields is very difficult because we humans have a lot of prior knowledge about the world and can easily take on new challenges. There still isn’t an AI system that incorporates that kind of knowledge. Therefore, any challenge that surrounding image classification and natural language would put AI algorithms at a disadvantage.

But ARC is based on simple visual elements that are easy to parse and require no prior. They strip the advantage that humans have and make it fairer for AI systems to compete. Humans can easily solve most of the problems proposed in ARC not because of their vast knowledge of the world, but thanks to their abstraction and reasoning capabilities.
Quote
Despite the enormity (and impossibility) of the task, at the time of this writing, more than 190 teams have applied for the ARC challenge and will be testing their skills. It will be interesting how the competition develops. And perhaps more importantly, it will be exciting to see what new discoveries we make in the interim.

 


NC girl born without eyes or nose graduates from college
by LOCKSUIT (General AI Discussion)
Today at 08:07:59 AM
roomba alg
by LOCKSUIT (General AI Discussion)
February 20, 2020, 09:57:38 PM
How Lucid are your thoughts?
by Art (General AI Discussion)
February 20, 2020, 05:50:35 PM
XKCD Comic : Picking Bad Stocks
by Tyler (XKCD Comic)
February 20, 2020, 12:01:19 PM
A single neuron in Bash script
by Dat D (AI Programming)
February 20, 2020, 05:35:48 AM
beyond omega level coding
by yotamarker (General AI Discussion)
February 19, 2020, 03:06:32 PM
'My Soul Has a Hat'
by LOCKSUIT (General Chat)
February 19, 2020, 06:00:51 AM
Green Light
by Hopefully Something (AI in Film and Literature.)
February 18, 2020, 05:24:28 AM

Users Online

11 Guests, 3 Users
Users active in past 15 minutes:
WriterOfMinds, Hopefully Something, LOCKSUIT
[Trusty Member]

Most Online Today: 25. Most Online Ever: 340 (March 26, 2019, 09:47:57 PM)

Articles