Call for Participants

The first Machine Automated IQ Test Challenge (MAIQ) at IJCAI’2020

AI benchmarking becomes an increasingly important task for the rapid development of AI research. Meaningful AI benchmarks, such as ImageNet and RoboCup not only provide a standard testbed for comparing different AI approaches, but also significantly promote and stimulate AI research.

As one of the predominant benchmarks for measuring human intelligence, Intelligence Quotient (IQ) test provides a natural and excellent AI benchmark for testing the current development of AI research. For better solving IQ tests automatedly by machines, one needs to use, combine and advance many areas in AI including knowledge representation and reasoning, machine learning, natural language processing and image understanding.

The IJCAI-2020 Machine Automated IQ Test Challenge (MAIQ’2020) contains three categories including verbal comprehension, diagram reasoning and sequence reasoning, all questions are collected from genuine IQ Test questions for human being. By given a SDK and some dataset, participants are required to develop programs to solve these problems automatically.

You can sign up https://iqtest.pub as a team to participate in the competition by clicking the “IJCAI’20 MAIQ Competition” button on the front page and following the instruction.

Finalists are invited to attend IJCAI’2020 for the on-site competition, on which the final ranking will be made and announced. Also, finalists are strongly encouraged to open their source codes as well as to submit a paper describing how their systems work.

The champion and the runner-up teams are requested either to open their source code or to submit a system paper.

Website URL

The competition webpage has been released at https://iqtest.pub

Fast Track for competition material

Important dates:

Mar/10, 2020 Call for participants

Apr/15, submission site open

Jun/01, submission deadline

Jun/15, finalist announcement

Jul/15, IJCAI’20 onsite final competition

Aug/01, post-proceeding paper submission deadline