Nanosemantics is collaborating with the OpenTalks.AI conference to organize a Turing Test for Russian-speaking chatbots, which will be held on February 14-16 in Moscow.
The Turing Test previously took place twice in Russia.
In 2015, it was organized by Nanosemantics Lab together with the Skolkovo Foundation at the Startup Village conference. The winner was the bot Sonya Guseva - 47% of the judges took her for a person. Sonya’s creators are part of the Inobot team, led by Ivan Golubev. He is currently a project manager at Just AI.
In 2016, we held the Turing Test together with Microsoft and Skolkovo. The winner was Ivan Shumilov.
What is a Turing Test?
The test is titled after the English mathematician Alan Turing. The goal of the test is to determine robots’ ability to maintain a believable conversation with a human. The robot passes the test if an independent expert can’t tell a human from a robot in the process of parallel and anonymous communication with both.
New contest rules
The 2019 Turing Test will be different.
After registering for the contest, participants will receive anonymous logins through which they can connect their chatbots to a single API that Nanosemantics will provide three weeks prior to the event. Each participant can provide up to 3 bots for the contest. The name of each bot should be original and unique, for example, Blonde Penny or Know-It-All Sheldon.
For each bot, a human volunteer will serve as a counterpart. The task of this person is to play the role of the robot, mimicking its personality while communicating with experts.
Anyone present at the venue from February 14 to 16 will have the chance to talk with all the bots and volunteers through the Telegram bot. Anyone can become an expert, talk with several interlocutors and try to guess who they are talking to in the span of 6 questions. The expert will only see the name of the test subject, who can be either a bot or a person.
The bot whom most of the independent experts deem to be human will be recognized as the best one. Prizes will be awarded to 3 teams that developed chatbots, 3 volunteers who played the role of a bot most convincingly and 3 experts who made the most accurate guesses.
Contest Roadmap
December 28, 2018 – The announcement of the contest and the publication of its rules. The start of the registration process for applicants
January 24, 2019 - Launching the API for participating teams
February 7, 2019 - End of registration
February 12, 2019 - Testing bots. Volunteer training
February 14, 2019 - Start of the Turing Test
February 16, 2019 - End of the Turing Test. Reviewing results and awarding the winners
You can keep up with all the contest updates on the event website. Everyone who wants to take part in the Turing Test will be able to do this on February 14-16 through the Telegram bot @TuringTestRussiaBot.
Nanosemantics is collaborating with the OpenTalks.AI conference to organize a Turing Test for Russian-speaking chatbots, which will be held on February 14-16 in Moscow.