SoccerUtter

This is a multimodal Java application that generates database queries from sketch and speech inputs.

Requirements

• Java with JavaFX SDK
• A drawing surface
• A microphone
• LibSVM for Java
• Sketched symbol feature extractor
• IrisTK
• Google Cloud Speech API Account
• Windows 7 or higher

How to use

• Install Java SDK and JavaFX.
• Install IrisTK by following the steps outlined here.
• Follow the steps given under Open vocabulary recognizers title in this tutorial.
• On command line (cmd.exe), browse to the main IrisTK directory (probably <your_home_directory>/IrisTK) by cmd <path_to_iristk>
• Type iristk create simple_dialog soccer_utter and then iristk eclipse.
• Import the main IrisTK folder (which is where you are on terminal now) to Eclipse.
• Copy all the files in this repository to app/soccer_utter folder in your project.
• Add LibSVM jar file to path
• Install sketched symbol feature extractor (details)
• In this file (main class), at line 83, change the path to the directory containing these files (feature extraction script and SVM model).
• Click Run.

Sample Usage

Watch this video to understand how to interact with the interface.

Credits

• IrisTK - iristk.net
• Ozan Can Altıok - oaltiok15 at ku dot edu dot tr - Koç University Intelligent User Interfaces Laboratory