Skip to content

Node JS app for interacting with your voice in 3D audio applications via osc

License

Notifications You must be signed in to change notification settings

lukirs95/speechToEmotion

Repository files navigation

speechToEmotion

Node JS app for interacting with your voice in 3D audio applications via osc (currently only german language supported!)

info

You need a working nodeJS environment with npm on your machine. You can download it from: https://nodejs.org/en/download/

usage

For normal localhost mode (Example: Max/MSP runs on this machine), just type: "npm start".

this means

  • reach web frontend just by typing the https://"IP address of this machine" in your chrome browser on your device.
  • receive compass data via OSC (0 - 360 deg) on port 8001.
  • compass OSC address: /gyrosc/compass
  • send speech to applications runnig on this machine via OSC on port 8002.
  • compass range 0 - 360 degrees

important

The web frontend is served on https with a self-signed certificate. There will be a warning, that the site is insecure! This is normal.

flags

You can set custom IP and Ports for communicating with machines on your local network.

syntax: "node app.js [flag value]"
(Example: node app.js -i 192.168.1.124 -p 1234)
Flag Value if set
i IPv4 address change OSC receiver IP
s NUMBER change OSC receiver port
r NUMBER change OSC receive port (compass)
p NUMBER change Website port
f has no value constantly send compass segment
a /address/compass/... change compass OSC pattern
c has no value change compass {-180/180}

change vocabulray

in the file words.json you can see the words the system knows already. You can simply add your own words and categories.

structure

vocab: {
  your-new-category: {
    words: ["some", "words", "or complete sentences" ]
    neg: "the opposite catagory in case of negation"
    }
}

About

Node JS app for interacting with your voice in 3D audio applications via osc

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published