[Sujet officiel] l'assistant vocal Snips 100% privé (Plugin développé pour jeedom)

[benj29]

Désolé, mais j'ai bien installé l'application officielle de "snips" jeedom.



Je vois bien que les lumières sont dans LightsSetJeedom



De toutes les manières, après avoir déployé cet assistant que ce soit avec ce binding dans LightsSetJeedom ou dans TurnOnJeedom, si je dis "allume la lumière du salon", il ne comprend pas...

J'aimerai bien comprendre comment vous y arriver ! (j'ai bien sûr activer et désactiver l'un ou l'autre pour mes essais).

1er cas dans lightsSetJeedom :



Me donne ceci dans watch :

Code : Tout sélectionner

[22:43:55] Watching on localhost:1883 (MQTT)
[22:45:47] [Hotword] detected on site satellite1, for model default
[22:45:47] [Asr] was asked to stop listening on site satellite1
[22:45:47] [Hotword] was asked to toggle itself 'off' on site satellite1
[22:45:47] [Dialogue] session with id '7bc85fb6-f0a7-4a37-94a4-a693b906c494' was started on site satellite1
[22:45:47] [AudioServer] was asked to play a wav of 41.1 kB with id 'd94e845f-7c4d-47dd-9183-314b33e2f576' on site satellite1
[22:45:47] [AudioServer] finished playing wav with id 'd94e845f-7c4d-47dd-9183-314b33e2f576'
[22:45:47] [Asr] was asked to listen on site satellite1
[22:45:50] [Asr] captured text "allume la lumière du salon" in 2.0s
[22:45:50] [Asr] was asked to stop listening on site satellite1
[22:45:50] [AudioServer] was asked to play a wav of 93.1 kB with id '6b4ce5c2-32ff-428a-848e-d8847008962a' on site satellite1
[22:45:50] [Asr] captured text "allume la lumière du salon" in 2.0s
[22:45:50] [AudioServer] was asked to play a wav of 61.1 kB with id '721f832b-6b63-45c4-9a08-9f14ac30b2f5' on site satellite1
[22:45:51] [AudioServer] finished playing wav with id '6b4ce5c2-32ff-428a-848e-d8847008962a'
[22:45:52] [AudioServer] finished playing wav with id '721f832b-6b63-45c4-9a08-9f14ac30b2f5'
[22:45:52] [Dialogue] session with id '7bc85fb6-f0a7-4a37-94a4-a693b906c494' was ended on site satellite1. The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload  }, with response: AsrCapture(AsrPayload { text: "allume la lumière du salon", tokens: Some([AsrTokenPayload { value: "allume", confidence: 0.94787884, range_start: 0, range_end: 6, time: AsrDecodingDurationPayload { start: 0.0, end: 1.0215635 } }, AsrTokenPayload { value: "la", confidence: 1.0, range_start: 7, range_end: 9, time: AsrDecodingDurationPayload { start: 1.0215635, end: 1.29 } }, AsrTokenPayload { value: "lumière", confidence: 1.0, range_start: 10, range_end: 17, time: AsrDecodingDurationPayload { start: 1.29, end: 1.4399999 } }, AsrTokenPayload { value: "du", confidence: 1.0, range_start: 18, range_end: 20, time: AsrDecodingDurationPayload { start: 1.4399999, end: 1.5899999 } }, AsrTokenPayload { value: "salon", confidence: 1.0, range_start: 21, range_end: 26, time: AsrDecodingDurationPayload { start: 1.5899999, end: 2.52 } }]), likelihood: 0.9893514, seconds: 2.0 })

[22:45:52] [Asr] was asked to stop listening on site satellite1
[22:45:52] [Hotword] was asked to toggle itself 'on' on site satellite1

De même si je disable le binding et que j'active l'autre dans TurnOnJeedom :

Code : Tout sélectionner

[22:45:52] [Asr] was asked to stop listening on site satellite1
[22:45:52] [Hotword] was asked to toggle itself 'on' on site satellite1
[22:47:43] [Hotword] detected on site satellite1, for model default
[22:47:43] [Asr] was asked to stop listening on site satellite1
[22:47:43] [Hotword] was asked to toggle itself 'off' on site satellite1
[22:47:43] [Dialogue] session with id '8c1b6cb0-f84c-4e9b-8b2e-156dcfa9c70c' was started on site satellite1
[22:47:43] [AudioServer] was asked to play a wav of 41.1 kB with id 'b4ccb804-7076-4c14-a2fb-c3ccae8d23a1' on site satellite1
[22:47:44] [AudioServer] finished playing wav with id 'b4ccb804-7076-4c14-a2fb-c3ccae8d23a1'
[22:47:44] [Asr] was asked to listen on site satellite1
[22:47:46] [Asr] captured text "allume la lumière du salon" in 2.0s
[22:47:46] [Asr] was asked to stop listening on site satellite1
[22:47:46] [AudioServer] was asked to play a wav of 93.1 kB with id 'd1dea8ef-6284-499e-919f-409c92510ca7' on site satellite1
[22:47:47] [Asr] captured text "allume la lumière du salon" in 2.0s
[22:47:47] [AudioServer] was asked to play a wav of 61.1 kB with id '6af8351f-82cf-41e5-8286-323de22e8a3b' on site satellite1
[22:47:48] [AudioServer] finished playing wav with id 'd1dea8ef-6284-499e-919f-409c92510ca7'
[22:47:48] [AudioServer] finished playing wav with id '6af8351f-82cf-41e5-8286-323de22e8a3b'
[22:47:48] [Dialogue] session with id '8c1b6cb0-f84c-4e9b-8b2e-156dcfa9c70c' was ended on site satellite1. The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload  }, with response: AsrCapture(AsrPayload { text: "allume la lumière du salon", tokens: Some([AsrTokenPayload { value: "allume", confidence: 0.9478732, range_start: 0, range_end: 6, time: AsrDecodingDurationPayload { start: 0.0, end: 0.84156376 } }, AsrTokenPayload { value: "la", confidence: 1.0, range_start: 7, range_end: 9, time: AsrDecodingDurationPayload { start: 0.84156376, end: 1.05 } }, AsrTokenPayload { value: "lumière", confidence: 1.0, range_start: 10, range_end: 17, time: AsrDecodingDurationPayload { start: 1.05, end: 1.23 } }, AsrTokenPayload { value: "du", confidence: 1.0, range_start: 18, range_end: 20, time: AsrDecodingDurationPayload { start: 1.23, end: 1.38 } }, AsrTokenPayload { value: "salon", confidence: 1.0, range_start: 21, range_end: 26, time: AsrDecodingDurationPayload { start: 1.38, end: 2.31 } }]), likelihood: 0.9893502, seconds: 2.0 })

[22:47:48] [Asr] was asked to stop listening on site satellite1
[22:47:48] [Hotword] was asked to toggle itself 'on' on site satellite1

Pareil... je pige pas.

[benj29]

De même avec un binding pour la télévision sur turnonjeedom ... que ce soit sur mets ou allume aussi j'ai essayé.

Code : Tout sélectionner

[22:53:30] [AudioServer] finished playing wav with id 'd10d0ede-aeb2-4e58-9777-12b310ecc5b7'
[22:53:30] [Asr] was asked to listen on site satellite1
[22:53:32] [Asr] captured text "mets la télévision" in 2.0s
[22:53:32] [Asr] was asked to stop listening on site satellite1
[22:53:32] [AudioServer] was asked to play a wav of 93.1 kB with id '1a92f762-0e47-4d6d-8064-e0922d1ffade' on site satellite1
[22:53:32] [Asr] captured text "mets la télévision" in 2.0s
[22:53:32] [AudioServer] was asked to play a wav of 61.1 kB with id 'bfb9ff17-478a-4e93-84a4-0128827d9838' on site satellite1
[22:53:34] [AudioServer] finished playing wav with id '1a92f762-0e47-4d6d-8064-e0922d1ffade'
[22:53:34] [AudioServer] finished playing wav with id 'bfb9ff17-478a-4e93-84a4-0128827d9838'
[22:53:34] [Dialogue] session with id 'dc8406cf-71b7-4445-9912-31c0ce8df5f0' was ended on site satellite1. The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload  }, with response: AsrCapture(AsrPayload { text: "mets la télévision", tokens: Some([AsrTokenPayload { value: "mets", confidence: 0.8791925, range_start: 0, range_end: 4, time: AsrDecodingDurationPayload { start: 0.0, end: 0.6636242 } }, AsrTokenPayload { value: "la", confidence: 1.0, range_start: 5, range_end: 7, time: AsrDecodingDurationPayload { start: 0.6636242, end: 0.75 } }, AsrTokenPayload { value: "télévision", confidence: 1.0, range_start: 8, range_end: 18, time: AsrDecodingDurationPayload { start: 0.75, end: 0.75 } }]), likelihood: 0.95799077, seconds: 2.0 })

[22:53:34] [Asr] was asked to stop listening on site satellite1
[22:53:34] [Hotword] was asked to toggle itself 'on' on site satellite1
[22:53:51] [Hotword] detected on site satellite1, for model default
[22:53:51] [Asr] was asked to stop listening on site satellite1
[22:53:51] [Hotword] was asked to toggle itself 'off' on site satellite1
[22:53:51] [Dialogue] session with id 'a5baf3e1-9996-4b14-b04a-4ddb1af25f6d' was started on site satellite1
[22:53:51] [AudioServer] was asked to play a wav of 41.1 kB with id 'a27de538-91d6-4f91-90ed-8199c0d215f7' on site satellite1
[22:53:51] [AudioServer] finished playing wav with id 'a27de538-91d6-4f91-90ed-8199c0d215f7'
[22:53:51] [Asr] was asked to listen on site satellite1
[22:53:54] [Asr] captured text "allume la télévision" in 2.0s
[22:53:54] [Asr] was asked to stop listening on site satellite1
[22:53:54] [AudioServer] was asked to play a wav of 93.1 kB with id '815fe027-9158-4e45-9d89-1e0c00ee86b9' on site satellite1
[22:53:54] [Asr] captured text "allume la télévision" in 2.0s
[22:53:54] [AudioServer] was asked to play a wav of 61.1 kB with id '239f1b5b-c7b2-46c0-8ad1-477252093692' on site satellite1
[22:53:55] [AudioServer] finished playing wav with id '815fe027-9158-4e45-9d89-1e0c00ee86b9'
[22:53:55] [AudioServer] finished playing wav with id '239f1b5b-c7b2-46c0-8ad1-477252093692'
[22:53:55] [Dialogue] session with id 'a5baf3e1-9996-4b14-b04a-4ddb1af25f6d' was ended on site satellite1. The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload  }, with response: AsrCapture(AsrPayload { text: "allume la télévision", tokens: Some([AsrTokenPayload { value: "allume", confidence: 0.9478787, range_start: 0, range_end: 6, time: AsrDecodingDurationPayload { start: 0.0, end: 0.90156364 } }, AsrTokenPayload { value: "la", confidence: 1.0, range_start: 7, range_end: 9, time: AsrDecodingDurationPayload { start: 0.90156364, end: 1.0799999 } }, AsrTokenPayload { value: "télévision", confidence: 1.0, range_start: 10, range_end: 20, time: AsrDecodingDurationPayload { start: 1.0799999, end: 2.31 } }]), likelihood: 0.98231536, seconds: 2.0 })

[22:53:55] [Asr] was asked to stop listening on site satellite1
[22:53:55] [Hotword] was asked to toggle itself 'on' on site satellite1

[Hydro]

Tu as essayé de faire "Sam watch vvv" pour avoir plus d'info ?

Perso quand je dis quelque chose, dans Sam watch je vois quelle action il trouve.

Sinon j'ai eu le même genre de problème, j'ai du réinstaller snips du côté jeedom, sûrement pour refaire la connexion entre les deux.

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Sérieux c'est n'importe quoi... Déjà il m'a fallu et encore merci aux personnes qui m'ont aidées presque 10j d'essais acharnés pour faire marcher snips et là tu me dis de réinstaller

Envoyé de mon JSN-L21 en utilisant Tapatalk

[Hydro]

Juste le plugin jeedom, ou peut être relancer la détection des commandes fonctionne.

Après c'est pas certain ^^ mais chez moi sa a fonctionné quand j'avais pas d'action détecté dans le Sam watch.

A voir tes logs avec vvv

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Tu as essayé de faire "Sam watch vvv" pour avoir plus d'info ?

Perso quand je dis quelque chose, dans Sam watch je vois quelle action il trouve.

Sinon j'ai eu le même genre de problème, j'ai du réinstaller snips du côté jeedom, sûrement pour refaire la connexion entre les deux.

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

J'ai fait sam watch vvv comme tu m'as dit mais j'ai exactement le même log que j'ai copié en haut.
Donc deux cas, soit tu n'as pas vu le log que j'avais donné, soit je n'ai pas compris.

Donc si je dis jarvis .... allume la lumière du salon.
Voilà ce que j'ai dans le log.

Code : Tout sélectionner

[14:19:45] [Hotword] was asked to toggle itself 'off' on site satellite1
[14:19:45] [Dialogue] session with id 'aef9a581-254b-4298-ae8d-a17723b95a69' was started on site satellite1
[14:19:45] [AudioServer] was asked to play a wav of 41.1 kB with id '8cabe675-5986-4c47-ae83-13fec7054200' on site satellite1
[14:19:46] [AudioServer] finished playing wav with id '8cabe675-5986-4c47-ae83-13fec7054200'
[14:19:46] [Asr] was asked to listen on site satellite1
[14:19:49] [Asr] captured text "allume la lumière du salon" in 2.0s
[14:19:49] [Asr] was asked to stop listening on site satellite1
[14:19:49] [AudioServer] was asked to play a wav of 93.1 kB with id '88ac185a-8b7a-47f3-bce5-a94c06b6bae6' on site satellite1
[14:19:49] [Asr] captured text "allume la lumière du salon" in 3.0s
[14:19:49] [AudioServer] was asked to play a wav of 61.1 kB with id 'cfde140c-8492-4f82-9de1-6bec15e9711f' on site satellite1
[14:19:50] [AudioServer] finished playing wav with id '88ac185a-8b7a-47f3-bce5-a94c06b6bae6'
[14:19:50] [AudioServer] finished playing wav with id 'cfde140c-8492-4f82-9de1-6bec15e9711f'
[14:19:50] [Dialogue] session with id 'aef9a581-254b-4298-ae8d-a17723b95a69' was ended on site satellite1. The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload  }, with response: AsrCapture(AsrPayload { text: "allume la lumière du salon", tokens: Some([AsrTokenPayload { value: "allume", confidence: 0.94787294, range_start: 0, range_end: 6, time: AsrDecodingDurationPayload { start: 0.0, end: 1.3815638 } }, AsrTokenPayload { value: "la", confidence: 1.0, range_start: 7, range_end: 9, time: AsrDecodingDurationPayload { start: 1.3815638, end: 1.62 } }, AsrTokenPayload { value: "lumière", confidence: 1.0, range_start: 10, range_end: 17, time: AsrDecodingDurationPayload { start: 1.62, end: 1.74 } }, AsrTokenPayload { value: "du", confidence: 1.0, range_start: 18, range_end: 20, time: AsrDecodingDurationPayload { start: 1.74, end: 1.89 } }, AsrTokenPayload { value: "salon", confidence: 1.0, range_start: 21, range_end: 26, time: AsrDecodingDurationPayload { start: 1.89, end: 2.73 } }]), likelihood: 0.98935014, seconds: 3.0 })

[14:19:50] [Asr] was asked to stop listening on site satellite1
[14:19:50] [Hotword] was asked to toggle itself 'on' on site satellite1

Déjà je vois qu'il voit deux fois "allume la lumière du salon"


Ensuite dans le log je vois :
The session was ended because an error happened: Event not supported: Response { waiting: AudioFinishedPayload }
Ensuite j'ai l'impression qu'il extrait les mots mais pour autant aucune correspondance claire.

[Hydro]

Voilà mon log pour la lumière :

[14:32:13] Watching on localhost:1883 (MQTT)
[14:32:20] [Hotword] detected on site salon, for model hey_snips
[14:32:20] [Asr] was asked to stop listening on site salon
[14:32:20] [Hotword] was asked to toggle itself 'off' on site salon
[14:32:20] [Dialogue] session with id 'b035910c-c4f5-4f94-ad8c-f10ee6f13ad1' was started on site salon
[14:32:20] [AudioServer] was asked to play a wav of 41.1 kB with id 'f27b13ee-928a-4148-bd60-7efa9b1afcbe' on site salon
[14:32:21] [AudioServer] finished playing wav with id 'f27b13ee-928a-4148-bd60-7efa9b1afcbe'
[14:32:21] [Asr] was asked to listen on site salon
[14:32:24] [Asr] captured text "allume la lumière" in 2.0s
[14:32:24] [Asr] was asked to stop listening on site salon
[14:32:24] [AudioServer] was asked to play a wav of 93.1 kB with id 'c47c7012-52ec-49eb-821f-439548b65f95' on site salon
[14:32:25] [AudioServer] finished playing wav with id 'c47c7012-52ec-49eb-821f-439548b65f95'
[14:32:25] [Nlu] was asked to parse input "allume la lumière"
[14:32:25] [Nlu] detected intent lightsSetJeedom with probability 0.996 for input "allume la lumière"
[14:32:25] [Dialogue] New intent detected lightsSetJeedom with probability 0.996
[14:32:25] [Dialogue] was ask to end session with id b035910c-c4f5-4f94-ad8c-f10ee6f13ad1 by saying ''
[14:32:25] [Dialogue] session with id 'b035910c-c4f5-4f94-ad8c-f10ee6f13ad1' was ended on site salon. The session ended as expected
[14:32:25] [Asr] was asked to stop listening on site salon
[14:32:25] [Hotword] was asked to toggle itself 'on' on site salon

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Je suis en train de virer totalement le plugin effectivement il était complètement crashé. J'avais beau activé ou non un binding ou un intent, il n'y voyait que du feu.

Sérieux, ça me laisse très très perplexe devant Snips...

[Hydro]

Je suis de ton avis, l'utilisation pourrait être sympa mais l'installation reste compliqué surtout sur VM alors que la plupart des gens utilisent ce mode.

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Les alternatives correctes sont limitées...
Openjarvis et c'est tout j'ai l'impression.
Il y a aussi autre chose qui m'embête avec SNIPS, deux points :

- la startup a ouvert son moteur, OK. Mais le jour où il souhaite le licencier pour le vendre à des entreprises, on fait quoi ? on pleure ?
- la voix robotisé est vraiment moche. Mon fils m'a dit "elle parle pas bien la dame..." t'as tout compris !

[Hydro]

1 - ce problème je pense peut arriver avec toutes les solutions open source comme jeedom. Après ton installation local restera fonctionnelle.

2 - c'est le problème du tts offline. Je crois il y a un script sur le forum snips pour passer de Google tts a la version offline en cas de coupure internet.

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Non open source, tu as les sources.
Snips, tu n'as pas les sources, sauf erreur.

On va déjà tester un peu snips sinon je me rabattrai sur jarvis. Tant pis.

[Hydro]

Je ne sais pas si c'est normal mais si j'attache un scénario a l'action et aucun biding, j'ai une erreur dans Sam watch alors que le scénario se lance bien.

Par contre si j'ai un binding, l'action se termine bien.

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

J'ai réinstallé le plugin, sauf que maintenant il ne voit plus le satellite.
J'ai ensuite tenté de supprimer l'assistant puis de le réinstaller, il ne veut plus se connecter à la VM ...
Sérieux, ça commence à me prendre la tête.
C'est vraiment le club méd ce truc... un coup ça marchotte, un coup non.

Bon de tout ce que j'ai lu snips marche à peu près en standalone complet sur un pi3 tout seul.
Sauf que dans une maison, je vais pas mettre un truc ! Il m'en faut plusieurs

[Hydro]

Comment tu sais qu'il veut plus se co ?

Envoyé de mon ONEPLUS A3003 en utilisant Tapatalk

[benj29]

Il m'indique que le serveur n'est pas joignable alors qu'il l'est bien...

Envoyé de mon JSN-L21 en utilisant Tapatalk

[dcjona]

T'auras été un bon beta testeur en tout cas je pense que tu as eu toutes les pannes possibles. Je comprends même pas comment j'y suis arrivé en voyant ce que tu rencontre...

Envoyé de mon Redmi 5 Plus en utilisant Tapatalk

[benj29]

Mais tu as une VM et des satellites ???

Envoyé de mon JSN-L21 en utilisant Tapatalk

[dcjona]

Oui et la config A et j'ai suis le tuto en page 49 rien d'autres..

Envoyé de mon Redmi 5 Plus en utilisant Tapatalk

[benj29]

Bon je vais encore recommencer

Envoyé de mon JSN-L21 en utilisant Tapatalk