[Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

[Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby samuel_t » Sun Dec 22, 2019 6:29 pm

Hello! :) I created a plugin that allows you to interact with SketchUp (in English) with voice or text. Speech recognition is only available on Windows. Let me know if you want bot handle more actions.

=> You can download it from SketchUcation PluginStore.

Demos

chat_demo_1.png


chat_demo_2.png
3
Last edited by samuel_t on Sat Dec 28, 2019 6:19 pm, edited 3 times in total.
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby samuel_t » Tue Dec 24, 2019 1:33 am

What's new in 1.0.1 version?

- Chat bot understands following sentences*:

Open a file.
Select first entity.
Select first group.
Select first component.
Move selection 1m along X axis, 1m along Y axis and 1m along Z axis.
Rotate selection by 90 degrees.
Increase selection size 2 times.

- There is a "Virtual Assistant" toolbar in SU.

(*) Sentences are customizable.

Download latest Virtual Assistant plugin from SketchUcation PluginStore.
0
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby Anton_S » Tue Dec 24, 2019 3:37 am

Whoa! That's some nice work there. I can't wait to check it out. This has so much potential.
0

Anton_S 
PluginStore Author
PluginStore Author
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby Anton_S » Tue Dec 24, 2019 3:59 am

Is there a way to enable microphone? It would be good if it listens for your messages while the chat box window is minimized or not active.
0

Anton_S 
PluginStore Author
PluginStore Author
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby samuel_t » Tue Dec 24, 2019 5:40 pm

Anton_S wrote:Whoa! That's some nice work there. I can't wait to check it out. This has so much potential.


Thank you Anton! Let me know if you have ideas.

Anton_S wrote:Is there a way to enable microphone? It would be good if it listens for your messages while the chat box window is minimized or not active.


I found no way to enable microphone for now! :(
0
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby Anton_S » Wed Dec 25, 2019 1:32 am

samuel_t wrote:Let me know if you have ideas.

I have a few ideas, including:
  • Selecting an entity with name: select entity SomeEntityName
  • Look at entity with name
  • Zoom extents at entity with name / selected
  • Delete entity with name/selected
  • Active tool [ToolName]
samuel_t wrote:I found no way to enable microphone for now! :(

If you google JavaScript speech to text, you should see a number of solutions and libraries. For example, check out https://tutorialzine.com/2017/08/conver ... javascript

If user says an unrecognizable command, list a number of commands the are similar; allow creating aliases.
2

Anton_S 
PluginStore Author
PluginStore Author
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby samuel_t » Wed Dec 25, 2019 2:03 am

@Anton_S

Thanks again!
0
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.1 - 24 Dec. 2019

Postby samuel_t » Thu Dec 26, 2019 8:36 pm

Good news: next version will include speech recognition. :P
4
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby samuel_t » Sat Dec 28, 2019 6:22 pm

What's new in 1.0.2 version?

- Chat bot listens to your voice/microphone.
This requires Windows 64 bits & Chrome 25+.

- Chat bot understands following sentences:

- Select group with name ...
- Select instance with name ...
- Name ...
- Duplicate and name ...
- Clear selection.
- Delete.
- Activate Push Pull tool.
- Activate Rectangle tool.
- Activate ... tool.
- Write ...

- A "Did you mean" algo. was implemented.

- Chat bot understands somewhat quantities.

Download latest Virtual Assistant plugin from SketchUcation PluginStore.
2
User avatar
samuel_t 
 

Re: [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby Anton_S » Sun Jan 05, 2020 9:40 am

Nice! I tried the update with the microphone option and it works quite well. I do realize it is much faster to do things without saying but this can always be expanded to perform more complex operations.
1

Anton_S 
PluginStore Author
PluginStore Author
 

Re: [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby faust07 » Mon Jan 06, 2020 12:14 am

It is amazing when geniuses are found. I am thrilled and can hardly wait for the results. I would be particularly excited about the synergies for the MSPhysics area - voice input ...
Thanks again!
1

faust07 
 

Re: [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby bigfoot03242 » Sat May 09, 2020 12:37 am

This is a great Idea Does it use only windows is tht an additional function of cortana or narrator
0

bigfoot03242 
 

Re: [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

Postby samuel_t » Sun May 10, 2020 3:34 pm

bigfoot03242 wrote:This is a great Idea Does it use only windows is tht an additional function of cortana or narrator

It uses Google Chrome Speech Recognition.
0
User avatar
samuel_t 
 

SketchUcation One-Liner Adverts

by Ad Machine » 5 minutes ago



Ad Machine 
Robot
 



 

Return to Plugins

Who is online

Users browsing this forum: DigitalEye, gigi56, JohnnyWin, mariamhatem and 14 guests

Visit our sponsors: