2020_CSE_03: Week 5

 Fifth Week Progress(10/05/2021):

  • Added a textbox which can be used to store in all the textual content which the user wants to mail.
  • Used Speech Recognition to recognize all the contents the user would speak out and convert it into a textual format.
  • Used artyom.js throughout for speech synthesis 
  • Started testing out the Commands feature available in the artyom library.
  • Explored the speech synthesis package p5.speech.js to build a basic webpage which speaks out hardcoded text
  • Made a few changes in the basic extension which used chrome.tts.speech to speak out hardcoded text

 

In the next week: 

We will be integrating all of this an extension for testing purposes. We also will be testing out other stt and tts libraries to use in our project.

Comments

Post a Comment

Popular posts from this blog

2020_CSE_03 Week 09

 Week 09(07/06/21): We found some challenges in regards to calling multiple Gmail APIs directly in an extension, so for now we have resorted to using a localhost server to call these APIs and run all the important functionality of our project on it till we figure out how we can resort to calling multiple APIs in the extension. We also made a mock-up UI of our prototype which has a simple layout. One of the main intention of this UI is to make the extension screen-reader friendly as well. We were able to create a compose window using Gmail API from which mails can be sent, further all of it will be revamped with the UI and will see how we can go further from there We will be testing out a few test cases in the coming weeks like: Checking how to access user created folder in gmail. To find a solution as to where the contents of the mail can be stored if the user loses internet connection before sending the mail.  
Read more

2020_CSE_03 BLOGS

Welcome to our blog series where we share our journey in building a chrome web browser extension which can read, compose and organize a user’s Gmail inbox all controlled through his voice. We will be updating our findings and progress every 2 weeks through this series.  x So what exactly are we working on? The plan is simple, over the course of next few months we are aiming to develop a chrome extension which acts as a Voice Assistant for your Gmail account. Our main goal is to make it so user friendly that even visually blind users can access their Gmail accounts without any hassle. Why? As we all are witnessing the importance of technology and it’s services during the pandemic, we realized that many of the services available today mainly rely on an email client for communication of important information, thus many visually impaired users face a challenging time in accessing these technologies in their day to day life. In an attempt to make the internet a more accessible place, w...
Read more

2020_CSE_03 WEEK 10

 Week 10(14/06/2021) We integrated the UI with the part that was running on localhost which was retrieving emails and deployed it on replit. We also added a few voice commands such that total mail count and unread mail count is given as a voice output. We did research on colors such that someone with color blindness would also be able to use our interface easily and differentiate elements   So far we have a UI which can be comforting to color blind users, retrieval of 10 emails from the user's inbox and a voice output of unread emails count of the user.  Challenges: When a voice command is given the output is repeated twice and we are finding it a bit challenging while getting voice outputs of retrieved emails.
Read more