2020_CSE_03: Week 11 and Week 12

 Week 11: 

We built an extension that can compose the subject and body of an email through voice. The user will have to use " line break " command to differentiate between subject and body 

The colors were optimized to comfort the users with color blindness as well. As per our research most color blind users have a hard time recognizing between red, blue and green. So we decided to use shades of green and blue. Presently the UI consists of a gradient background colors of green and blue which should be comforting to all users. 

All of these are presently baked into the popup UI of our extension and in the next week we will be looking into the webpage operations through voice.

 

Week 12:

This week was one hell of a ride. We could give a voice output of the details of a specific email. All of these are achieved through voice commands which are required to be specified by the user. We have added these following commands : "read one", "read second", "read third", "read 4", "read 5" and "read next" 

The reason why there is such irregularity in the commands is that the web speech API is having a hard time in recognizing "two" and "three". It either takes it as "tu" or "free" and "forth" for "fourth". So as a temporary fix we have resorted to these commands which we will improvise and optimize in the coming week. 

We could also retrieve emails in the folders sent and bin other than the main inbox. We need to add commands to switch between these folders. 

Lot of work pending in terms of optimization of the code as most of these are a temporary fix, so stick around to get the updates.


Comments

Post a Comment

Popular posts from this blog

2020_CSE_03 Week 09

 Week 09(07/06/21): We found some challenges in regards to calling multiple Gmail APIs directly in an extension, so for now we have resorted to using a localhost server to call these APIs and run all the important functionality of our project on it till we figure out how we can resort to calling multiple APIs in the extension. We also made a mock-up UI of our prototype which has a simple layout. One of the main intention of this UI is to make the extension screen-reader friendly as well. We were able to create a compose window using Gmail API from which mails can be sent, further all of it will be revamped with the UI and will see how we can go further from there We will be testing out a few test cases in the coming weeks like: Checking how to access user created folder in gmail. To find a solution as to where the contents of the mail can be stored if the user loses internet connection before sending the mail.  
Read more

2020_CSE_03 BLOGS

Welcome to our blog series where we share our journey in building a chrome web browser extension which can read, compose and organize a user’s Gmail inbox all controlled through his voice. We will be updating our findings and progress every 2 weeks through this series.  x So what exactly are we working on? The plan is simple, over the course of next few months we are aiming to develop a chrome extension which acts as a Voice Assistant for your Gmail account. Our main goal is to make it so user friendly that even visually blind users can access their Gmail accounts without any hassle. Why? As we all are witnessing the importance of technology and it’s services during the pandemic, we realized that many of the services available today mainly rely on an email client for communication of important information, thus many visually impaired users face a challenging time in accessing these technologies in their day to day life. In an attempt to make the internet a more accessible place, w...
Read more

2020_CSE_03 WEEK 10

 Week 10(14/06/2021) We integrated the UI with the part that was running on localhost which was retrieving emails and deployed it on replit. We also added a few voice commands such that total mail count and unread mail count is given as a voice output. We did research on colors such that someone with color blindness would also be able to use our interface easily and differentiate elements   So far we have a UI which can be comforting to color blind users, retrieval of 10 emails from the user's inbox and a voice output of unread emails count of the user.  Challenges: When a voice command is given the output is repeated twice and we are finding it a bit challenging while getting voice outputs of retrieved emails.
Read more