Difference between revisions of "Projets-2015-2016-Borne-Interactive"

From air
Jump to navigation Jump to search
 
(51 intermediate revisions by 3 users not shown)
Line 14: Line 14:
 
Transcription of speech into text.
  
Transcription of speech into text.
 
Allows deaf people to understand better the reception staff.
  
Allows deaf people to understand better the reception staff.
−  
   
 
== Week 1 (January 11th - January 17th) ==
 
== Week 1 (January 11th - January 17th) ==
   
 
=== Objectives ===
  
=== Objectives ===
−
Discover the project.
 +
* Discover the project.
−
Contact Jérôme Maisonasse for more details.
 +
* Contact Jérôme Maisonasse for more details.
   
 
=== Work done ===
  
=== Work done ===
−
Project chose.
 +
* Project chose.
   
 
=== Problems faced ===
  
=== Problems faced ===
−
None so far
 +
* None so far
   
 
== Week 2 (January 18th - January 24th) ==
  
== Week 2 (January 18th - January 24th) ==
Line 33: Line 32:
 
* Set up of logbook
  
* Set up of logbook
 
* Precise the project ideas.
  
* Precise the project ideas.
−
* List all the Google Speech API features.
 +
* List all the Web Speech API features.
   
 
=== Work done ===
  
=== Work done ===
Line 41: Line 40:
 
=== Problems faced ===
  
=== Problems faced ===
 
* Define the features of the software : Does it has to provide a way to answer for the deaf person? => No
  
* Define the features of the software : Does it has to provide a way to answer for the deaf person? => No
−
* Choose hardware (touchscreen or keyboard & mouse).
 +
* Hardware choice (touchscreen or keyboard & mouse).
   
 
== Week 3 (January 25th - January 31st) ==
  
== Week 3 (January 25th - January 31st) ==
   
 
=== Objectives ===
  
=== Objectives ===
  +
* Settle a first draft using Web Speech API.
−  
   
 
=== Work done ===
  
=== Work done ===
−
[[Projets-2015-2016-Borne-Interactive/UML_Diagrams| '''UML Diagrams''']]: Use Case, Sequence and state diagrams.
 +
* [[Projets-2015-2016-Borne-Interactive/UML_Diagrams| '''UML Diagrams''']]:
  +
** Use Case
  +
** Sequence
  +
** State
  +
  +
* First tests on [https://dvcs.w3.org/hg/speech-api/raw-file/tip/speechapi.html Web Speech API].
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
* Getting to know Web Speech API.
   
 
== Week 4 (February 1st - February 7th) ==
  
== Week 4 (February 1st - February 7th) ==
   
 
=== Objectives ===
  
=== Objectives ===
−
Make an appointment with project tutors to show the first prototypes.
 +
* Make an appointment with project tutors to show the first prototypes.
   
 
=== Work done ===
  
=== Work done ===
 
First prototypes:
  
First prototypes:
−
* Communication between two windows
 +
* Communication between two windows : simple recognition with start/stop and punctuation buttons.
−
* Discovery of Web Speech API
 +
* Use of Web Speech API features
   
 
=== Problems faced ===
  
=== Problems faced ===
−
How to communicate between two windows
 +
* How to communicate between two windows.
   
 
== Week 5 (February 8th - February 14th) ==
  
== Week 5 (February 8th - February 14th) ==
   
 
=== Objectives ===
  
=== Objectives ===
−
Make an appointment with project tutors to talk about the UI.
 +
* Write appointment debrief.
  +
* Note down all the mentioned functionalities.
−  
 
=== Work done ===
  
=== Work done ===
  ⚫
* Appointment with project tutors to talk about the UI and the functionalities the application should offer. First demo.
−
* Design patterns
 +
* Design patterns.
−
* Assistance provided to the group working on the project "Sous-titre en temps réel d'un cours"
 +
* Assistance provided to the group working on the project "Sous-titre en temps réel d'un cours".
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
* Long term listening of the API.
   
 
== Week 6 (February 15th - February 21st) ==
  
== Week 6 (February 15th - February 21st) ==
   
 
=== Objectives ===
  
=== Objectives ===
−
Final sprint backlog (Item product backlog, Task, State => Slide 50 Scrum) => Sprint backlog meeting
 +
* Final sprint backlog (Item product backlog, Task, State => Slide 50 Scrum) => Sprint backlog meeting
   
 
=== Work done ===
  
=== Work done ===
  +
* [https://docs.google.com/document/d/1DH6wm3c2xQz9kcFoF05IZwLyOxAI1LRtSFOve4v7REQ/edit?usp=sharing Report] of the last week meeting.
⚫
* Appointment with project tutors to talk about the UI and functionality the application should offer.
  
  +
* Scrum steps: [https://docs.google.com/spreadsheets/d/1ju8rEWwl77wDPqDEkmqMxTH4U9BsyunIrLwkDhvFb3Y/edit?usp=sharing Scrums documents]
−  
−
* Scrum steps:
  
 
** Product backlog
  
** Product backlog
  +
** [[Projets-2015-2016-Borne-Interactive/Users_stories| '''Users Stories''']] - Summarize all the functionalities mentionned in the meeting.
−
** Users Stories
  
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
* Set the correct priority for every task.
−  
   
 
== Week 7 (February 29th - March 6th) ==
  
== Week 7 (February 29th - March 6th) ==
   
 
=== Objectives ===
  
=== Objectives ===
  +
* Begin to develop next features.
  +
* Check out which tasks are limited by the API.
   
 
=== Work done ===
  
=== Work done ===
  +
* Preparation for presentation.
  +
* Choice for next tasks to complete.
  +
* Start to develop a word's modification.
  +
* Size option for the welcomed person's text.
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
Seems hard to realize due to the API limits :
−  
  +
* Autocompletion,
  +
* Modification list,
  +
* Vocal modification of a word,
  +
* Addition of specific words.
   
 
== Week 8 (March 7th - March 13th) ==
  
== Week 8 (March 7th - March 13th) ==
   
 
=== Objectives ===
  
=== Objectives ===
  +
* Make an appointment with the project tutor.
   
 
=== Work done ===
  
=== Work done ===
  +
* Presentation with Didier Donsez and Olivier Richard.
  +
* Developing of the modification of a word with keyboard.
  +
* Reflection on administrator interface.
  +
* Thoughts about the final UI.
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
* Using a database to add words to understand is not compatible with the API (Specific words can't be added in the comprehension, and so admin interface is not intersting anymore; and the autocompletion of a word is not possible the same way, because it would need a database).
−  
  +
* Vocal modification of a word: little importance due to the semantic distance that is way bigger, its priority goes down.
   
 
== Week 9 (March 14th - March 20th) ==
  
== Week 9 (March 14th - March 20th) ==
   
 
=== Objectives ===
  
=== Objectives ===
  +
* Check out what other limits are gaven by the API.
   
 
=== Work done ===
  
=== Work done ===
  +
* Jérôme Maisonasse contacted.
  +
* Complete SRS file.
  +
* Begin to develop the impression option.
   
 
=== Problems faced ===
  
=== Problems faced ===
−  
   
 
== Week 10 (March 21st - March 27th) ==
  
== Week 10 (March 21st - March 27th) ==
   
 
=== Objectives ===
  
=== Objectives ===
  +
* Welcomed people can point out a word that is misunderstood or mispelled.
  +
* Add a history option.
   
 
=== Work done ===
  
=== Work done ===
  +
* Impression option developed.
  +
* How to implement the modification list.
   
 
=== Problems faced ===
  
=== Problems faced ===
  +
* The API only returns the possible sentence at the moment you speak. For example for the sentences below, the API will return the first one, and you can access to the second one, but there has to be a treatment to detect that "William" matches with "I am" and "speaking" to "speak in". This problem makes the insertion of a list with other likely words for each word quite complicated.
   
  +
"I am speaking to a computer"
  +
"William speak in to a computer"
   
 
== Week 11 (March 28th - April 3rd) ==
  
== Week 11 (March 28th - April 3rd) ==
  +
  +
=== Objectives ===
  +
* Make an appointment with Marie-Paule Balicco.
  +
  +
=== Work done ===
  +
* Appointment with Jérôme Maisonnasse.
  +
* Begin to develop the option that allows the welcomed person to point out a word.
  +
* Try to figure out how to add a list below the words, knowing the issue mentioned before.
  +
  +
=== Problems faced ===
  +
* Issues to separate the text result word by word and to reference to this word.
  +
* When a word is pointed out with a tag, it is complicated to remove the tag once the welcoming person has changed the word.
  +
  +
== Week 12 (April 4th - April 10th) ==
   
 
=== Objectives ===
  
=== Objectives ===
   
 
=== Work done ===
  
=== Work done ===
  +
* Appointment with Marie-Paule Balicco
  +
* Write report and presentation
  +
* Work demo
  +
* Final presentation
   
 
=== Problems faced ===
  
=== Problems faced ===

Latest revision as of 17:35, 4 April 2016

Subject: Borne interactive - Interactive Terminal

Supervisors:

  • Jérôme Maisonasse

Students:

  • Quentin DUNAND (RICM4)
  • Elsa NAVARRO (RICM4)
  • Antoine REVEL (RICM4)


Subject summary

Interactive terminal to welcome deaf or hearing impaired people. Transcription of speech into text. Allows deaf people to understand better the reception staff.

Week 1 (January 11th - January 17th)

Objectives

  • Discover the project.
  • Contact Jérôme Maisonasse for more details.

Work done

  • Project chose.

Problems faced

  • None so far

Week 2 (January 18th - January 24th)

Objectives

  • Set up of logbook
  • Precise the project ideas.
  • List all the Web Speech API features.

Work done

  • Project requirements (SRS).
  • Brainstorming about project's goal.

Problems faced

  • Define the features of the software : Does it has to provide a way to answer for the deaf person? => No
  • Hardware choice (touchscreen or keyboard & mouse).

Week 3 (January 25th - January 31st)

Objectives

  • Settle a first draft using Web Speech API.

Work done

Problems faced

  • Getting to know Web Speech API.

Week 4 (February 1st - February 7th)

Objectives

  • Make an appointment with project tutors to show the first prototypes.

Work done

First prototypes:

  • Communication between two windows : simple recognition with start/stop and punctuation buttons.
  • Use of Web Speech API features

Problems faced

  • How to communicate between two windows.

Week 5 (February 8th - February 14th)

Objectives

  • Write appointment debrief.
  • Note down all the mentioned functionalities.

Work done

  • Appointment with project tutors to talk about the UI and the functionalities the application should offer. First demo.
  • Design patterns.
  • Assistance provided to the group working on the project "Sous-titre en temps réel d'un cours".

Problems faced

  • Long term listening of the API.

Week 6 (February 15th - February 21st)

Objectives

  • Final sprint backlog (Item product backlog, Task, State => Slide 50 Scrum) => Sprint backlog meeting

Work done

Problems faced

  • Set the correct priority for every task.

Week 7 (February 29th - March 6th)

Objectives

  • Begin to develop next features.
  • Check out which tasks are limited by the API.

Work done

  • Preparation for presentation.
  • Choice for next tasks to complete.
  • Start to develop a word's modification.
  • Size option for the welcomed person's text.

Problems faced

Seems hard to realize due to the API limits :

  • Autocompletion,
  • Modification list,
  • Vocal modification of a word,
  • Addition of specific words.

Week 8 (March 7th - March 13th)

Objectives

  • Make an appointment with the project tutor.

Work done

  • Presentation with Didier Donsez and Olivier Richard.
  • Developing of the modification of a word with keyboard.
  • Reflection on administrator interface.
  • Thoughts about the final UI.

Problems faced

  • Using a database to add words to understand is not compatible with the API (Specific words can't be added in the comprehension, and so admin interface is not intersting anymore; and the autocompletion of a word is not possible the same way, because it would need a database).
  • Vocal modification of a word: little importance due to the semantic distance that is way bigger, its priority goes down.

Week 9 (March 14th - March 20th)

Objectives

  • Check out what other limits are gaven by the API.

Work done

  • Jérôme Maisonasse contacted.
  • Complete SRS file.
  • Begin to develop the impression option.

Problems faced

Week 10 (March 21st - March 27th)

Objectives

  • Welcomed people can point out a word that is misunderstood or mispelled.
  • Add a history option.

Work done

  • Impression option developed.
  • How to implement the modification list.

Problems faced

  • The API only returns the possible sentence at the moment you speak. For example for the sentences below, the API will return the first one, and you can access to the second one, but there has to be a treatment to detect that "William" matches with "I am" and "speaking" to "speak in". This problem makes the insertion of a list with other likely words for each word quite complicated.
    "I am speaking to a computer"
    "William speak in to a computer"

Week 11 (March 28th - April 3rd)

Objectives

  • Make an appointment with Marie-Paule Balicco.

Work done

  • Appointment with Jérôme Maisonnasse.
  • Begin to develop the option that allows the welcomed person to point out a word.
  • Try to figure out how to add a list below the words, knowing the issue mentioned before.

Problems faced

  • Issues to separate the text result word by word and to reference to this word.
  • When a word is pointed out with a tag, it is complicated to remove the tag once the welcoming person has changed the word.

Week 12 (April 4th - April 10th)

Objectives

Work done

  • Appointment with Marie-Paule Balicco
  • Write report and presentation
  • Work demo
  • Final presentation

Problems faced

Retrieved from "https://air.imag.fr/index.php?title=Projets-2015-2016-Borne-Interactive&oldid=28732"