Patent application title: SYSTEM AND METHOD FOR ENHANCING REMOTE SPEECH FLUENCY THERAPY VIA A SOCIAL MEDIA PLATFORM
Inventors:
Moshe Rot (Ramat Gan, IL)
Lilach Rothschild (Tel Aviv, IL)
Smadar Lerner (Kefar Saba, IL)
Eli Lerner (Kefar Saba, IL)
Assignees:
Novotalk, Ltd.
IPC8 Class: AG09B1904FI
USPC Class:
434185
Class name: Education and demonstration language speech
Publication date: 2016-06-30
Patent application number: 20160189566
Abstract:
A social networking platform for enhancing fluency training is presented.
The platform includes a plurality of fluency practice devices; a
plurality of therapist devices; and a server communicatively connected to
the plurality of fluency practice devices and the plurality of therapist
devices, wherein the server is configured to facilitate communications
among the plurality of fluency practice devices and between the plurality
of fluency practice devices and the plurality of therapist devices,
wherein the server is further configured to share social networking feeds
related to practicing speech fluency, wherein the social networking feeds
are generated by at least each of the plurality of fluency practice
devices.Claims:
1. A social networking platform for enhancing speech fluency training,
comprising: a plurality of fluency practice devices; a plurality of
therapist devices; and a server communicatively connected to the
plurality of fluency practice devices and the plurality of therapist
devices, wherein the server is configured to facilitate communications
among the plurality of fluency practice devices and between the plurality
of fluency practice devices and the plurality of therapist devices,
wherein the server is further configured to share social networking feeds
related to practicing speech fluency, wherein the social networking feeds
are generated by at least each of the plurality of fluency practice
devices.
2. The social networking platform of claim of 1, wherein each of the social networking feeds includes any of: a feedback generated respective of a fluency practice session, and motivational content.
3. The social networking platform of claim 2, wherein the motivational content includes at least one of: an achievement respective of the feedback, and an automatic update of a user profile respective of the feedback.
4. The social networking platform of claim 2, wherein the motivational content is generated by a therapist using a therapist device respective of a user using a fluency practice device, wherein the therapist and the user are part of the same social connection.
5. The social networking platform of claim 2, wherein the motivational content is generated by a first user using a first fluency practice device and a second user using a second fluency practice device, wherein the first user and the second user are part of the same social connection.
6. The social networking platform of claim 5, wherein each fluency practice device is configured to generate the feedback respective of the fluency practice session.
7. The social networking platform of claim 5, wherein each fluency practice device is further configured to: receive voice productions captured during the fluency practice session, wherein the fluency practice session includes at least one fluency shaping exercise; process at least one of the received voice productions to evaluate a correct execution of the at least one fluency shaping exercise; and generate the feedback based on the evaluated execution of the at least one fluency shaping exercise.
8. The social networking platform of claim 7, wherein the feedback is at least a visual feedback, wherein the motivational content includes the visual feedback.
9. The social networking platform of claim 7, wherein each of the server, the plurality of fluency practice devices, and the plurality of therapist devices is further configured to: generate at least a reward respective of the correct execution of the at least one fluency shaping exercise; and share the generated reward via at least one of the social networking feeds.
10. The social networking platform of claim 7, wherein the at least one fluency shaping exercise allows practicing fluent speech at a standardized speech rate or at a regulated speech rate in spontaneous speech.
11. The social networking platform of claim 7, wherein each fluency shaping exercise has a difficulty, wherein the difficulty of each fluency shaping exercise is based on a therapy stage of a user of one of the plurality of fluency practice devices.
12. The social networking platform of claim 2, wherein the server is further configured to establish the fluency practice session between at least one of the fluency practice devices and at least one of the therapist devices over a communication channel.
13. The social networking platform of claim 12, wherein the communication channel is any of: a text communication channel, an audio communication channel, and an audio-visual communication channel.
14. The social networking platform of claim 2, wherein each social networking feed includes any of: a textual message, a video clip, an audio clip, an image, and a user-created exercise.
15. The social networking platform of claim 2, wherein the fluency practice session is between at least two participating fluency practice devices or between at least one participating fluency practice device and at least one participating therapist device.
16. The social networking platform of claim 15, wherein the server is further configured to select each participating fluency practice device and each participating therapist device based on a fluency progress of a user of each participating fluency practice device.
17. The social networking platform of claim 2, wherein the server is further configured to store a progress of a user of each fluency practice device respective of the feedback.
18. The social networking platform of claim 1, wherein the server is further configured to communicate with each fluency practice device and each therapist device via any of: a web interface, an application installed on the device, and a script executed by the device.
19. The social networking platform of claim 1, wherein each fluency practice device and each therapist device is any one of: a personal computer, a personal digital assistant, a mobile phone, a smart phone, a tablet computer, a wearable computer device, and a game console.
20. A method for enhancing speech fluency training via social networking platform, comprising: facilitating communications among a plurality of fluency practice devices and between a plurality of fluency practice devices and the plurality of therapist devices; and sharing social networking feeds related to practicing speech fluency, wherein the social networking feeds are generated by at least each of the plurality of fluency practice devices.
Description:
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of U.S. Provisional Application No. 62/098,355 filed on Dec. 31, 2014, the contents of which are hereby incorporated by reference.
TECHNICAL FIELD
[0002] The present disclosure relates generally to the field of speech therapy, and more particularly to engaging speech therapy patients over social media networks.
BACKGROUND
[0003] Speech disorders are one of the most prevalent disabilities in the world. Generally, speech disorders may be classified as fluency disorders, voice disorders, motor speech disorders, and speech sound disorders. As one example, stuttering is classified as a fluency disorder in the rhythm of speech in which a person knows precisely what to say, but is unable to communicate or speak in accordance with his or her intent.
[0004] Many clinical therapy techniques for speech disorders are disclosed in the related art. Conventional techniques for treating speech disorders and, in particular, anti-stuttering techniques, are commonly based on regulating the breath and controlling the rate of speech. To this end, speech therapists train their patients to improve their fluency. Such conventional techniques were found effective, in the short-term, as a speech disorder is predominantly a result of poorly coordinated speech production muscles.
[0005] In more details, one common stutter therapy technique is fluency shaping, in which a therapist trains a person (e.g., a stuttering patient) to improve his or her speech fluency through the altering of various motor skills. Such skills include the abilities to control breathing; to gently increase, at the beginning of each phrase, vocal volume and laryngeal vibration continue phonation through the end of the phrase by keeping the vocal folds relaxed and air flowing; to speak slower and with prolonged vowel sounds; to enable continuous phonation; and to reduce articulatory pressure.
[0006] The speech motor skills are taught in the clinic while the therapist models the behavior and provides verbal feedback as the person learns to perform the motor skill. As the person develops speech motor control, the person increases rate and prosody of her/his speech until it sounds normal. During the final stage of the therapy, when the speech is fluent and sounds normal in the clinic, the person is trained to practice the acquired speech motor skills in her/his everyday life activities.
[0007] When fluency shaping therapy is successful, the stuttering is significantly improved or even eliminated. However, this therapy requires continuous training and practice in order to maintain effective speech fluency. As a result, the conventional techniques for practicing fluency shaping therapy are not effective for people suffering from stuttering. This is mainly because not all persons are capable of developing the target speech motor skills in the clinic, and even if such skills are developed, such skills are not easily transferable into everyday conversations. In other word, a patient can learn to speak fluently in the clinic, but will likely revert to stuttering outside of the clinic.
[0008] Thus, the continuous practice of speech motor skills is key to successful fluency shaping therapy. Consequently, the dependency on therapists and on frequent visits to clinics reduces the success rate of the fluency-shaping therapy. For example, a patient who waits a few days or weeks between therapy sessions may be more likely to stutter than patients who more frequently attend therapy. Lack of continuous practice between sessions further deteriorates the effectiveness of the therapy.
[0009] In addition to the need for access to continuous practice, the patient must remain motivated to actually participate in such continuous practice. Motivation may come in the form of, e.g., encouragement, celebrations of progress, setting progress goals, and so on. If the patient does not remain sufficiently motivated, then the patient will not continuously practice even if he or she has access to tools enabling remote practice. Consequently, motivation is a key factor in ensuring speech therapy success.
[0010] Therapists and other patients can contribute to motivating the patient to continue practicing regularly. To maintain motivation during the time periods between live sessions with a therapist, the patient should receive encouragement during those time periods. Patient motivation may further be spurred by sharing patient progress with appropriate people who can acknowledge the patient's efforts and encourage additional progress. Existing techniques for providing speech therapy face challenges in providing encouragement between therapy sessions because they rely on the availability of therapists and other motivating individuals between sessions.
[0011] With the advent of the Internet and, in particular, social media, people can now communicate with large groups of friends, family, and acquaintances 24 hours a day, 7 days a week, 365 days a year. Social media networks may further provide automatic updates for users such as, e.g., birthday and holiday messages, as well as web-based activity of a user. As an example, a social media network may automatically (or by user selection) share media content viewed by a user, items purchased by the user, games played by the user, and so on. However, such social media networks lack the ability to provide feedback and support for speech therapy patients.
[0012] It would therefore be advantageous to provide a solution that would overcome the deficiencies of the prior art.
SUMMARY
[0013] A summary of several example embodiments of the disclosure follows. This summary is provided for the convenience of the reader to provide a basic understanding of such embodiments and does not wholly define the breadth of the disclosure. This summary is not an extensive overview of all contemplated embodiments, and is intended to neither identify key or critical elements of all embodiments nor to delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more embodiments in a simplified form as a prelude to the more detailed description that is presented later. For convenience, the term "some embodiments" may be used herein to refer to a single embodiment or multiple embodiments of the disclosure.
[0014] The disclosed embodiments include a social networking platform for enhancing fluency training, comprising: a plurality of fluency practice devices; a plurality of therapist devices; and a server communicatively connected to the plurality of fluency practice devices and the plurality of therapist devices, wherein the server is configured to facilitate communications among the plurality of fluency practice devices and between the plurality of fluency practice devices and the plurality of therapist devices, wherein the server is further configured to share social networking feeds related to practicing speech fluency, wherein the social networking feeds are generated by at least each of the plurality of fluency practice devices.
[0015] The disclosed embodiments further include a method for enhancing speech fluency training via social networking platform. The method comprises facilitating communications among a plurality of fluency practice devices and between a plurality of fluency practice devices and the plurality of therapist devices; and sharing social networking feeds related to practicing speech fluency, wherein the social networking feeds are generated by at least each of the plurality of fluency practice devices.
BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The subject matter disclosed herein is particularly pointed out and distinctly claimed in the claims at the conclusion of the specification. The foregoing and other objects, features, and advantages of the disclosed embodiments will be apparent from the following detailed description taken in conjunction with the accompanying drawings.
[0017] FIG. 1 is a network diagram utilized to describe the various disclosed embodiments.
[0018] FIG. 2 is a flowchart illustrating a method for enhancing remote speech therapy via social media according to an embodiment.
[0019] FIG. 3 is a screenshot illustrating a social networking message from a user.
[0020] FIG. 4 is a screenshot illustrating progress indicators presented as motivational content.
[0021] FIG. 5 is a screenshot illustrating a challenge presented as motivational content.
[0022] FIG. 6 is a screenshot illustrating groupings of users.
DETAILED DESCRIPTION
[0023] It is important to note that the embodiments disclosed herein are only examples of the many advantageous uses of the innovative teachings herein. In general, statements made in the specification of the present application do not necessarily limit any of the various claimed embodiments. Moreover, some statements may apply to some inventive features but not to others. In general, unless otherwise indicated, singular elements may be in plural and vice versa with no loss of generality. In the drawings, like numerals refer to like parts through several views.
[0024] Social networking elements are used to support stuttering/stammering treatment using Fluency Shaping techniques, as follows. Online practice between users--with the aid of the video chat and chat platforms, for example, in the form of templates, fluency practice sessions between users of the system are created. Feed creation in the area of Fluency Shaping-achievements of the users are used to create the feed as well as to improve motivation to practice the technique. Users can reward the achievements of other users based on their successes and various reports.
[0025] Speech is a social activity. Therefore, in order to gain mastery of the fluency shaping techniques in spontaneous speech, it is important to practice using the new speech patterns in various communicative situations which challenge speech fluency (for example, with new people, with strangers, in situations already identified as difficult for that individual, in group discussions), and not just alone in front of the computer or the clinician. Elements of social networking can be used within the system to help achieve this goal.
[0026] It is important to note that the main purpose of the system is to provide a platform for the practice and application of the fluency shaping techniques in conversational spontaneous speech with other people. However, an additional advantage is that it provides a community in which persons practicing speech fluency can support each other before, during and after treatment.
[0027] Practicing fluent speech at the standardized/regulated rate can occur between two users on the system of the invention (the users do not need to know each other previously). The practice is conducted online at convenient times for the users and in any location from which they can connect to the system. The conversations are conducted using video conferencing as well as the various system-based indicators (visual monitor, rate monitor, etc.).
[0028] A feed is created for fluency shaping where users' achievements can be broadcast on an online "feed" and used to increase motivation for practicing the techniques. Users of the system have the option to "reward" the achievements of other users. Achievements are published inside internal news feed (available only for registered users). All users can encourage the feed events in the manner of comments and encouragement counter.
[0029] FIG. 1 shows an exemplary and non-limiting diagram of a remote speech therapy system 100 utilized to describe the various disclosed embodiments. The system 100 includes a network 110, a first plurality of user devices 120-1 through 120-n (hereinafter referred to individually as a fluency practice device 120 and collectively as fluency practice devices 120, merely for simplicity purposes), a server 130, a database 140, a feedback generator system (FGS) 150, and a second plurality of user devices 160-1 through 160-n (hereinafter referred to individually as a therapist device 160 and collectively as therapist devices 160, merely for simplicity purposes).
[0030] The network 110 may be the Internet, the world-wide-web (WWW), a local area network (LAN), a wide area network (WAN), and other networks configured to communicate between the elements of the 110. Each fluency practice device 120 and each therapist device 160 may be, but is not limited to, a personal computer (PC), a personal digital assistant (PDA), a mobile phone, a smart phone, a tablet computer, a wearable computer device, a game console, and the like.
[0031] In a non-limiting example, the fluency practice devices 120 are utilized by people (e.g., speech therapy patients) practicing to improve existing speech disorders, and the therapist devices 160 are utilized by speech therapists. It should be noted that one or more fluency practice devices 120 can communicate with a single therapist device 160, and multiple therapist devices 160 can communicate with one or more fluency practice devices 120. It should be noted that the fluency practice device 120 can be operated by any person who may or may not suffer from a speech disorder. It should be further noted that the therapist device 160 may be operated by any person who may or may not be a therapist. Typically, the therapist device 160 is operated by either a therapist or any other person who may be permitted to observe the fluency-practicing user's progress (e.g., a friend, a family member, a guardian, and so on).
[0032] Each of the fluency practice devices 120 and the therapist devices 160 is configured to communicate with the server 130. The server 130, according to the disclosed embodiments, is configured to allow fluency practice sessions between the user devices 120 and/or 160, to obtain feedback based on the fluency practice sessions, to store fluency practice progress, and to share content respective of the fluency practice sessions. Each fluency practice session may be joined by one or more of the fluency practice devices 120 and/or one or more of the therapist devices 160.
[0033] In an embodiment, the fluency practice sessions may be created according to a template. The template defines parameters for exercises included in the fluency practice sessions. Each exercise may further have a difficulty level that may correspond to a therapy stage of a fluency-practicing user. Exercises having higher difficulty levels are therefore typically for fluency-practicing user at higher therapy stages as determined based on, e.g., past performances. In a further embodiment, the server 130 may be configured to select one or more exercises from a plurality of exercise based on the user profiles of the patient(s) participating in the fluency practice session. For example, the exercises may be selected based on the therapy stage of the patients participating in a particular fluency practice session.
[0034] In an embodiment, an audio/video communication channel may be established between any of the fluency practice devices 120 and/or the therapist devices 160. This enables fluency practice sessions such as, for example, remote therapy sessions, group therapy sessions between multiple patients and/or therapists, combinations thereof, and so on. The audio/video communication channel can be a peer-to-peer connection between the fluency practice devices 120 and/or the therapist devices 160, or can be through the server 130 via, e.g., a website, a mobile application, and so on. To this end, an audio/video channel may be established between the fluency practice devices 120 and/or the therapist devices 160 to allow direct communication between the patients and/or the therapists. The channel, in one embodiment, is established over HTTP. In an embodiment, the agent 125 or 165 of each respective device 120 or 160 is configured to stream video streams from one device to another over the established communication channel.
[0035] The interface between each of the devices 120 or 160 and the server 130 may be realized through, for example, a web interface (e.g., a web portal), an application installed on the device 120 or 160, a script executed on the device 120 or 160, and the like. In an embodiment, each fluency practice device 120 is installed with an agent 125 and each therapist device 160 is installed with an agent 165. Each of the agents 125 and 165 may be configured to communicate with the server 130. In certain configurations, each agent 125 or 165 can operate and be implemented as stand-alone programs and/or can communicate and be integrated with other programs or applications executed in the fluency practice device 120 and the therapist device 160, respectively. Examples for a stand-alone program may include a web application, a mobile application, and the like.
[0036] The server 130 may be configured to store a user profile associated with each user of the fluency practice devices 120 and/or therapist devices 160 in the database 140. Each user profile may include, but is not limited to, a name of a user, a classifications of a user (e.g., a user may be classified as either a patient, a therapist, or a guardian), friends lists, supervised users lists (e.g., a list of patients that a therapist supervises), a fluency proficiency level of a patient, a therapy stage of the patient, an assignment for a therapist (e.g., a therapist may be assigned to work with patients at a particular therapy stage stage), content shared among users of the devices 120 and 160, feedback related to a patient's vocal performances, and so on. The server 130 may be configured to utilize the user profiles to automatically determine and provide appropriate motivational content to each patient. The motivational content may include, but is not limited to, prizes, achievements, shared content, performance evaluations, additional exercises, notifications of therapy stage updates, and so on.
[0037] FIG. 3 shows an exemplary and non-limiting screenshot 300 illustrating a supervised users list for a therapist as displayed in a social networking application. The screenshot 300 includes a supervised users list 310. The supervised users list 310 indicates patients whose progress the therapist is currently supervising.
[0038] The agent 125 may be configured to capture sound samples from its respective fluency practice device 120 during a fluency practice session and to send the captured sound samples to the server 130. In an embodiment, the server 130 may be configured to receive the sound samples from the agent 125 and to send the sound samples to the feedback generator system 150. The feedback generator system 150 analyzes the patient's performance respective of the captured sound samples and generates feedback respective of the performance. The analysis and generation of feedback based on patient performances is described further in U.S. patent application Ser. No. 14/978,274 titled "A METHOD AND SYSTEM FOR ONLINE AND REMOTE SPEECH DISORDERS THERAPY," (hereinafter the '274 Application) assigned to the common assignee, which is hereby incorporated by reference for all that it contains. The feedback generator system 150 may send the feedback to the server 130.
[0039] The server 130 may store the feedback in the database 140. In an embodiment, the server 130 may be configured to select one or more of the devices 120 and/or 160 and to send the feedback to the selected devices 120 and 160. In response, the selected devices 120 and 160 may display the feedback.
[0040] In a further embodiment, the server 130 may select the devices 120 and 160 based on a user profile associated with the fluency practice device 120 from which the sound samples were captured. As an example, the user profile may indicate a therapy stage of the patient, and the selected devices may be utilized by patients at the same therapy stage. As another example, the user profile may indicate friends of the patient, and the selected devices may be utilized by the indicated friends.
[0041] In an embodiment, the sever 130 may generate a feed for the patient based, in part, on the obtained feedback. The feed may be a collection of previously generated feedbacks respective of past voice productions of a patient. The feed may further indicate progress of the patient based on, for example, time periods of practice, regularity of practice, successes, attaining particular stages in therapy, and so on. The progress may further be respective of one or more challenges undertaken by the patient.
[0042] Based on the generated feedback and/or the feed, the server 130 may be configured to determine motivational content for display on the fluency practice device 120 respective of the patient's performance. The social feeds including but not limited to the motivational content may be, but is not limited to, a textual message (e.g., an email, a SMS message, a message displayed on the fluency practice device 120 via the agent 125), a video clip, an audio clip, an image, an achievement, a user-created exercise, a performance graph, combinations thereof, and so on. The motivational content may provide encouragement and/or motivation to the patient in the form of, for example, patient progress, challenges, achievements, rewards, and any other motivating factors.
[0043] FIG. 4 shows an exemplary and non-limiting screenshot 400 illustrating progress indicators presented as motivational content. The screenshot 400 includes circular progress meters 410-1 and 410-2 representing a user's progress with respect to the challenges of "practice at least 3 days for 15 minutes" and "complete 5 medium speech tasks." In the exemplary screenshot 400, the progress meter 410-1 indicates that the user has not practiced for 15 minutes on any day, while the progress meter 410-2 indicates that the user has completed 9 medium difficulty speech tasks.
[0044] FIG. 5 shows an exemplary and non-limiting screenshot 500 illustrating a challenge from another user presented as motivational content. The screenshot 500 includes a challenge box 510 including an image and text related to a challenge from another patient or from a therapist. The challenge asks the patient to practice for 15 minutes on at least 4 days and to complete 4 medium difficulty speech tasks.
[0045] In an embodiment, the server 130 may be configured to determine and send motivational content automatically. The motivational content may be determined based on, but not limited to, the user profile, the feedback, and so on. In another embodiment, the server 130 may be configured to receive motivational content from one or more of the devices 120 and/or 160 and to send the received motivational content to the fluency practice device 120. As an example, another patient observing the patient's feedback may send a congratulatory video after a successful fluency practice session. As another example, a therapist may create and send an additional exercise to further help improve the patient's performance after a fluency practice session.
[0046] In an embodiment, the server 130 may be further configured to automatically update a social networking profile of the patient based on the most recent feedback. In another embodiment, the server 130 may be further configured to automatically send a notification regarding the most recent feedback. The notification may be sent via, e.g., email, short message service, the agent 125, the agent 165, and so on. The notification may be sent to select patients and/or therapists based on, e.g., the user profile. For example, only therapists assigned to the therapy stage of the patient and/or other patients that are friends of the patient may be sent the notification.
[0047] In yet another embodiment, the server 130 may be configured to receive social networking messages (e.g., "posts") respective of the feedback. FIG. 6 is an exemplary and non-limiting screenshot 600 of a social networking message from a user. The screenshot 600 includes a message entry field 610 as well as message boxes 620. In the exemplary screenshot 600, the message boxes 620 include posts by a patient Moshe Rot. The posts include images and text entered in response to fluency practice sessions.
[0048] It should be noted that the feedback, the feed, and/or the motivational content may be sent to the fluency practice device 120 or the therapist device 160 for display in response to activity such as, but not limited to, launching of the agent 125 or 165, a user interaction with the device 120 or 160 during execution of the agent 125 or 165, and so on. The displayed items may be displayed as part of a social networking profile of a member of a social media network.
[0049] It should be noted that the feedback generator system 150 may comprise or be a component of the server 130 without departing from the scope of the disclosure.
[0050] In some implementations, each of the fluency practice device 120, the server 130, and the therapist device 160 typically includes a processing system (not shown) connected to a memory (not shown). The memory contains a plurality of instructions that are executed by the processing system. Specifically, the memory may include machine-readable media for storing software. Software shall be construed broadly to mean any type of instructions, whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise. Instructions may include code (e.g., in source code format, binary code format, executable code format, or any other suitable format of code). The instructions, when executed by the one or more processors, cause the processing system to perform the various functions described herein.
[0051] The processing system may comprise or be a component of a larger processing system implemented with one or more processors. The one or more processors may be implemented with any combination of general-purpose microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate array (FPGAs), programmable logic devices (PLDs), controllers, state machines, gated logic, discrete hardware components, dedicated hardware finite state machines, or any other suitable entities that can perform calculations or other manipulations of information.
[0052] It should be understood that the embodiments disclosed herein are not limited to the specific architecture illustrated in FIG. 1, and other architectures may be equally used without departing from the scope of the disclosed embodiments. Specifically, the server 130 may reside in the cloud computing platform, a datacenter, and the like. Moreover, in an embodiment, there may be a plurality of servers 130 operating as described hereinabove and configured to either have one as a standby, to share the load between them, or to split the functions between them.
[0053] FIG. 2 is an exemplary and non-limiting flowchart 200 illustrating a method for enhancing remote speech therapy via social media according to an embodiment. In an embodiment, the method may be performed by the server 130.
[0054] In optional S205, a communication channel may be established between a fluency practice device and one or more other devices. The other devices may include, but are not limited to, other fluency practice devices, therapist devices, and so on. In an embodiment, the communication channel may be established based on a user profile of a patient using the fluency practice device as described further herein above with respect to FIG. 1.
[0055] In S210, a voice production by the patient is received from the fluency practice device respective of a fluency practice session. The fluency practice session may be individual to the fluency practice device (i.e., the patient may be engaged in a solo session that does not require a communication channel between devices), or may be based on communications between the fluency practice device and other patient and/or therapist devices. The fluency practice session may include one or more exercises, with each exercise having a difficulty level indicating the relative degree of fluency required to perform the exercise well. The relative degree of fluency required may be indicated by, but not limited to, a fluency proficiency level of the user, a therapy stage of the user, and so on.
[0056] In an embodiment, the training session may be based on selections made via the fluency practice device. The selections may include initiating a session without communicating with other devices (i.e., a solo session), inviting one or more friends to join a current group training session, and scheduling a public (i.e., no invitation required to join) or semi-public (i.e., by invitation) group training session at a later time. The selections may be received via a user interface displayed on the user device. In a further embodiment, results of the fluency practice session including the voice production may be received after the fluency practice session. The scheduled training session may include establishing a communication channel between the fluency practice device and any of the invited devices at the scheduled start time.
[0057] In S220, an analysis of the voice production is caused. In an embodiment, the analysis may be performed by a feedback generator system (e.g., the feedback generator system 150). The analysis may be performed in real-time during the fluency practice session, or may be performed after the fluency practice session has ended. The analysis includes processing the voice production to evaluate a correct execution of the voice production respective of the exercise difficulty levels. Processing the voice production to evaluate a correct execution is described further in the above-referenced '274 Application.
[0058] In S230, respective of the analysis, a feedback is obtained. In an embodiment, the feedback may be received or retrieved from the feedback generator system. The feedback may be a visual feedback illustrating differences between a patient's voice production and a predefined target template. In another embodiment, the feedback may be sent for display on any of the fluency practice device, the other fluency practice devices, and/or the therapist devices.
[0059] In optional S235, a feed is generated or updated based on the obtained feedback. The feed is a collection of previous feedbacks respective of past user performances.
[0060] In 240, motivational content is determined based on the feedback and/or the feed. In an embodiment, the motivational content is further based on the user profile of the patient. The motivational content may be received from one of the other devices, or may be automatically selected. In another embodiment, additional motivational content may be determined in response to receiving the additional motivational content.
[0061] In S250, a display of the motivational content is caused. In an embodiment, S250 may further include sending a notification respective of the motivational content. The notification may be sent via email, short message service, an agent installed on a device, and so on. The notification may be accessed via the fluency practice device, another fluency practice device, a therapist device, and so on. The notification may indicate information related to the patient's vocal production such as, but not limited to, termination of a fluency practice session, completion of a therapy course, achievements, performance graphs, audio and video clips of the patient's performance, and so on. The notification may further include the motivational content.
[0062] It should be noted that the embodiments disclosed herein are described with respect to speech therapy patients merely for simplicity purposes and without limitation on the disclosure. Any fluency-practicing user seeking to improve a speech disorder may participate in fluency practice sessions and/or be motivated by social networking respective thereof without departing from the scope of the disclosure.
[0063] It should be noted that a portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent & Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
[0064] The various embodiments disclosed herein can be implemented as hardware, firmware, software, or any combination thereof. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage unit or computer readable medium consisting of parts, or of certain devices and/or a combination of devices. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units ("CPUs"), a memory, and input/output interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU, whether or not such a computer or processor is explicitly shown. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit. Furthermore, a non-transitory computer readable medium is any computer readable medium except for a transitory propagating signal.
[0065] All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the principles of the disclosed embodiment and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions. Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosed embodiments, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
User Contributions:
Comment about this patent or add new information about this topic: