• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    A system that expresses the contents of a speaker in sign language on a display device through a specific device for the communication of the hearing impaired. The basic concept is to make a word (sound) into a text and use the 3D animation as the basis for the movement of the character. It is a system expressed in (Sign Language). It will serve as an aid to hearing and speech impaired people in normal conversation with the public.
    公开号:KR20010107877A
    申请号:KR1020010069665
    申请日:2001-11-09
    公开日:2001-12-07
    发明作者:이창선
    申请人:이창선；
    IPC主号:
    专利说明:

    Voice Recognized 3D Animation Sign Language Display System
    [8] (1) Technology Development
    [9] At present, several related companies have developed related technologies. Caption, as well as the text Avatar (Avatar) has appeared a technique to show the action. However, the technology of converting speech into text is inferior in terms of speech recognition rate and function. Other 3D, LCD moving picture realization and surrounding technology can be applied by simple application or simple application.
    [10] (2) Market Status
    [11] Currently, Closed Caption Broadcasting (MBC) is being conducted by the Broadcasting Station (MBC) for the deaf and speech impaired in Korea, and foreign countries are implementing different types and forms of systems, such as NTSC systems in North America and PAL systems in Europe. is. In Korea, Caption devices are widely used, but currently 33% of the hearing impaired people have no receivers, and the demand for interpretation of sign language is increasing because subtitles pass too fast or sentences are difficult. In addition, in the hospitals and public institutions, devices with this technology can be distributed for the hearing and speech impaired, and when applied to mobile phones, the market will be large and it can be applied to PDAs that are being deployed in earnest these days. The PDA can be a communication tool for the hearing and speech impaired with the general public if only technology is applied and utilized and developed well. From this point of view, the market size can be expanded at home and abroad.
    [12] Development of technology for text to speech will be the key. This is because the technology of Dictation is developed by domestic companies, but the recognition rate is low, and the training of the speaker is required, and at the same time, the recognition rate is relatively high only for the specific person. You need a voice recognition system that integrates intonation, dialect, and many other cases.
    [1] 1 is a specific content of an engine according to the present invention.
    [2] 2 is a target according to the applicable output method of the present invention.
    [3] 3 is a system flowchart of PCs equipped with an engine according to the present invention.
    [4] 4 is an example of applying the system according to the present invention to a broadcasting station.
    [5] 5 is an example of applying the system according to the present invention to a mobile phone.
    [6] 6 is an example of applying the system according to the present invention to a general telephone and an interphone.
    [7] 7 is an example of applying the system according to the present invention to a vehicle GIS.
    [13] (1) Basic configuration
    [14] The present invention is an engine system that converts an input voice signal into a caption, codes the caption, and displays it in 3D animation by interworking with each sign language operation D / B. This system is composed of voice recognition unit, text recognition unit, and sign language display unit as shown in the diagram. The voice recognition unit is a part corresponding to Engine I of FIG. 1 and is a step of capturing the input voice signal by processing the dictation. The character recognition unit and sign language display unit corresponds to Engine II of FIG. 1, and the caption is coded to link the 3D character's arm, hand movement, and facial expression D / B. In this way, the sign language will appear in 3D Animation.
    [15] (2) Detailed Description
    [16] 1) Figure 2 shows an example of the system application and output target according to the present invention.
    [17] ① Basically, this system is equipped with engine on PC and shows voice signal input by microphone in sign language.
    [18] ② PDA can be applied as it is.
    [19] -It is possible to apply the same concept as in PC by interworking with wireless LAN.
    [20] -It can be used as a mobile phone concept when interworking with wireless internet.
    [21] ③ In the case of a mobile phone, it can be implemented as one of the mobile phone supplementary services by configuring a system in conjunction with a mobile telephone exchange. This engine is mounted on the exchanger to convert the sender's voice signal and display it on the receiver's LCD monitor in sign language.
    [22] ④ First of all, the application to TV can be applied to internet broadcasting stations most easily. It is the easiest to implement with VOD. In other words, if you click the produced VOD file, the video screen and sign language screen will be executed at the same time. In the case of TV and CATV, caption caption and sign language screen are sent along with the video screen. Later, you can add caption and sign language translation function to the TV itself, or you can make and attach a single unit of equivalent function.
    [23] ⑤ The same concept system can be applied to home video telephones, receivers for vehicle GIS, and displays capable of specially designed displays. In other words, in the case of a home video telephone, it can be applied to the telephone itself, in the case of a vehicle, such as a cellular phone and a PDA, and other dedicated terminals can be applied as a single product.
    [24] 2) Figure 3 is a system flow diagram of the PC-type equipped with the engine according to the present invention. It is an illustration showing the outline of running the engine according to the present invention on a Notebook PC, Desktop PC, PDA body.
    [25] 3) Figure 4 is an example of applying the system according to the present invention to a broadcasting station.
    [26] 4) Figure 5 is an example of applying the system according to the present invention to a cellular phone and IMT-2000.
    [27] 5) Figure 6 is an example of applying the system according to the present invention to a general telephone and intercom. In the case of a regular phone, the flow is similar to that of a mobile phone, except that it uses a wire, not a wireless one. In the case of an interphone, the engine is attached to the interphone as in a single unit.
    [28] 6) Figure 7 is an example of applying the system according to the present invention to the vehicle GIS. The line will use the Internet (even in the case of satellites), and if you use a mobile phone and a GIS receiver to request geographic or other information from a company that performs GIS services, that company will reinstate the information over the Internet. System.
    [29] This is a technology that displays the contents of the speaker in 3D Animation using sign language when watching TV and Internet broadcasts of the hearing impaired, at public offices, hospitals, companies, or through mobile phones and other devices. It is a system that converts text and expresses it based on the text (3D). This system includes 3D character's text interlocking motion technology that assumes voice recognition and caption technology. Based on this, it is required to develop and manufacture a single device similar to a caption subtitle. It will serve as a communication aid between hearing and speech impaired people and the general public.
    [30] One of the important indicators of developed countries is the welfare of the disabled. There are many tasks to be pursued, such as improving the perspective and treatment of the disabled, but in practice, prioritizing proper legal and institutional arrangements for people with disabilities is the technology to solve or reduce their discomfort and enjoy an equal cultural life. In addition, this is one of the technologies that can advance the welfare state as a common human-oriented technology in the world, and also play a role in establishing the status as an IT country, and because it is based on text, it can be used in other countries as well. It is easy to form. The system also uses characters that can give intimacy, so it can replace humans.
    [31] (1) Application
    [32] ① Access to mass media of all deaf and hearing-impaired people who need sign language
    [33] ② Mobile Phone and IMT-2000 Field
    [34] ③ Public service device for the welfare of the disabled in public institutions and government offices
    [35] ④ Emergency rescue and disaster reporting organization
    [36] ⑤ Communication apparatus for hearing and speech impaired people
    [37] (2) expected effect
    [38] ① Contribute to improving the quality of life of the people
    [39] ② Entry into developed countries by improving national welfare
    [40] ③ Nationalization of technology-driven technology by establishing a leading IT country
    [41] ④ Pioneering import substitution and export market
    权利要求:
    Claims (8)
    [1" claim-type="Currently amended] In the engine system that converts the input voice signal into a caption and codes the caption and displays it in 3D animation by interlocking with each sign language operation D / B.
    -First step of captioning by processing Dictation of input voice signal
    -The second step in which the sign language is displayed in 3D animation while the caption is displayed
    A third step in the field and method of applying the engine system;
    -Fourth step of the idea and method of manufacturing and applying the applied system to a single device
    [2" claim-type="Currently amended] In paragraph 1
    -The first step above
    Capturing the Dictation Text
    -Step of composing D / B by coding the caption
    -Integrated management method including
    [3" claim-type="Currently amended] In paragraph 1
    -The second step above
    -2nd stage that constitutes 3D character's arm, hand gesture and facial expression D / B
    Step 2 of interlocking the D / B with each other
    -Caption is displayed 2. 2.
    Step 2. 4 in which the movement of the character is represented by 3D animation according to the linkage
    Integrated operating method, including
    [4" claim-type="Currently amended] In paragraph 3
    -In step 2.3 above
    -Idea and method to display caption
    [5" claim-type="Currently amended] In paragraph 3
    -In step 2.4 above
    -Ideas and methods of using 3D characters in sign language
    -Ideas and methods to represent sign language with 3D animation of characters
    [6" claim-type="Currently amended] In paragraph 1
    -The third step above
    -How to mount the engine system on the Desk Top and Notebook PC
    -How to install engine system on PDA
    -How to use the engine system for mobile phones and IMT-2000
    -Plan to use engine system for landline and intercom
    -How to link engine system with vehicle GIS
    -How to use engine system for internet broadcasting station and general TV and CATV system
    -Ideas and methods involving them
    [7" claim-type="Currently amended] In paragraph 6
    -How to interoperate with the mobile communication company's switch and the system for use in mobile phones and IMT-2000
    -Plan to use as one of additional service items of mobile communication company
    -Plan to include sign language marking service in vehicle GIS system
    -Ideas and methods involving them
    [8" claim-type="Currently amended] In paragraph 1
    -The fourth step above
    -Ideas and methods to make separate dedicated devices and use them as communication aids for the hearing impaired
    -Integrated management method including
    类似技术:
    公开号 | 公开日 | 专利标题
    US20140192138A1|2014-07-10|Displaying Participant Information in a Videoconference
    US7990411B2|2011-08-02|Videoconferencing systems with recognition ability
    Power et al.2004|Everyone here speaks TXT: Deaf people using SMS in Australia and the rest of the world
    EP2255527B1|2011-11-30|Method for implementing rich video on mobile terminals
    US5808663A|1998-09-15|Multimedia carousel for video conferencing and multimedia presentation applications
    US7099685B2|2006-08-29|Apparatus and method for providing multimedia service in a mobile terminal
    US7746986B2|2010-06-29|Methods and systems for a sign language graphical interpreter
    KR100698942B1|2007-03-23|The Sign Language Interpretation System By Using The Sign Language Conversation Video Telephone And Its Supplementary Device
    EP1633142B1|2018-12-19|Portable terminal adapted to display subtitles when the silent mode is activated
    US8325883B2|2012-12-04|Method and system for providing assisted communications
    US5978014A|1999-11-02|Video TTY device and method for videoconferencing
    EP2154885B1|2011-11-30|A caption display method and a video communication control device
    CN102939791B|2015-09-23|For having the hand communication assistor of people of the sense of hearing, speech and dysopia
    US7006604B2|2006-02-28|Relay for personal interpreter
    KR20020023234A|2002-03-28|Method and system for indicating change of speaker in a videoconference application
    US8082152B2|2011-12-20|Device for communication for persons with speech and/or hearing handicap
    US7822050B2|2010-10-26|Buffering, pausing and condensing a live phone call
    US5982853A|1999-11-09|Telephone for the deaf and method of using same
    US20030023424A1|2003-01-30|Multimedia dictionary
    US6493426B2|2002-12-10|Relay for personal interpreter
    US20090174759A1|2009-07-09|Audio video communications device
    US6771302B1|2004-08-03|Videoconference closed caption system and method
    US20050208962A1|2005-09-22|Mobile phone, multimedia chatting system and method thereof
    US8494859B2|2013-07-23|Universal processing system and methods for production of outputs accessible by people with disabilities
    JPWO2004028162A1|2006-01-19|Sign language video presentation device, sign language video input / output device, and sign language interpretation system
    同族专利:
    公开号 | 公开日
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    2001-11-09|Application filed by 이창선
    2001-11-09|Priority to KR1020010069665A
    2001-12-07|Publication of KR20010107877A
    优先权:
    申请号 | 申请日 | 专利标题
    KR1020010069665A|KR20010107877A|2001-11-09|2001-11-09|Voice Recognized 3D Animation Sign Language Display System|
    [返回顶部]