• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    A device 1 has a first input 3 via which the television signal enters, as well as a second input 9 via which the subtitle signal enters. Furthermore, the device has a buffer 15 for temporarily storing the television signal, as well as a signal mixer 17 for mixing the subtitle signal and the television signal into a composite signal. The device 1 furthermore has a synchronization unit 25 which ensures that the television signal and the subtitle signal in the signal mixer 17 are combined into the composite signal in which the subtitle coincides with the images and sounds to which it relates. The synchronizing unit 25 ensures that the signal mixer 17, on the basis of a time delay code sent along with the subtitle signal, which contains a period of time that the incoming subtitle signal is lagging behind the incoming television signal, merges the incoming subtitle signal with the television signal that this period of time is earlier entered. The television signal is buffered during this period of time.
    公开号:NL2017188A
    申请号:NL2017188
    申请日:2016-07-19
    公开日:2017-11-27
    发明作者:Van Loenhout Peter；Pasveer Sander；Gerbecks Wim
    申请人:Pasveer Sander；Gerbecks Wim；Van Loenhout Peter；
    IPC主号:
    专利说明:

    Device for real-time subtitling of a live television signal DESCRIPTION:
    FIELD OF THE INVENTION
    The invention relates to a device for real-time subtitling of a live television signal which is composed of an image signal and a sound signal, which device is provided with a television input for the television signal.
    With a device, one can think of a unit with hardware components for realizing the actions, as well as an existing device (PC, tablet) with software with the same functionality as that of the unit.
    State of the art
    Such a device is generally known in the form of a device which ensures that a real-time subtitle signal from subtitlers can be added to a live television signal by means of teletext page number 888. This known device is part of a television device which is located at the end user. The end user is the person who watches the television broadcast. When subtitling a live television program, in particular for the deaf and hearing impaired, the subtitles immediately after hearing the speech when the television signal is transmitted, the spoken text is typed or the spoken word is converted into the written word by means of speech recognition. a device converted to a subtitle signal. This subtitle signal is then merged with the television signal and broadcast. Because typing the subtitle text takes some time, the subtitle signal will be merged with the television signal in a delayed way, so that the subtitle is not synchronized with the television images. Particularly in discussion or talk programs in which several people speak briefly and immediately after each other, it is difficult for the viewer to read by reading the subtitle by whom the text just read was spoken. This is somewhat resolved by entering the name of the speaker prior to the text, but this takes time so that the subtitles are delayed even more compared to the image and sound. Another example where the synchronization of the TV signal with the subtitle signal is relevant is the timing at football matches (when a goal is scored), or when a joke is told (and the deaf / hearing impaired only understands it later).
    Summary of the invention
    An object of the invention is to provide a device of the type described in the preamble in which the above-described disadvantage does not occur. To this end, the device according to the invention is characterized in that only the television signal enters via the TV input and the device further comprises an internet input through which the subtitle signal enters, as well as a signal mixer for mixing the subtitle signal and the television signal into a composite signal . Because the transmission of the television signal to the end user takes longer than the transmission of the subtitle signal to the end user, the time delay that the subtitle signal sustains when typing the subtitle signal when broadcasting the TV signal will be compensated by the faster transmission via the Internet to the end user, so that both signals are received almost simultaneously with the end user and the subtitle is therefore not delayed in relation to the TV signal.
    In case the device is an existing device with software in it that gives the device the functionality according to the invention, the signal mixer is therefore a software module.
    Because in practice the TV signal and subtitle signal are never received exactly simultaneously, the device is preferably provided with a buffer to temporarily store the delayed signal (this may be the subtitle signal or the TV signal) and to delay it. to give.
    Furthermore, the device preferably has a synchronization unit which ensures that the television signal and the subtitle signal are combined in the signal mixer into a composite signal in which the subtitle coincides with the images and sounds to which it relates. The device can be designed as an additional device to be connected to the television and to which the cable for the television signal should be connected or as an existing device (PC, tablet) with software for obtaining the desired functionality. The subtitle signal is herein preferably (wirelessly) brought in via the internet by the device. The device according to the invention thus ensures that the subtitle signal is transmitted with the television signal to the screen in such a way that the subtitle is synchronous with the pronunciation. This synchronization unit can, for example, adjust the subtitle signal to the audio signal so that the subtitle and speech coincide in time.
    In the case that the subtitle signal is received with a delay by the end user, a favorable embodiment of the device according to the invention is characterized in that the synchronization unit is based on a time delay code which is accompanied by the subtitle signal and which contains a period of time that the incoming subtitle signal lags behind on the incoming television signal, the incoming subtitle signal merges with the television signal that this period of time has previously arrived by temporarily storing the television signal in the buffer during this period of time. This is a simple way to synchronize the subtitle signal with the television signal. The duration is related to the speed at which the subtitle works and the time delay that occurs when sending the subtitle signal to the end user, where the television signal arrives at the same time as the subtitle. This length of time can be measured in advance with an end user where no use is made of the device according to the invention and subsequently subsequently sent by this subtitler in future subtitles.
    A further favorable embodiment of the device according to the invention is characterized in that it comprises input means for the font size, font color and position of the subtitle on the screen, as well as setting means for adapting the subtitle signal to the input values.
    The invention also relates to a method for synchronizing a television signal, comprising an image signal and an audio signal, with a subtitle signal, comprising: receiving the television signal, receiving the subtitle signal, mixing the subtitle signal and the television signal into a composite signal, and outputting the composite signal.
    With regard to the method, the invention is characterized in that the television signal and subtitle signal are received and mixed at the end user and then sent directly to a display device.
    A favorable embodiment of the method according to the invention is characterized in that the first incoming signal is buffered for a period of time accompanied by the signal and then mixed with the other incoming signal.
    A further favorable embodiment of the method according to the invention is characterized in that when mixing the subtitle signal and the television signal into a composite signal, the television signal and the subtitle signal are synchronized with each other such that in the composite signal the subtitle coincides with the images and sounds to which it relates.
    A still further favorable embodiment of the method according to the invention is characterized in that at the start of receiving the subtitle signal, a time delay code is also received which contains a period of time that the incoming subtitle signal lags behind the incoming television signal, and the television signal during this period of time is buffered, and then merged with the incoming subtitle signal.
    Brief description of the drawings
    The invention will be explained in more detail below with reference to exemplary embodiments of the device according to the invention shown in the drawings. Hereby shows:
    Figure 1 shows a schematic representation of a first embodiment of the device according to the invention;
    Figure 2 shows a schematic representation of a second embodiment of the device according to the invention;
    Figure 3 shows a schematic representation of a third embodiment of the device according to the invention;
    Figure 4 shows a schematic graphic representation of the assembly of the signals; and
    Figure 5 shows a schematic representation of a fifth embodiment of the device according to the invention with software.
    Detailed description of the drawings
    Figure 1 schematically shows a first embodiment of the device for real-time subtitling of a live television signal according to the invention. This device is the simplest embodiment of the invention. The TV signal to be composed with a subtitle signal comprises an image signal and an audio signal. The device 1 is provided with a TV input 3 through which only the television signal (reference numeral 7 in Figure 4) enters. The device 1 is furthermore provided with a signal input 9 via which the subtitle signal (reference numeral 11 in Figure 4) enters. The subtitle signal arrives via the internet and is wirelessly sent to the device via a router. An antenna 13 is connected to the signal input for receiving this signal.
    Furthermore, the device has a signal mixer 17 for mixing the subtitle signal and the television signal into a composite signal (reference numeral 19 in Figure 4). This composite signal is sent via a further cable 23 connected to an output 21 of the device to a television.
    Figure 2 schematically shows a second embodiment of the device according to the invention. All parts that are the same as those of the first embodiment are designated with the same reference numerals. With respect to the first embodiment, this device 31 furthermore has two buffers 15 for temporarily storing the television signal or the subtitle signal, depending on which signal first comes in. The stored signal is buffered for a certain time and then issued.
    Figure 3 schematically shows a third embodiment of the device according to the invention. All parts that are the same as those of the second embodiment are designated with the same reference numerals. With respect to the first embodiment, this device 33 further has a synchronization unit 25 which ensures that the television signal and the subtitle signal in the signal mixer 17 are combined into the composite signal in which the subtitle coincides with the images and sounds to which it relates.
    The synchronization unit 25 ensures that the signal mixer 17, on the basis of a time delay code sent with the subtitle signal, merges the first incoming signal with the second incoming signal. This delay code indicates the duration (reference numeral 27 in Fig. 4) that the last incoming signal (in Fig. 4 this is the subtitle signal) lags behind the first incoming signal (in Fig. 4 this is the television signal). The first incoming signal is buffered during this period of time and sent to the synchronization unit 25 with a delay. This is schematically illustrated in Figure 4 by way of illustration, the horizontal axis representing the time axis.
    The device 33 further has input and adjustment means 29 for inputting the font size, font color and position of the subtitle on the screen and for adjusting the subtitle signal to the entered values.
    Figure 5 schematically shows a third embodiment of the device according to the invention. This embodiment is a software embodiment. The software is hereby loaded into an existing device (server) and is software that the subtitlers and end users use. The subtitlers send their live subtitles there and users receive the subtitles. One of the solutions is subtitling via a website (eg Horizon from Ziggo). The titles are therefore sent from the server software to the website. And the users see the video / audio / subtitle signal through their browser.
    The software consists of five modules. A first module 41 retrieves the offered signals (TV signal and subtitle signal). In a second module 43, it is detected which signal first arrives. Subsequently, in a third module 45, the first incoming signal is buffered and it is also determined during which time the signal is buffered. In a fourth module 47, the two signals are then mixed into a composite signal. This composite signal is output in a fifth module 49.
    Determining the length of time during which the first incoming signal is to be buffered can for instance be done by reading a time code which is sent with this signal. Another method for this is to measure the moment in the TV signal when speaking and then add the subtitle signal.
    Although in the foregoing the invention has been elucidated with reference to the drawings, it should be noted that the invention is by no means limited to the embodiments shown in the drawings. The invention also extends to all embodiments deviating from the embodiments shown in the drawings within the scope defined by the claims.
    权利要求:
    Claims (9)
    [1]
    Device (1; 31; 33) for subtitling a live television signal (7), which is composed of an image signal and an audio signal, which device is provided with a television input (3) for the television signal, with characterized in that only the television signal (7) enters via the TV input (3) and the device comprises an internet input (9) through which the subtitle signal (11) enters, as well as a signal mixer (17) for mixing the subtitle signal (11) and the television signal (7) into a composite signal (19).
    [2]
    A device (31; 33) as claimed in claim 1, characterized in that the device comprises a buffer (15) around the first incoming signal, this may be the subtitle signal (11) or the TV signal (7) temporarily to save and spend in a delayed way.
    [3]
    Device (33) according to claim 2, characterized in that the device further comprises a synchronization unit (25) which ensures that the television signal (7) and the subtitle signal (11) are combined in the signal mixer (17) into a composite signal (19) in which the subtitles coincide with the images and sounds to which it relates.
    [4]
    Device (33) according to claim 3, characterized in that the synchronization unit (25) is controlled by a time delay code which is sent with the first incoming signal (11) and which contains a duration (27) which is the last incoming signal lagging behind the first incoming signal, merging the last incoming signal with the first incoming signal, that this duration has previously arrived, by temporarily storing the first incoming signal in the buffer during this duration.
    [5]
    Device (33) according to one of the preceding claims, characterized in that the device comprises input means (29) for the font size, font color and position of the subtitle on the screen, as well as setting means for adapting the subtitle signal to the input values .
    [6]
    A method for synchronizing a television signal, comprising an image signal and an audio signal, with a subtitle signal, comprising: receiving the television signal, receiving the subtitle signal, mixing the subtitle signal and the television signal into a composite signal, and the outputting the composite signal, characterized in that the television signal and subtitle signal are received and mixed at the end user and then sent directly to a display device.
    [7]
    Method according to claim 6, characterized in that the first incoming signal is buffered for a period of time accompanied by the signal and then mixed with the other incoming signal.
    [8]
    Method according to claim 7, characterized in that when mixing the subtitle signal and the television signal into a composite signal, the television signal and the subtitle signal are synchronized with each other such that in the composite signal the subtitle coincides with the images and sounds on which these relates.
    [9]
    A method according to claim 8, characterized in that at the start of receiving the subtitle signal, a time delay code is also received which contains a period of time that the incoming subtitle signal lags behind the incoming television signal, and the television signal is buffered during this period of time, and then merged with the incoming subtitle signal.
    类似技术:
    公开号 | 公开日 | 专利标题
    EP3787300A1|2021-03-03|Video stream processing method and apparatus, computer device and storage medium
    KR20130029055A|2013-03-21|System for translating spoken language into sign language for the deaf
    EP2063662B1|2016-05-04|Multimedia apparatus and synchronization method thereof
    KR100678938B1|2007-02-07|Apparatus and method for synchronization between moving picture and caption
    WO2014155377A1|2014-10-02|Method and system for automatically adding subtitles to streaming media content
    US10582268B2|2020-03-03|System and method for synchronization of audio and closed captioning
    CN102802044A|2012-11-28|Video processing method, terminal and subtitle server
    US9654813B2|2017-05-16|Method and system for synchronized multi-venue experience and production
    US10638082B2|2020-04-28|Systems and methods for picture-in-picture video conference functionality
    KR101192207B1|2012-10-17|System for providing real-time subtitles service of many languages for online live broadcasting and method thereof
    US20120105719A1|2012-05-03|Speech substitution of a real-time multimedia presentation
    EP3100457B1|2018-03-07|Method and apparatus for synchronizing playbacks at two electronic devices
    EP2840797A2|2015-02-25|Display apparatus and control method thereof
    JP2005286969A|2005-10-13|Recording and reproducing device, display device, and method for correcting caption display delay of captioned broadcast
    US20210029410A1|2021-01-28|Method and apparatus for looping a video file
    KR20180119101A|2018-11-01|System and method for creating broadcast subtitle
    NL2017188B1|2017-12-05|Device for real-time subtitling of a live television signal
    JP2006324779A|2006-11-30|Caption distributing system, caption transmitting apparatus, caption synthesis apparatus and subtitle distributing method
    US10692497B1|2020-06-23|Synchronized captioning system and methods for synchronizing captioning with scripted live performances
    KR20150019931A|2015-02-25|Display apparatus and control method thereof
    JP6271194B2|2018-01-31|Providing second screen information to mobile devices
    US20190222720A1|2019-07-18|Multimedia signal synchronization apparatus and sychronization method thereof
    KR101789221B1|2017-10-23|Device and method for providing moving picture, and computer program for executing the method
    CN101282438A|2008-10-08|Method for synchronization of image and sound as well as video apparatus using the same
    KR101832464B1|2018-02-26|Device and method for providing moving picture, and computer program for executing the method
    同族专利:
    公开号 | 公开日
    NL2017188B1|2017-12-05|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    NL2016803|2016-05-19|
    [返回顶部]